-- Logs begin at Mon 2022-07-11 10:33:25 UTC, end at Mon 2022-07-11 12:13:03 UTC. -- Jul 11 11:16:39.298575 dv-cinder-848429-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 11 11:16:39.308273 dv-cinder-848429-2-iscsi devstack@n-api.service[103793]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 11 11:16:39.310223 dv-cinder-848429-2-iscsi devstack@n-api.service[103793]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 11 11:16:39 2022] *** Jul 11 11:16:39.310223 dv-cinder-848429-2-iscsi devstack@n-api.service[103793]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 11 11:16:39.310223 dv-cinder-848429-2-iscsi devstack@n-api.service[103793]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 11 11:16:39.310223 dv-cinder-848429-2-iscsi devstack@n-api.service[103793]: nodename: dv-cinder-848429-2-iscsi Jul 11 11:16:39.310223 dv-cinder-848429-2-iscsi devstack@n-api.service[103793]: machine: x86_64 Jul 11 11:16:39.310223 dv-cinder-848429-2-iscsi devstack@n-api.service[103793]: clock source: unix Jul 11 11:16:39.310223 dv-cinder-848429-2-iscsi devstack@n-api.service[103793]: pcre jit disabled Jul 11 11:16:39.310223 dv-cinder-848429-2-iscsi devstack@n-api.service[103793]: detected number of CPU cores: 4 Jul 11 11:16:39.310223 dv-cinder-848429-2-iscsi devstack@n-api.service[103793]: current working directory: / Jul 11 11:16:39.310223 dv-cinder-848429-2-iscsi devstack@n-api.service[103793]: detected binary path: /usr/bin/uwsgi-core Jul 11 11:16:39.310948 dv-cinder-848429-2-iscsi devstack@n-api.service[103793]: your processes number limit is 47680 Jul 11 11:16:39.310948 dv-cinder-848429-2-iscsi devstack@n-api.service[103793]: your memory page size is 4096 bytes Jul 11 11:16:39.310948 dv-cinder-848429-2-iscsi devstack@n-api.service[103793]: detected max file descriptor number: 2048 Jul 11 11:16:39.310948 dv-cinder-848429-2-iscsi devstack@n-api.service[103793]: lock engine: pthread robust mutexes Jul 11 11:16:39.310948 dv-cinder-848429-2-iscsi devstack@n-api.service[103793]: thunder lock: enabled Jul 11 11:16:39.310948 dv-cinder-848429-2-iscsi devstack@n-api.service[103793]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 11 11:16:39.310948 dv-cinder-848429-2-iscsi devstack@n-api.service[103793]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 11 11:16:39.353659 dv-cinder-848429-2-iscsi devstack@n-api.service[103793]: Python main interpreter initialized at 0x5607357e69c0 Jul 11 11:16:39.353659 dv-cinder-848429-2-iscsi devstack@n-api.service[103793]: python threads support enabled Jul 11 11:16:39.353659 dv-cinder-848429-2-iscsi devstack@n-api.service[103793]: your server socket listen backlog is limited to 100 connections Jul 11 11:16:39.353659 dv-cinder-848429-2-iscsi devstack@n-api.service[103793]: your mercy for graceful operations on workers is 90 seconds Jul 11 11:16:39.353978 dv-cinder-848429-2-iscsi devstack@n-api.service[103793]: mapped 403077 bytes (393 KB) for 2 cores Jul 11 11:16:39.353978 dv-cinder-848429-2-iscsi devstack@n-api.service[103793]: *** Operational MODE: preforking *** Jul 11 11:16:39.354245 dv-cinder-848429-2-iscsi devstack@n-api.service[103793]: *** uWSGI is running in multiple interpreter mode *** Jul 11 11:16:39.354245 dv-cinder-848429-2-iscsi devstack@n-api.service[103793]: spawned uWSGI master process (pid: 103793) Jul 11 11:16:39.354424 dv-cinder-848429-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 11 11:16:39.355507 dv-cinder-848429-2-iscsi devstack@n-api.service[103793]: spawned uWSGI worker 1 (pid: 103794, cores: 1) Jul 11 11:16:39.355507 dv-cinder-848429-2-iscsi devstack@n-api.service[103793]: spawned uWSGI worker 2 (pid: 103795, cores: 1) Jul 11 11:16:39.355507 dv-cinder-848429-2-iscsi devstack@n-api.service[103793]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 11 11:16:40.009988 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 11 11:16:40.012155 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 11 11:16:41.125099 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 11 11:16:41.125099 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: from cryptography.utils import int_from_bytes Jul 11 11:16:41.125689 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 11 11:16:41.125689 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: from cryptography.utils import int_from_bytes Jul 11 11:16:41.128867 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 11 11:16:41.128867 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: from cryptography.utils import int_from_bytes Jul 11 11:16:41.129425 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 11 11:16:41.129425 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: from cryptography.utils import int_from_bytes Jul 11 11:16:43.613099 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 11 11:16:43.613667 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 11 11:16:43.613763 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 11 11:16:43.614130 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 11 11:16:43.614218 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 11 11:16:43.614299 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 11 11:16:43.614445 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 11 11:16:43.614578 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 11 11:16:43.614827 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.614930 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 11 11:16:43.615103 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 11 11:16:43.615200 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.615482 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.615585 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.615799 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.615909 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.616129 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.616215 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.616438 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.616532 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.616753 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.616839 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.617060 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.617152 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.617385 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.617507 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.617640 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.617737 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.617951 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.618040 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.618261 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.618370 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-848429-2-iscsi {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.618573 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.618670 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.618875 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.618964 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-848429-2-iscsi {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.619180 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.619300 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.619518 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.619607 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.619819 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.619921 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.620135 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.620229 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.620437 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.620531 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.620756 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.620924 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.621061 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.621379 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.621563 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.621692 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.621875 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.622009 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.622180 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.622296 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.622486 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.622622 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.622819 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.622958 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.623132 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.623218 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.623466 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.623554 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.623784 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.623878 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.624091 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.624185 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.624412 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.624553 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-848429-2-iscsi {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.624718 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.624805 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.625081 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.625169 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-848429-2-iscsi {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.625392 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.625478 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.625703 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.626313 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.626536 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.626676 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.626921 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.627037 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.627243 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.627376 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.627569 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.627665 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.627885 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.628009 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.628204 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.628294 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.628511 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.628600 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.628825 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.628920 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.629143 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.629232 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.629442 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.629536 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.629748 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.629844 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.630046 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.630143 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.630353 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.630440 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.630655 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.630756 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.630956 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.631043 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.631202 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.631321 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.631531 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.631627 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.631810 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.631904 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.632115 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.632202 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.632436 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.632527 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.632692 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.632786 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.632940 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.633060 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.633256 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.633345 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.633547 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.633643 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.633863 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.633960 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.634164 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.634252 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.634466 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.634561 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.634769 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.634856 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.635068 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.635157 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.635396 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.635490 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.635700 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.635787 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.635999 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.636095 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.636298 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.636384 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.636606 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.636710 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.636923 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.637013 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.637227 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.637317 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.637542 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.637641 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.637844 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.637940 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.638161 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.638271 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.638464 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.638609 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.638789 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.638883 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.639094 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.639196 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.639420 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.639510 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.639737 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.639826 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.640054 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.640149 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.640358 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.640451 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.640659 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.640749 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.640962 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.641063 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.641264 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.641357 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.642128 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.642229 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.642436 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.642554 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.642690 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.642788 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.642996 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.643143 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.643314 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.643442 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.643621 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.643708 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.643923 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.644023 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.644227 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.644324 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.644528 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.644621 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.644824 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.644912 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.645126 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.645220 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.645425 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.645522 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.645723 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.645811 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.646025 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.646113 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.646328 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.646415 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.646626 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.646736 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.646928 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.647027 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.647224 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.647371 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.647552 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.647651 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.647858 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.647953 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.648163 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.648250 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.648465 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.648573 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.648765 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.648854 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.649066 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.649162 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.649364 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.649463 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.649667 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.649756 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.649965 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.650053 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.650264 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.650361 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.650569 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.650656 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.650867 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.650955 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.651167 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.651310 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.651500 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.651595 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.651798 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.651885 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.652097 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.652193 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.652406 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.652492 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.652700 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.652786 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.653000 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.653101 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.653299 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.653397 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.653598 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.653687 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.653897 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.653986 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.654195 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.654291 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.654494 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.654581 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.654793 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.654891 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.655092 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.655185 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.655410 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.655500 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.655711 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.655800 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.656006 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.656102 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.656304 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.656389 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.656605 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.656693 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.656912 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.657076 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.657236 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.657335 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.657536 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.657626 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.657839 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.657925 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.658143 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.658247 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.658461 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:16:43.658549 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.658795 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.658883 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.659103 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.659205 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.659455 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.659545 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.659781 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.659882 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.660097 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.660194 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.660405 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.660500 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.660715 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.660816 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.661025 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.661112 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.661329 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.661423 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.661636 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.661733 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.661942 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.662031 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.662255 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.662341 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.662564 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.662657 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.662877 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.663055 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.663186 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.663373 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.663523 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.663613 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.663839 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.663929 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.664146 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.664235 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.664458 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.664554 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.664766 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.664854 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.665081 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.665168 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.665383 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.665470 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.665717 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.665804 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.666028 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.666122 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.666350 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.666450 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.666667 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.666755 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.666982 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.667071 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.667302 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.667410 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.667610 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.667699 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.667914 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.668003 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.668226 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.668322 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.668537 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.668634 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.668844 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.668944 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.669155 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.669252 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.669458 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.669547 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.669762 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.669857 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.670065 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.670155 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.670369 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.670457 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.670672 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.670760 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.670980 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.671067 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.671308 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.671398 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.671619 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.671705 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.671923 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.672013 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.672234 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.672322 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.672538 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.672628 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.672866 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.672956 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.673171 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.673259 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.673467 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.673562 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.673763 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.673853 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.674060 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.674165 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.674361 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.674457 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.674657 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.674752 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.674959 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.675046 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.675271 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.675375 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.675585 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.675680 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.675911 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.675999 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.676210 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.676306 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.676519 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.676607 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.676824 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.676913 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.677127 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.677227 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.677429 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.677518 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.677735 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.677821 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.678037 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.678125 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.678334 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.678431 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.678641 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.678727 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.678946 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.679043 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.679243 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.679349 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.679583 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.679923 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.680140 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.680231 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.680437 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.680525 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.680747 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.680836 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.681048 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.681136 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.681351 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.681439 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.681655 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.681754 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.681959 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.682047 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.682268 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.682361 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.682577 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.682678 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.682881 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.682968 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.683198 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.683312 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.683546 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.683647 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.683848 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.683944 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.684168 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.684263 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.684487 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.684582 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.684796 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.684884 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.685095 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.685183 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.685402 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.685492 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.685702 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.685791 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.686000 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.686089 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.686301 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.686430 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.686603 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.686690 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.686901 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.686998 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.687201 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.687356 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.687526 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.687616 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.687827 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.687915 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.688125 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.688214 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.688939 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.689027 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.689242 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.689340 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.689539 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.689626 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.689837 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.689925 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.690136 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.690233 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.690438 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.690525 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.690739 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.690827 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.691081 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.691179 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.691430 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.691571 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.691742 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.691831 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.692059 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.692160 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.692365 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.692454 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.692675 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.692763 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.692981 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.693070 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.693286 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.693375 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.693589 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.693677 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.693892 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.693994 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.694198 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.694285 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.694500 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.694587 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.694814 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.694901 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.695115 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.695202 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.695456 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.695544 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.695758 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.695846 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.696070 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.696169 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.696371 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.696471 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.696681 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.696769 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.696981 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.697066 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.697293 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.697395 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.697629 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.697720 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.697944 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.698032 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.698248 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.698345 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.698558 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.698647 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.698863 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.698950 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.699166 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.699283 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.699496 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.699600 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.699802 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.699889 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.700107 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.700203 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.700409 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.700496 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.700733 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.700834 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.701024 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.701120 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.701337 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.701432 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.701640 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.701727 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.701955 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.702045 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.702254 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.702349 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.702564 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.702653 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.702866 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.702960 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.703177 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.703315 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.703522 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.703610 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.703831 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.703921 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.704704 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.704800 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.705010 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.705111 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.705318 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.705407 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.705624 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.705710 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.705923 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.706018 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.706225 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.706320 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.706525 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.706613 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.706829 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.706931 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.707134 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.707229 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.707466 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.707566 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.707769 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.707872 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.708076 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.708171 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.708378 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.708464 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.708677 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.708767 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.708975 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.709062 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.709273 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.709360 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.709574 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.709663 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.709880 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.709974 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.710198 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.710284 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.710506 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.710596 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.710803 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.710897 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.711103 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.711192 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.711441 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.711539 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.711742 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.711828 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.712041 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.712128 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.712341 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.712431 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.712640 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.712728 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.712941 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.713035 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.713242 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.713330 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.713557 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.713643 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.713871 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.713968 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.714173 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.714267 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.714481 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.714625 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.714789 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.714887 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.715095 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.715184 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.715422 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.715514 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.715730 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.715829 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.716038 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.716124 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.716342 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.716429 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.716647 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.716746 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.716951 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.717037 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.717253 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.717355 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.717557 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.717650 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.717854 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.717943 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.718153 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.718247 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.718460 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.718549 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.718764 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.718852 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.719061 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.719150 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.719393 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.719486 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.719732 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.719823 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.720077 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.720293 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.720383 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.720622 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.720934 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.721021 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.721250 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.721347 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.721564 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.721650 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.721874 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.721961 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.722188 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.722286 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.722509 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.722598 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.722838 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.722927 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.723138 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.723235 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.723468 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.723566 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.723770 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.723870 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.724069 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.724157 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.724374 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.724471 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.724673 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.724760 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.724970 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.725057 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.725269 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.725371 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.725571 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.725659 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.725870 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.725966 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.726169 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.726272 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.726468 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.726562 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.726770 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.726859 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.727071 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.727160 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.727395 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.727486 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.727703 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.727803 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.728004 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.728094 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.728312 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.728407 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.728613 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.728699 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.728911 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.729000 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.729210 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.729298 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.729510 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.729598 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.729808 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.729905 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.730109 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.730197 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.730448 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.730545 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.730753 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.730841 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.731086 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.731173 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.731406 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.731507 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.731709 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.731797 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.732029 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.732119 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.732329 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.732426 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.732630 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.732726 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.732927 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.733016 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.733230 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.733320 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.733534 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.733628 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.733831 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.733927 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.734135 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.734232 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.734436 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.734523 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.734735 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.734822 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.735038 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.735133 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.735386 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.735491 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.735692 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.735780 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.735989 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.736080 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.736295 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.736381 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.736594 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.736694 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.736895 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.736984 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.737191 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.737279 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.737490 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.737586 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.737789 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.737885 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.738085 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.738176 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.738387 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.738484 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.738683 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.738772 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.738989 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.739075 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.739303 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.739407 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.739604 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.739700 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.739901 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.739996 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.740202 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.740290 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.740502 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.740589 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.740801 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.740889 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.741108 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.741207 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.741409 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.741501 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.741707 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.741796 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.742003 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.742099 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.742306 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.742395 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.742603 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.742691 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.742899 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.742989 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.743198 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.743304 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.743526 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.743627 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.743835 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.743924 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.744130 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.744263 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.744434 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.744531 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.744733 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.744823 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.745031 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.745120 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.745328 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.745425 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.745629 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.745716 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.745923 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.746010 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.746218 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.746315 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.746514 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.746602 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.746811 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.746896 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.747104 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.747199 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.747429 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.747530 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.747733 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.747821 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.748030 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.748119 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.748328 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.748419 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.748624 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.748715 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.748923 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.749011 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.749222 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.749310 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.749561 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.749648 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.749863 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.749959 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.750168 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.750255 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.750479 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.750576 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.751293 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.751392 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.751618 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.751706 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.751928 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.752033 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.752227 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.752323 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.752538 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.752625 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.752841 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.752937 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.753148 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.753247 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.753447 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.753535 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.753745 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.753843 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.754046 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.754132 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.754349 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.754436 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.754650 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.754749 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.754964 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.755052 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.755290 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.755394 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.755614 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.755703 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.755913 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.756002 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.756216 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.756306 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.756521 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.756618 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.756824 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.756913 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.757127 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.757217 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.757430 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.757521 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.757733 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.757824 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.758038 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.758124 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.758340 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.758428 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.758645 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.758732 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.758947 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.759043 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.759246 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.759390 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.759568 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.759658 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.759869 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.759965 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.760168 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.760255 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.760472 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.760560 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.760775 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.760875 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.761070 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.761158 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.761372 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.761461 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.761672 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.761770 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.761975 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.762063 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.762274 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.762370 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.762579 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.762689 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.762879 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.762994 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.763316 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.763418 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.763618 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.763708 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.763920 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.764008 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.764220 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.764306 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.764525 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.764616 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.764830 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.764923 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.765125 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.765212 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.765440 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.765528 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.765740 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.765836 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.766106 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.766206 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.766427 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.767008 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.767244 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.767391 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.767571 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.767673 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.767876 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.768016 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.768176 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.768263 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.768475 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.768575 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.768772 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.768862 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.769069 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.769157 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.769368 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.769467 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.769666 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.769761 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.769979 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.770067 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.770277 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.770366 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.770593 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.770682 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.770961 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.771055 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.771331 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.771434 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.771641 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.771731 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.771983 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.772071 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.772301 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.772391 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.772616 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.772704 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.772932 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.773025 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.773230 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.773320 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.773536 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.773654 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.773840 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.773939 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.774157 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.774256 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.774469 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.774558 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.774770 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.774859 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.775077 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.775175 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.775397 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.775488 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.775714 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.775814 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.776015 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.776117 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.776327 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.776414 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.776643 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.776731 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.776954 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.777051 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.777273 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.777361 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.777647 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.777736 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.777961 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.778096 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.778279 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.778368 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.778579 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.778667 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.778877 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.778968 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.779181 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.779313 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.779505 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.779605 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.779807 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.779905 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.780109 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.780205 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.780407 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.780495 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.780711 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.780803 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.781013 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.781103 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.781315 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.781405 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.781613 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.781703 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.781910 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.781999 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.782237 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.782340 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.782540 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.782636 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.782854 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.782949 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.783160 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.783274 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.783499 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.783588 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.783809 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.783896 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.784108 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.784206 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.784425 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.784515 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.784728 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.784820 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.785026 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.785123 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.785325 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.785421 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.785622 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.785712 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.785922 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.786011 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.786226 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.786315 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.786544 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.786637 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.786858 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.786947 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.787178 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.787330 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.787512 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.787603 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.787838 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.787939 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.788145 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.788240 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.788460 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.788593 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.788773 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.788864 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.789089 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.789176 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.789389 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.789487 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.789687 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.789776 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.789992 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.790082 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.790291 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.790390 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.790589 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.790678 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.790889 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.790978 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.791187 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.791301 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.791509 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.791600 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.791809 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.791898 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.792108 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.792212 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.792409 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.792505 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.792710 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.792799 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.793024 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.793114 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.793323 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.793410 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.793621 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.793708 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.793922 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.794019 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.794218 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.794308 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.794518 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.794607 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.794821 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.794913 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.795159 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.795276 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.795491 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.795587 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.795807 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.795895 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.796127 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.796225 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.796432 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.796530 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.796750 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.796850 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.797059 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.797146 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.797371 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.797468 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.797707 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.797797 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.798022 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.798111 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.798330 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.798427 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.798640 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.798740 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.798947 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.799036 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.799269 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.799375 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.799585 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.799675 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.799889 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.799976 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.800199 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.800296 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.800509 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.800712 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.800847 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.801036 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.801325 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.801415 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.801637 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.801725 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.801944 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.802040 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.802252 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.802342 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.802558 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.802647 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.802863 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.802952 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.803168 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.803308 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.803496 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.803586 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.803803 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.803908 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.804111 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.804200 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.804421 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.804510 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.804993 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.805097 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.805314 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.805403 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.805624 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.805711 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.805933 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.806024 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.806242 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.806340 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.806549 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.806638 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.806860 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.806949 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.807173 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.807280 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.807510 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.807609 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.807820 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.807910 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.808129 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.808218 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.808438 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.808541 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.808743 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.808832 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.809047 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.809144 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.809354 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.809521 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.809657 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.809754 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.809962 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.810052 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.810266 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.810368 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.810573 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.810663 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.810876 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.810965 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.811184 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.811321 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.811524 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.811624 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.811835 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.811923 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.812143 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.812233 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.812450 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.812547 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.812760 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.812858 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.813074 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.813789 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.813923 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.814115 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.814436 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.814534 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.814751 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.814839 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.815067 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.815167 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.815399 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.815503 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.815711 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.815801 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.816027 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.816113 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.816326 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.816427 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.816625 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.816714 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.816930 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.817020 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.817227 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.817386 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.817524 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.817618 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.817828 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.817915 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.818129 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.818217 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.818423 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.818511 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.818736 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.818862 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.819033 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.819130 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.819376 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.819590 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.819679 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.819930 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.820200 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.820291 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.820541 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.820630 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.820857 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.820958 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.821167 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.821254 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.821470 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.821560 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.821789 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.821886 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.822091 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.822181 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.822392 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.822481 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.822697 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.822797 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.822999 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.823087 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.823322 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.823413 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.823625 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.823727 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.823931 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.824021 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.824231 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.824320 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.824529 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.824618 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.824833 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.824921 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.825131 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.825262 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.825437 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.825535 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.825737 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.825824 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.826035 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.826123 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.826333 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.826425 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.826635 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.826721 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.826930 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.827018 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.827226 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.827346 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.827548 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.827637 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.827850 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.827950 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.828153 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.828251 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.828449 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.828574 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.828751 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.828849 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.829585 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.829679 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.829893 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.829989 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.830190 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.830287 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.830494 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.830592 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.830792 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.830881 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.831099 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.831198 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.831458 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.831548 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.831758 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.831847 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.832067 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.832158 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.832364 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.832451 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.832680 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.832769 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.832985 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.833073 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.833285 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.833373 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.833607 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.833702 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.833913 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.834003 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.834256 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.834435 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.834570 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.834765 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.835102 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.835197 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.835432 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.835524 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.835760 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.835862 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.836064 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.836153 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.836363 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.836459 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.836662 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.836763 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.836980 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.837076 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.837285 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.837384 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.837592 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.837690 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.837904 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.837991 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.838208 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.838302 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.838509 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.838599 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.838812 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.838900 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.839117 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.839205 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.839444 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.839537 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.839748 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.839838 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.840050 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.840139 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.840354 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.840444 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.840654 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.840743 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.840956 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.841053 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.841260 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.841347 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.841570 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.841659 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.841883 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.841981 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.842191 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.842287 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.842500 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.842588 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.842808 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.842905 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.843113 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.843203 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.843444 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.843533 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.843748 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.843854 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.844052 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.844142 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.844357 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.844444 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.844692 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.844793 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.845000 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.845090 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.845299 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.845424 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.845624 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.845712 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.845928 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.846018 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.846308 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.846396 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.846625 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.846722 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.846929 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.847025 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.847244 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.847381 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.847575 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.847672 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.847897 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.847993 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.848214 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.848311 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.848521 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.848608 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.848841 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.848929 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.849150 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.849248 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.849478 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.849567 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.849797 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.849884 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.850102 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.850192 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.850405 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.850494 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.850705 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.850792 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.851010 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.851099 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.851334 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.851437 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.851641 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.851732 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.851941 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.852032 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.852238 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.852327 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.852540 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.852637 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.852838 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.852926 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.853139 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.853228 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.853438 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.853539 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.853738 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.853827 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.854039 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.854130 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.854333 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.854434 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.854632 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.854721 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.854929 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.855073 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.855225 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.855362 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.855544 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.855634 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.855839 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.855928 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.856140 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.856228 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.856436 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.856524 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.856734 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.856823 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.857031 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.857121 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.857329 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.857426 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.857627 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.857717 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.857936 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.858045 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.858227 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.858320 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.858556 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.858644 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.858873 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.858971 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.859178 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.859295 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.859518 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.859656 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.859823 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.859912 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.860659 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.860761 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.860977 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.861074 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.861301 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.861390 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.861614 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.861710 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.861926 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.862027 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.862233 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.862322 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.862541 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.862629 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.862846 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.862945 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.863195 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.863341 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.863483 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.863620 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.863791 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.863882 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.864107 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.864195 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.864419 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.864508 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.864719 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.864808 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.865038 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.865127 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.865348 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.865435 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.865660 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.865757 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.865969 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.866059 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.866276 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.866374 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.866588 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.866677 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.866891 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.866978 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.867197 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.867317 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.867532 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.867630 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.867839 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.867928 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.868143 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.868306 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.868450 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.868537 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.868758 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.868860 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.869073 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.869164 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.869388 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.869476 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.869692 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.869850 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.870014 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.870105 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.870322 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.870417 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.870647 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.870736 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.870956 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.871045 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.871317 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.871411 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.871629 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.871716 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.871937 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.872033 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.872242 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.872332 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.872543 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.872640 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.872782 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 11 11:16:43.872879 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.873168 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:16:43.873409 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 11 11:16:43.934055 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: INFO dbcounter [None req-1e881df7-0f0e-4bf1-8625-42995fcaf61b None None] Registered counter for database nova_api Jul 11 11:16:43.934773 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: INFO dbcounter [None req-86bf3521-e695-499d-8760-ba310e82935f None None] Registered counter for database nova_api Jul 11 11:16:44.045437 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG oslo_db.sqlalchemy.engines [None req-1e881df7-0f0e-4bf1-8625-42995fcaf61b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103795) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 11:16:44.046949 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG oslo_db.sqlalchemy.engines [None req-86bf3521-e695-499d-8760-ba310e82935f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103794) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 11:16:44.052566 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG dbcounter [-] [103795] Writer thread running {{(pid=103795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 11:16:44.054558 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG dbcounter [-] [103794] Writer thread running {{(pid=103794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 11:16:44.108530 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.context [None req-1e881df7-0f0e-4bf1-8625-42995fcaf61b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),342f6239-eef4-41fd-9223-51ec0b89b6f5(cell1) {{(pid=103795) load_cells /opt/stack/nova/nova/context.py:464}} Jul 11 11:16:44.113027 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG oslo_concurrency.lockutils [None req-1e881df7-0f0e-4bf1-8625-42995fcaf61b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:16:44.114648 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG oslo_concurrency.lockutils [None req-1e881df7-0f0e-4bf1-8625-42995fcaf61b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:16:44.115411 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG oslo_concurrency.lockutils [None req-1e881df7-0f0e-4bf1-8625-42995fcaf61b None None] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:16:44.117483 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG oslo_concurrency.lockutils [None req-1e881df7-0f0e-4bf1-8625-42995fcaf61b None None] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:16:44.117863 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.context [None req-86bf3521-e695-499d-8760-ba310e82935f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),342f6239-eef4-41fd-9223-51ec0b89b6f5(cell1) {{(pid=103794) load_cells /opt/stack/nova/nova/context.py:464}} Jul 11 11:16:44.119456 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: INFO dbcounter [None req-1e881df7-0f0e-4bf1-8625-42995fcaf61b None None] Registered counter for database nova_cell0 Jul 11 11:16:44.121805 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG oslo_concurrency.lockutils [None req-86bf3521-e695-499d-8760-ba310e82935f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:16:44.123363 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: INFO dbcounter [None req-1e881df7-0f0e-4bf1-8625-42995fcaf61b None None] Registered counter for database nova_cell1 Jul 11 11:16:44.123475 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG oslo_concurrency.lockutils [None req-86bf3521-e695-499d-8760-ba310e82935f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:16:44.124218 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG oslo_concurrency.lockutils [None req-86bf3521-e695-499d-8760-ba310e82935f None None] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:16:44.126866 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG oslo_concurrency.lockutils [None req-86bf3521-e695-499d-8760-ba310e82935f None None] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:16:44.128874 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: INFO dbcounter [None req-86bf3521-e695-499d-8760-ba310e82935f None None] Registered counter for database nova_cell0 Jul 11 11:16:44.131764 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG oslo_db.sqlalchemy.engines [None req-1e881df7-0f0e-4bf1-8625-42995fcaf61b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103795) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 11:16:44.132881 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: INFO dbcounter [None req-86bf3521-e695-499d-8760-ba310e82935f None None] Registered counter for database nova_cell1 Jul 11 11:16:44.133409 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG oslo_db.sqlalchemy.engines [None req-1e881df7-0f0e-4bf1-8625-42995fcaf61b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103795) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 11:16:44.139009 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG dbcounter [-] [103795] Writer thread running {{(pid=103795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 11:16:44.140377 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG oslo_db.sqlalchemy.engines [None req-86bf3521-e695-499d-8760-ba310e82935f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103794) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 11:16:44.141611 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG oslo_db.sqlalchemy.engines [None req-86bf3521-e695-499d-8760-ba310e82935f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103794) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 11:16:44.141725 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG dbcounter [-] [103795] Writer thread running {{(pid=103795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 11:16:44.148006 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG dbcounter [-] [103794] Writer thread running {{(pid=103794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 11:16:44.149602 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG dbcounter [-] [103794] Writer thread running {{(pid=103794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 11:16:44.287035 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: INFO dbcounter [None req-1e881df7-0f0e-4bf1-8625-42995fcaf61b None None] Registered counter for database nova_cell0 Jul 11 11:16:44.295762 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG oslo_db.sqlalchemy.engines [None req-1e881df7-0f0e-4bf1-8625-42995fcaf61b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103795) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 11:16:44.296808 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: INFO dbcounter [None req-86bf3521-e695-499d-8760-ba310e82935f None None] Registered counter for database nova_cell0 Jul 11 11:16:44.300778 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG dbcounter [-] [103795] Writer thread running {{(pid=103795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 11:16:44.306244 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG oslo_db.sqlalchemy.engines [None req-86bf3521-e695-499d-8760-ba310e82935f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103794) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 11:16:44.310574 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG dbcounter [-] [103794] Writer thread running {{(pid=103794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 11:16:44.740248 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: WARNING keystonemiddleware.auth_token [None req-1e881df7-0f0e-4bf1-8625-42995fcaf61b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 11 11:16:44.747581 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: WARNING keystonemiddleware.auth_token [None req-1e881df7-0f0e-4bf1-8625-42995fcaf61b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 11 11:16:44.765905 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: WARNING keystonemiddleware.auth_token [None req-86bf3521-e695-499d-8760-ba310e82935f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 11 11:16:44.773535 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: WARNING keystonemiddleware.auth_token [None req-86bf3521-e695-499d-8760-ba310e82935f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 11 11:16:45.084559 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: WARNING keystonemiddleware.auth_token [None req-1e881df7-0f0e-4bf1-8625-42995fcaf61b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 11 11:16:45.090476 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: WARNING keystonemiddleware.auth_token [None req-1e881df7-0f0e-4bf1-8625-42995fcaf61b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 11 11:16:45.095730 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5607357e69c0 pid: 103795 (default app) Jul 11 11:16:45.097777 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi [None req-1e881df7-0f0e-4bf1-8625-42995fcaf61b None None] Calling method '>' {{(pid=103795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:16:45.098960 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: INFO nova.api.openstack.requestlog [None req-1e881df7-0f0e-4bf1-8625-42995fcaf61b None None] 10.222.0.26 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001725 Jul 11 11:16:45.099394 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: [pid: 103795|app: 0|req: 1/1] 10.222.0.26 () {50 vars in 788 bytes} [Mon Jul 11 11:16:45 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:16:45.109836 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: WARNING keystonemiddleware.auth_token [None req-86bf3521-e695-499d-8760-ba310e82935f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 11 11:16:45.116283 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: WARNING keystonemiddleware.auth_token [None req-86bf3521-e695-499d-8760-ba310e82935f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 11 11:16:45.121458 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5607357e69c0 pid: 103794 (default app) Jul 11 11:18:03.696075 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi [None req-1e881df7-0f0e-4bf1-8625-42995fcaf61b None None] Calling method '>' {{(pid=103795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:18:03.697085 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: INFO nova.api.openstack.requestlog [None req-1e881df7-0f0e-4bf1-8625-42995fcaf61b None None] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Jul 11 11:18:03.697645 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: [pid: 103795|app: 0|req: 2/2] 10.222.0.26 () {54 vars in 930 bytes} [Mon Jul 11 11:18:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:18:03.710075 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG dbcounter [-] [103794] Writing DB stats nova_api:SELECT=3 {{(pid=103794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:18:03.711198 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG dbcounter [-] [103794] Writing DB stats nova_cell0:SELECT=3 {{(pid=103794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:18:03.712232 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG dbcounter [-] [103794] Writing DB stats nova_cell1:SELECT=3 {{(pid=103794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:18:03.712935 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG dbcounter [-] [103794] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:18:04.570642 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi [None req-d933bea9-5ee2-4ea7-a806-2adc8d49757b admin admin] Calling method '>' {{(pid=103794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:18:04.600525 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: INFO nova.api.openstack.requestlog [None req-d933bea9-5ee2-4ea7-a806-2adc8d49757b admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.895485 Jul 11 11:18:04.601406 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: [pid: 103794|app: 0|req: 1/3] 10.222.0.26 () {60 vars in 1291 bytes} [Mon Jul 11 11:18:03 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:18:06.839645 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi [None req-1e881df7-0f0e-4bf1-8625-42995fcaf61b None None] Calling method '>' {{(pid=103795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:18:06.841010 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: INFO nova.api.openstack.requestlog [None req-1e881df7-0f0e-4bf1-8625-42995fcaf61b None None] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001743 Jul 11 11:18:06.841598 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: [pid: 103795|app: 0|req: 3/4] 10.222.0.26 () {54 vars in 930 bytes} [Mon Jul 11 11:18:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:18:07.298002 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi [None req-fe44cdfa-0785-47a5-933a-9a476b500f06 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "swap": 0, "disk": 1, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "rxtx_factor": 1.0, "id": "c1"}} {{(pid=103794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:18:07.317754 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 11:18:07.317754 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: warnings.warn(msg) Jul 11 11:18:07.429610 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: INFO nova.api.openstack.requestlog [None req-fe44cdfa-0785-47a5-933a-9a476b500f06 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.581036 Jul 11 11:18:07.430323 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: [pid: 103794|app: 0|req: 2/5] 10.222.0.26 () {64 vars in 1282 bytes} [Mon Jul 11 11:18:06 2022] POST /compute/v2.1/flavors => generated 407 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 11 11:18:07.652764 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi [None req-a528a659-485b-4d55-924f-16d5b7aaa1fa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:18:07.655330 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 11:18:07.655330 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: warnings.warn(msg) Jul 11 11:18:07.670702 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG dbcounter [-] [103795] Writing DB stats nova_api:SELECT=3 {{(pid=103795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:18:07.671153 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG dbcounter [-] [103795] Writing DB stats nova_cell1:SELECT=3 {{(pid=103795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:18:07.671729 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG dbcounter [-] [103795] Writing DB stats nova_cell0:SELECT=3 {{(pid=103795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:18:07.672462 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG dbcounter [-] [103795] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:18:07.786816 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: INFO nova.api.openstack.requestlog [None req-a528a659-485b-4d55-924f-16d5b7aaa1fa admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.348091 Jul 11 11:18:07.787444 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: [pid: 103795|app: 0|req: 4/6] 10.222.0.26 () {64 vars in 1335 bytes} [Mon Jul 11 11:18:07 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:18:10.016227 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi [None req-fe44cdfa-0785-47a5-933a-9a476b500f06 admin admin] Calling method '>' {{(pid=103794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:18:10.017253 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: INFO nova.api.openstack.requestlog [None req-fe44cdfa-0785-47a5-933a-9a476b500f06 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Jul 11 11:18:10.017652 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: [pid: 103794|app: 0|req: 3/7] 10.222.0.26 () {54 vars in 930 bytes} [Mon Jul 11 11:18:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:18:10.680619 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi [None req-a1633e4d-2ef8-4421-bd1c-b31b87bb5e72 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "ram": 512, "disk": 5, "os-flavor-access:is_public": true, "id": "d1"}} {{(pid=103795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:18:10.702750 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 11:18:10.702750 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: warnings.warn(msg) Jul 11 11:18:10.778263 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: INFO nova.api.openstack.requestlog [None req-a1633e4d-2ef8-4421-bd1c-b31b87bb5e72 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.754709 Jul 11 11:18:10.778958 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: [pid: 103795|app: 0|req: 5/8] 10.222.0.26 () {64 vars in 1282 bytes} [Mon Jul 11 11:18:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 11:18:10.790907 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi [None req-26376551-c5b5-44fe-bac5-9daca42809cb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:18:10.792611 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 11:18:10.792611 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: warnings.warn(msg) Jul 11 11:18:10.902420 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: INFO nova.api.openstack.requestlog [None req-26376551-c5b5-44fe-bac5-9daca42809cb admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.115229 Jul 11 11:18:10.903561 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: [pid: 103794|app: 0|req: 4/9] 10.222.0.26 () {64 vars in 1335 bytes} [Mon Jul 11 11:18:10 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:18:13.173132 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi [None req-a1633e4d-2ef8-4421-bd1c-b31b87bb5e72 admin admin] Calling method '>' {{(pid=103795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:18:13.174160 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: INFO nova.api.openstack.requestlog [None req-a1633e4d-2ef8-4421-bd1c-b31b87bb5e72 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Jul 11 11:18:13.174551 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: [pid: 103795|app: 0|req: 6/10] 10.222.0.26 () {54 vars in 930 bytes} [Mon Jul 11 11:18:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:18:13.577160 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi [None req-460b2452-6b41-4066-a5cc-ef932cc2e5c7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "name": "ds1G", "vcpus": 1, "swap": 0, "disk": 10, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "rxtx_factor": 1.0}} {{(pid=103794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:18:13.645864 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: INFO nova.api.openstack.requestlog [None req-460b2452-6b41-4066-a5cc-ef932cc2e5c7 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.464480 Jul 11 11:18:13.646455 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: [pid: 103794|app: 0|req: 5/11] 10.222.0.26 () {64 vars in 1282 bytes} [Mon Jul 11 11:18:13 2022] POST /compute/v2.1/flavors => generated 404 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 11 11:18:13.658389 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi [None req-39ee9f86-6d23-48b4-a592-b3ff0525bee0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:18:13.728811 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: INFO nova.api.openstack.requestlog [None req-39ee9f86-6d23-48b4-a592-b3ff0525bee0 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.074076 Jul 11 11:18:13.729499 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: [pid: 103795|app: 0|req: 7/12] 10.222.0.26 () {64 vars in 1335 bytes} [Mon Jul 11 11:18:13 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:18:15.953181 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi [None req-460b2452-6b41-4066-a5cc-ef932cc2e5c7 admin admin] Calling method '>' {{(pid=103794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:18:15.954198 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: INFO nova.api.openstack.requestlog [None req-460b2452-6b41-4066-a5cc-ef932cc2e5c7 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Jul 11 11:18:15.954598 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: [pid: 103794|app: 0|req: 6/13] 10.222.0.26 () {54 vars in 930 bytes} [Mon Jul 11 11:18:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:18:16.410751 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi [None req-ee1ec398-6237-45b6-8949-12f8e0f9da29 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 2, "id": "d3", "disk": 10, "name": "ds2G", "rxtx_factor": 1.0, "ram": 2048, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:18:16.497342 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: INFO nova.api.openstack.requestlog [None req-ee1ec398-6237-45b6-8949-12f8e0f9da29 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.536778 Jul 11 11:18:16.498649 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: [pid: 103795|app: 0|req: 8/14] 10.222.0.26 () {64 vars in 1282 bytes} [Mon Jul 11 11:18:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 11:18:16.510767 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi [None req-50a236cd-028c-49b8-8dd2-e15e47c6e202 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:18:16.603644 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: INFO nova.api.openstack.requestlog [None req-50a236cd-028c-49b8-8dd2-e15e47c6e202 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.096718 Jul 11 11:18:16.604372 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: [pid: 103794|app: 0|req: 7/15] 10.222.0.26 () {64 vars in 1335 bytes} [Mon Jul 11 11:18:16 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:18:18.829773 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi [None req-ee1ec398-6237-45b6-8949-12f8e0f9da29 admin admin] Calling method '>' {{(pid=103795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:18:18.830784 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: INFO nova.api.openstack.requestlog [None req-ee1ec398-6237-45b6-8949-12f8e0f9da29 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Jul 11 11:18:18.831181 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: [pid: 103795|app: 0|req: 9/16] 10.222.0.26 () {54 vars in 930 bytes} [Mon Jul 11 11:18:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:18:19.252286 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi [None req-2c64c0bf-61e0-46b6-aae8-256ce51efd9a admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "vcpus": 4, "name": "ds4G", "ram": 4096, "os-flavor-access:is_public": true}} {{(pid=103794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:18:19.325310 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: INFO nova.api.openstack.requestlog [None req-2c64c0bf-61e0-46b6-aae8-256ce51efd9a admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.488108 Jul 11 11:18:19.333117 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: [pid: 103794|app: 0|req: 8/17] 10.222.0.26 () {64 vars in 1282 bytes} [Mon Jul 11 11:18:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 11:18:19.338551 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi [None req-d4462b57-b164-45b8-9851-af628b10e898 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:18:19.433057 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: INFO nova.api.openstack.requestlog [None req-d4462b57-b164-45b8-9851-af628b10e898 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.098544 Jul 11 11:18:19.433845 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: [pid: 103795|app: 0|req: 10/18] 10.222.0.26 () {64 vars in 1335 bytes} [Mon Jul 11 11:18:19 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:18:21.723419 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi [None req-2c64c0bf-61e0-46b6-aae8-256ce51efd9a admin admin] Calling method '>' {{(pid=103794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:18:21.724456 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: INFO nova.api.openstack.requestlog [None req-2c64c0bf-61e0-46b6-aae8-256ce51efd9a admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Jul 11 11:18:21.724861 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: [pid: 103794|app: 0|req: 9/19] 10.222.0.26 () {54 vars in 930 bytes} [Mon Jul 11 11:18:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:18:22.157598 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi [None req-3f5eca49-a10d-4b26-82e0-13b4f1763f86 admin admin] Calling method '>' {{(pid=103795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:18:22.184668 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: INFO nova.api.openstack.requestlog [None req-3f5eca49-a10d-4b26-82e0-13b4f1763f86 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.453541 Jul 11 11:18:22.185787 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: [pid: 103795|app: 0|req: 11/20] 10.222.0.26 () {60 vars in 1291 bytes} [Mon Jul 11 11:18:21 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:18:24.408573 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi [None req-2c64c0bf-61e0-46b6-aae8-256ce51efd9a admin admin] Calling method '>' {{(pid=103794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:18:24.409580 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: INFO nova.api.openstack.requestlog [None req-2c64c0bf-61e0-46b6-aae8-256ce51efd9a admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Jul 11 11:18:24.409981 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: [pid: 103794|app: 0|req: 10/21] 10.222.0.26 () {54 vars in 930 bytes} [Mon Jul 11 11:18:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:18:24.854213 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi [None req-b3ef66d4-8005-4db4-a266-f2bc98aa53bc admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.tiny", "vcpus": 1, "disk": 1, "swap": 0, "ram": 512}} {{(pid=103795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:18:24.925310 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: INFO nova.api.openstack.requestlog [None req-b3ef66d4-8005-4db4-a266-f2bc98aa53bc admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.509647 Jul 11 11:18:24.926062 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: [pid: 103795|app: 0|req: 12/22] 10.222.0.26 () {64 vars in 1282 bytes} [Mon Jul 11 11:18:24 2022] POST /compute/v2.1/flavors => generated 402 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 11:18:24.939447 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi [None req-9ca55945-9fc6-4155-a79f-d6bcbe0461aa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:18:25.008917 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: INFO nova.api.openstack.requestlog [None req-9ca55945-9fc6-4155-a79f-d6bcbe0461aa admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.074420 Jul 11 11:18:25.009490 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: [pid: 103794|app: 0|req: 11/23] 10.222.0.26 () {64 vars in 1332 bytes} [Mon Jul 11 11:18:24 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:18:27.410857 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi [None req-b3ef66d4-8005-4db4-a266-f2bc98aa53bc admin admin] Calling method '>' {{(pid=103795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:18:27.411927 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: INFO nova.api.openstack.requestlog [None req-b3ef66d4-8005-4db4-a266-f2bc98aa53bc admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 Jul 11 11:18:27.412516 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: [pid: 103795|app: 0|req: 13/24] 10.222.0.26 () {54 vars in 930 bytes} [Mon Jul 11 11:18:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:18:27.811846 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi [None req-6fa8459a-4871-4ad6-881b-0990bfdd0f50 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "vcpus": 1, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "2", "swap": 0, "name": "m1.small"}} {{(pid=103794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:18:27.879959 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: INFO nova.api.openstack.requestlog [None req-6fa8459a-4871-4ad6-881b-0990bfdd0f50 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.461983 Jul 11 11:18:27.880520 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: [pid: 103794|app: 0|req: 12/25] 10.222.0.26 () {64 vars in 1282 bytes} [Mon Jul 11 11:18:27 2022] POST /compute/v2.1/flavors => generated 405 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 11:18:27.892556 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi [None req-29f0c5df-dfa0-4e67-be2f-756dde3398ea admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:18:27.951453 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: INFO nova.api.openstack.requestlog [None req-29f0c5df-dfa0-4e67-be2f-756dde3398ea admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.062435 Jul 11 11:18:27.951963 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: [pid: 103795|app: 0|req: 14/26] 10.222.0.26 () {64 vars in 1332 bytes} [Mon Jul 11 11:18:27 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:18:30.195539 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi [None req-6fa8459a-4871-4ad6-881b-0990bfdd0f50 admin admin] Calling method '>' {{(pid=103794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:18:30.196763 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: INFO nova.api.openstack.requestlog [None req-6fa8459a-4871-4ad6-881b-0990bfdd0f50 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001717 Jul 11 11:18:30.197264 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: [pid: 103794|app: 0|req: 13/27] 10.222.0.26 () {54 vars in 930 bytes} [Mon Jul 11 11:18:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:18:30.582429 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi [None req-3f337610-28c7-4a41-9954-326a68941429 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 40, "ram": 4096, "name": "m1.medium", "swap": 0}} {{(pid=103795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:18:30.668254 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: INFO nova.api.openstack.requestlog [None req-3f337610-28c7-4a41-9954-326a68941429 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.463543 Jul 11 11:18:30.668853 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: [pid: 103795|app: 0|req: 15/28] 10.222.0.26 () {64 vars in 1282 bytes} [Mon Jul 11 11:18:30 2022] POST /compute/v2.1/flavors => generated 406 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 11:18:30.681630 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi [None req-dde17597-46e9-4470-870f-b2e5a0a726e5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:18:30.760996 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: INFO nova.api.openstack.requestlog [None req-dde17597-46e9-4470-870f-b2e5a0a726e5 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.083137 Jul 11 11:18:30.765901 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: [pid: 103794|app: 0|req: 14/29] 10.222.0.26 () {64 vars in 1332 bytes} [Mon Jul 11 11:18:30 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:18:33.011739 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi [None req-3f337610-28c7-4a41-9954-326a68941429 admin admin] Calling method '>' {{(pid=103795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:18:33.012757 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: INFO nova.api.openstack.requestlog [None req-3f337610-28c7-4a41-9954-326a68941429 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Jul 11 11:18:33.013166 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: [pid: 103795|app: 0|req: 16/30] 10.222.0.26 () {54 vars in 930 bytes} [Mon Jul 11 11:18:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:18:33.506324 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi [None req-071e5c69-9711-43ac-8963-4397b9be97af admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 4, "swap": 0, "name": "m1.large", "disk": 80, "ram": 8192, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:18:34.136882 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG dbcounter [-] [103794] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:18:34.143461 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: INFO nova.api.openstack.requestlog [None req-071e5c69-9711-43ac-8963-4397b9be97af admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 1.123805 Jul 11 11:18:34.151586 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: [pid: 103794|app: 0|req: 15/31] 10.222.0.26 () {64 vars in 1282 bytes} [Mon Jul 11 11:18:33 2022] POST /compute/v2.1/flavors => generated 405 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 11:18:34.156928 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi [None req-97d7e7ba-f0c4-4d3d-8135-73b3dd80d02c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:18:34.312763 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: INFO nova.api.openstack.requestlog [None req-97d7e7ba-f0c4-4d3d-8135-73b3dd80d02c admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.160281 Jul 11 11:18:34.324281 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: [pid: 103795|app: 0|req: 17/32] 10.222.0.26 () {64 vars in 1332 bytes} [Mon Jul 11 11:18:34 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:18:36.541269 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi [None req-071e5c69-9711-43ac-8963-4397b9be97af admin admin] Calling method '>' {{(pid=103794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:18:36.542292 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: INFO nova.api.openstack.requestlog [None req-071e5c69-9711-43ac-8963-4397b9be97af admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Jul 11 11:18:36.542697 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: [pid: 103794|app: 0|req: 16/33] 10.222.0.26 () {54 vars in 930 bytes} [Mon Jul 11 11:18:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:18:36.987210 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi [None req-750ea1bc-fd71-4b22-a986-7af0e7c57ba5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "name": "m1.xlarge", "ram": 16384, "vcpus": 8, "id": "5", "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=103795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:18:37.056929 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: INFO nova.api.openstack.requestlog [None req-750ea1bc-fd71-4b22-a986-7af0e7c57ba5 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.508389 Jul 11 11:18:37.057479 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: [pid: 103795|app: 0|req: 18/34] 10.222.0.26 () {64 vars in 1282 bytes} [Mon Jul 11 11:18:36 2022] POST /compute/v2.1/flavors => generated 408 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 11:18:37.069395 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi [None req-096a7959-7ced-4f49-aded-e2174a180030 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:18:37.152684 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: INFO nova.api.openstack.requestlog [None req-096a7959-7ced-4f49-aded-e2174a180030 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.087054 Jul 11 11:18:37.153799 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: [pid: 103794|app: 0|req: 17/35] 10.222.0.26 () {64 vars in 1332 bytes} [Mon Jul 11 11:18:37 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:18:57.508039 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi [None req-750ea1bc-fd71-4b22-a986-7af0e7c57ba5 admin admin] Calling method '>' {{(pid=103795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:18:57.509050 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: INFO nova.api.openstack.requestlog [None req-750ea1bc-fd71-4b22-a986-7af0e7c57ba5 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Jul 11 11:18:57.509477 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: [pid: 103795|app: 0|req: 19/36] 10.222.0.26 () {54 vars in 930 bytes} [Mon Jul 11 11:18:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:18:57.906717 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi [None req-c9dc0cb9-f17c-40f8-81d5-b5706945b36a admin admin] Calling method '>' {{(pid=103794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:18:57.923747 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: INFO nova.api.openstack.requestlog [None req-c9dc0cb9-f17c-40f8-81d5-b5706945b36a admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.408399 Jul 11 11:18:57.924213 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: [pid: 103794|app: 0|req: 18/37] 10.222.0.26 () {60 vars in 1291 bytes} [Mon Jul 11 11:18:57 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 11:18:58.981933 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi [None req-750ea1bc-fd71-4b22-a986-7af0e7c57ba5 admin admin] Calling method '>' {{(pid=103795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:18:58.983528 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: INFO nova.api.openstack.requestlog [None req-750ea1bc-fd71-4b22-a986-7af0e7c57ba5 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001985 Jul 11 11:18:58.983921 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: [pid: 103795|app: 0|req: 20/38] 10.222.0.26 () {56 vars in 1074 bytes} [Mon Jul 11 11:18:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:18:59.509965 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi [None req-a6af192e-2161-4bc9-9d33-91f32ab4b737 admin admin] Calling method '>' {{(pid=103794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:18:59.516044 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: INFO nova.api.openstack.wsgi [None req-a6af192e-2161-4bc9-9d33-91f32ab4b737 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 11 11:18:59.519422 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi [None req-a6af192e-2161-4bc9-9d33-91f32ab4b737 admin admin] Request method failure captured: Jul 11 11:18:59.519422 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 11 11:18:59.519422 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: Accept: application/json Jul 11 11:18:59.519422 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: Accept-Encoding: gzip, deflate Jul 11 11:18:59.519422 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: Connection: keep-alive Jul 11 11:18:59.519422 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: Content-Length: 0 Jul 11 11:18:59.519422 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: Host: 10.222.0.26 Jul 11 11:18:59.519422 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: Openstack-Api-Version: compute 2.90 Jul 11 11:18:59.519422 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: Openstack-System-Scope: None Jul 11 11:18:59.519422 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: User-Agent: python-novaclient Jul 11 11:18:59.519422 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: X-Auth-Token: gAAAAABizAciy100dEC58GzjWrcrjW2IVJyQrjlSDn_BMLZPDeXNCgkSvse3I2fSzrLwcZ4kfMR4aMkBntSQZdRhX3EQvcwFbAtyb5VOrX5ccpR4OWvWeZTHncdWvzCa1PqPc7onveZWB6quUx9FALvHhfqAhSjuE0-8CtB1uVZGFi2hqchGYvI Jul 11 11:18:59.519422 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: X-Domain-Id: None Jul 11 11:18:59.519422 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: X-Domain-Name: None Jul 11 11:18:59.519422 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: X-Identity-Status: Confirmed Jul 11 11:18:59.519422 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: X-Is-Admin-Project: True Jul 11 11:18:59.519422 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: X-Openstack-Nova-Api-Version: 2.90 Jul 11 11:18:59.519422 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: X-Project-Domain-Id: default Jul 11 11:18:59.519422 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: X-Project-Domain-Name: Default Jul 11 11:18:59.519422 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: X-Project-Id: d16c61acfee74652b6cd4c256cd8f443 Jul 11 11:18:59.519422 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: X-Project-Name: admin Jul 11 11:18:59.519422 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: X-Role: member,admin,reader Jul 11 11:18:59.519422 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: X-Roles: member,admin,reader Jul 11 11:18:59.521239 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d16c61acfee74652b6cd4c256cd8f443"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d16c61acfee74652b6cd4c256cd8f443"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d16c61acfee74652b6cd4c256cd8f443"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d16c61acfee74652b6cd4c256cd8f443"}]}] Jul 11 11:18:59.521239 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: X-Tenant: admin Jul 11 11:18:59.521239 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: X-Tenant-Id: d16c61acfee74652b6cd4c256cd8f443 Jul 11 11:18:59.521239 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: X-Tenant-Name: admin Jul 11 11:18:59.521239 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: X-User: admin Jul 11 11:18:59.521239 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: X-User-Domain-Id: default Jul 11 11:18:59.521239 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: X-User-Domain-Name: Default Jul 11 11:18:59.521239 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: X-User-Id: 41ca161a25324736922d4952cd76a1f3 Jul 11 11:18:59.521239 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: X-User-Name: admin Jul 11 11:18:59.521239 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: method: > Jul 11 11:18:59.521239 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: exception: Flavor 42 could not be found. Jul 11 11:18:59.521239 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: action_args: {'id': '42'} Jul 11 11:18:59.521239 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: {{(pid=103794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 11:18:59.521239 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:18:59.522189 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 11 11:18:59.522189 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 11 11:18:59.522189 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 11 11:18:59.522189 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 11 11:18:59.522189 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 11 11:18:59.522189 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 11 11:18:59.522189 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 11 11:18:59.522189 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 11 11:18:59.522189 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 11 11:18:59.522189 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 11:18:59.522189 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 11 11:18:59.522189 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 11 11:18:59.522189 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 11 11:18:59.522189 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi Jul 11 11:18:59.522189 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:18:59.522189 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi Jul 11 11:18:59.522189 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:18:59.522189 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:18:59.522189 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:18:59.523739 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 11:18:59.523739 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 11:18:59.523739 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 11:18:59.523739 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 11:18:59.523739 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 11 11:18:59.523739 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 11 11:18:59.523739 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 11 11:18:59.523739 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi Jul 11 11:18:59.523739 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:18:59.523739 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi Jul 11 11:18:59.523739 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:18:59.523739 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:18:59.523739 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:18:59.523739 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 11:18:59.523739 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 11:18:59.523739 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 11 11:18:59.523739 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi Jul 11 11:18:59.523739 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi [None req-a6af192e-2161-4bc9-9d33-91f32ab4b737 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 11:18:59.525221 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: INFO nova.api.openstack.requestlog [None req-a6af192e-2161-4bc9-9d33-91f32ab4b737 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.386435 Jul 11 11:18:59.525221 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: [pid: 103794|app: 0|req: 19/39] 10.222.0.26 () {60 vars in 1190 bytes} [Mon Jul 11 11:18:59 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 387 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 11 11:18:59.531069 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi [None req-a1867d87-35c3-41ba-82a0-7e23a47a1939 admin admin] Calling method '>' {{(pid=103795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:18:59.533941 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG dbcounter [-] [103795] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:18:59.552423 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: INFO nova.api.openstack.requestlog [None req-a1867d87-35c3-41ba-82a0-7e23a47a1939 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025136 Jul 11 11:18:59.555208 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: [pid: 103795|app: 0|req: 21/40] 10.222.0.26 () {60 vars in 1210 bytes} [Mon Jul 11 11:18:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:18:59.563282 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi [None req-83cc3d5a-b966-4c76-b350-ef7ba9711534 admin admin] Calling method '>' {{(pid=103794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:18:59.584243 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: INFO nova.api.openstack.requestlog [None req-83cc3d5a-b966-4c76-b350-ef7ba9711534 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025052 Jul 11 11:18:59.584791 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: [pid: 103794|app: 0|req: 20/41] 10.222.0.26 () {60 vars in 1210 bytes} [Mon Jul 11 11:18:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:18:59.594642 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi [None req-74da411b-048e-4bec-804b-73d5c2cacb34 admin admin] Calling method '>' {{(pid=103795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:18:59.600705 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: INFO nova.api.openstack.wsgi [None req-74da411b-048e-4bec-804b-73d5c2cacb34 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 11 11:18:59.604434 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi [None req-74da411b-048e-4bec-804b-73d5c2cacb34 admin admin] Request method failure captured: Jul 11 11:18:59.604434 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 11 11:18:59.604434 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: Accept: application/json Jul 11 11:18:59.604434 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: Accept-Encoding: gzip, deflate Jul 11 11:18:59.604434 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: Connection: keep-alive Jul 11 11:18:59.604434 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: Content-Length: 0 Jul 11 11:18:59.604434 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: Host: 10.222.0.26 Jul 11 11:18:59.604434 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: Openstack-Api-Version: compute 2.90 Jul 11 11:18:59.604434 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: Openstack-System-Scope: None Jul 11 11:18:59.604434 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: User-Agent: python-novaclient Jul 11 11:18:59.604434 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: X-Auth-Token: gAAAAABizAciy100dEC58GzjWrcrjW2IVJyQrjlSDn_BMLZPDeXNCgkSvse3I2fSzrLwcZ4kfMR4aMkBntSQZdRhX3EQvcwFbAtyb5VOrX5ccpR4OWvWeZTHncdWvzCa1PqPc7onveZWB6quUx9FALvHhfqAhSjuE0-8CtB1uVZGFi2hqchGYvI Jul 11 11:18:59.604434 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: X-Domain-Id: None Jul 11 11:18:59.604434 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: X-Domain-Name: None Jul 11 11:18:59.604434 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: X-Identity-Status: Confirmed Jul 11 11:18:59.604434 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: X-Is-Admin-Project: True Jul 11 11:18:59.604434 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: X-Openstack-Nova-Api-Version: 2.90 Jul 11 11:18:59.604434 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: X-Project-Domain-Id: default Jul 11 11:18:59.604434 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: X-Project-Domain-Name: Default Jul 11 11:18:59.604434 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: X-Project-Id: d16c61acfee74652b6cd4c256cd8f443 Jul 11 11:18:59.604434 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: X-Project-Name: admin Jul 11 11:18:59.604434 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: X-Role: member,admin,reader Jul 11 11:18:59.604434 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: X-Roles: member,admin,reader Jul 11 11:18:59.605973 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d16c61acfee74652b6cd4c256cd8f443"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d16c61acfee74652b6cd4c256cd8f443"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d16c61acfee74652b6cd4c256cd8f443"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d16c61acfee74652b6cd4c256cd8f443"}]}] Jul 11 11:18:59.605973 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: X-Tenant: admin Jul 11 11:18:59.605973 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: X-Tenant-Id: d16c61acfee74652b6cd4c256cd8f443 Jul 11 11:18:59.605973 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: X-Tenant-Name: admin Jul 11 11:18:59.605973 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: X-User: admin Jul 11 11:18:59.605973 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: X-User-Domain-Id: default Jul 11 11:18:59.605973 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: X-User-Domain-Name: Default Jul 11 11:18:59.605973 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: X-User-Id: 41ca161a25324736922d4952cd76a1f3 Jul 11 11:18:59.605973 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: X-User-Name: admin Jul 11 11:18:59.605973 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: method: > Jul 11 11:18:59.605973 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: exception: Flavor 42 could not be found. Jul 11 11:18:59.605973 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: action_args: {'id': '42'} Jul 11 11:18:59.605973 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: {{(pid=103795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 11:18:59.605973 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:18:59.607791 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 11 11:18:59.607791 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 11 11:18:59.607791 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 11 11:18:59.607791 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 11 11:18:59.607791 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 11 11:18:59.607791 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 11 11:18:59.607791 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 11 11:18:59.607791 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 11 11:18:59.607791 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 11 11:18:59.607791 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 11:18:59.607791 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 11 11:18:59.607791 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 11 11:18:59.607791 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 11 11:18:59.607791 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi Jul 11 11:18:59.607791 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:18:59.607791 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi Jul 11 11:18:59.607791 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:18:59.607791 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:18:59.607791 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:18:59.609160 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 11:18:59.609160 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 11:18:59.609160 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 11:18:59.609160 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 11:18:59.609160 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 11 11:18:59.609160 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 11 11:18:59.609160 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 11 11:18:59.609160 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi Jul 11 11:18:59.609160 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:18:59.609160 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi Jul 11 11:18:59.609160 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:18:59.609160 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:18:59.609160 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:18:59.609160 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 11:18:59.609160 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 11:18:59.609160 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 11 11:18:59.609160 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi Jul 11 11:18:59.609160 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi [None req-74da411b-048e-4bec-804b-73d5c2cacb34 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103795) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 11:18:59.610368 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: INFO nova.api.openstack.requestlog [None req-74da411b-048e-4bec-804b-73d5c2cacb34 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014601 Jul 11 11:18:59.610368 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: [pid: 103795|app: 0|req: 22/42] 10.222.0.26 () {60 vars in 1190 bytes} [Mon Jul 11 11:18:59 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 11 11:19:00.557778 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi [None req-83cc3d5a-b966-4c76-b350-ef7ba9711534 admin admin] Calling method '>' {{(pid=103794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:19:00.558829 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: INFO nova.api.openstack.requestlog [None req-83cc3d5a-b966-4c76-b350-ef7ba9711534 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Jul 11 11:19:00.559223 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: [pid: 103794|app: 0|req: 21/43] 10.222.0.26 () {56 vars in 1074 bytes} [Mon Jul 11 11:19:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:19:01.077215 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi [None req-1cf5d22a-116d-40e9-9f03-9839bfccb403 admin admin] Calling method '>' {{(pid=103795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:19:01.083027 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: INFO nova.api.openstack.wsgi [None req-1cf5d22a-116d-40e9-9f03-9839bfccb403 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 11 11:19:01.084558 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi [None req-1cf5d22a-116d-40e9-9f03-9839bfccb403 admin admin] Request method failure captured: Jul 11 11:19:01.084558 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 11 11:19:01.084558 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: Accept: application/json Jul 11 11:19:01.084558 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: Accept-Encoding: gzip, deflate Jul 11 11:19:01.084558 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: Connection: keep-alive Jul 11 11:19:01.084558 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: Content-Length: 0 Jul 11 11:19:01.084558 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: Host: 10.222.0.26 Jul 11 11:19:01.084558 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: Openstack-Api-Version: compute 2.90 Jul 11 11:19:01.084558 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: Openstack-System-Scope: None Jul 11 11:19:01.084558 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: User-Agent: python-novaclient Jul 11 11:19:01.084558 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: X-Auth-Token: gAAAAABizAckK3C5IJeit5xXxpf6vqE3HbeHumJpEVhhwl5VUyQFr0wzkUkh7oTOU2JFti4hwtu2H2e7fuvgyGBCOLvKJeeC-gzpcxkX__Zh_vDHLBkMcKEiyCJMkofZMzEAg90d50FebSL6WFX5jqGNAhkacS1RpvmQcml0-S4PYPLH2pPHhI4 Jul 11 11:19:01.084558 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: X-Domain-Id: None Jul 11 11:19:01.084558 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: X-Domain-Name: None Jul 11 11:19:01.084558 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: X-Identity-Status: Confirmed Jul 11 11:19:01.084558 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: X-Is-Admin-Project: True Jul 11 11:19:01.084558 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: X-Openstack-Nova-Api-Version: 2.90 Jul 11 11:19:01.084558 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: X-Project-Domain-Id: default Jul 11 11:19:01.084558 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: X-Project-Domain-Name: Default Jul 11 11:19:01.084558 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: X-Project-Id: d16c61acfee74652b6cd4c256cd8f443 Jul 11 11:19:01.084558 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: X-Project-Name: admin Jul 11 11:19:01.084558 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: X-Role: member,admin,reader Jul 11 11:19:01.084558 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: X-Roles: member,admin,reader Jul 11 11:19:01.086099 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d16c61acfee74652b6cd4c256cd8f443"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d16c61acfee74652b6cd4c256cd8f443"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d16c61acfee74652b6cd4c256cd8f443"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d16c61acfee74652b6cd4c256cd8f443"}]}] Jul 11 11:19:01.086099 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: X-Tenant: admin Jul 11 11:19:01.086099 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: X-Tenant-Id: d16c61acfee74652b6cd4c256cd8f443 Jul 11 11:19:01.086099 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: X-Tenant-Name: admin Jul 11 11:19:01.086099 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: X-User: admin Jul 11 11:19:01.086099 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: X-User-Domain-Id: default Jul 11 11:19:01.086099 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: X-User-Domain-Name: Default Jul 11 11:19:01.086099 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: X-User-Id: 41ca161a25324736922d4952cd76a1f3 Jul 11 11:19:01.086099 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: X-User-Name: admin Jul 11 11:19:01.086099 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: method: > Jul 11 11:19:01.086099 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: exception: Flavor 84 could not be found. Jul 11 11:19:01.086099 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: action_args: {'id': '84'} Jul 11 11:19:01.086099 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: {{(pid=103795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 11:19:01.086099 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:19:01.087099 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 11 11:19:01.087099 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 11 11:19:01.087099 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 11 11:19:01.087099 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 11 11:19:01.087099 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 11 11:19:01.087099 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 11 11:19:01.087099 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 11 11:19:01.087099 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 11 11:19:01.087099 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 11 11:19:01.087099 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 11:19:01.087099 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 11 11:19:01.087099 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 11 11:19:01.087099 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 11 11:19:01.087099 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi Jul 11 11:19:01.087099 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:19:01.087099 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi Jul 11 11:19:01.087099 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:19:01.087099 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:19:01.087099 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:19:01.088570 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 11:19:01.088570 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 11:19:01.088570 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 11:19:01.088570 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 11:19:01.088570 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 11 11:19:01.088570 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 11 11:19:01.088570 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 11 11:19:01.088570 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi Jul 11 11:19:01.088570 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:19:01.088570 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi Jul 11 11:19:01.088570 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:19:01.088570 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:19:01.088570 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:19:01.088570 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 11:19:01.088570 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 11:19:01.088570 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 11 11:19:01.088570 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi Jul 11 11:19:01.088570 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi [None req-1cf5d22a-116d-40e9-9f03-9839bfccb403 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103795) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 11:19:01.089829 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: INFO nova.api.openstack.requestlog [None req-1cf5d22a-116d-40e9-9f03-9839bfccb403 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.388646 Jul 11 11:19:01.089829 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: [pid: 103795|app: 0|req: 23/44] 10.222.0.26 () {60 vars in 1190 bytes} [Mon Jul 11 11:19:00 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 11 11:19:01.096261 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi [None req-73353a6f-1547-4e55-93d4-316b724ad2c2 admin admin] Calling method '>' {{(pid=103794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:19:01.111672 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: INFO nova.api.openstack.requestlog [None req-73353a6f-1547-4e55-93d4-316b724ad2c2 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018852 Jul 11 11:19:01.112235 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: [pid: 103794|app: 0|req: 22/45] 10.222.0.26 () {60 vars in 1210 bytes} [Mon Jul 11 11:19:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:19:01.121767 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi [None req-31f9be30-a28f-41e7-8402-669e927dd608 admin admin] Calling method '>' {{(pid=103795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:19:01.137941 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: INFO nova.api.openstack.requestlog [None req-31f9be30-a28f-41e7-8402-669e927dd608 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019781 Jul 11 11:19:01.138990 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: [pid: 103795|app: 0|req: 24/46] 10.222.0.26 () {60 vars in 1210 bytes} [Mon Jul 11 11:19:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:19:01.148309 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi [None req-42f4d43d-21d9-47e3-a930-9b61c54afa50 admin admin] Calling method '>' {{(pid=103794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:19:01.153770 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: INFO nova.api.openstack.wsgi [None req-42f4d43d-21d9-47e3-a930-9b61c54afa50 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 11 11:19:01.155957 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi [None req-42f4d43d-21d9-47e3-a930-9b61c54afa50 admin admin] Request method failure captured: Jul 11 11:19:01.155957 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 11 11:19:01.155957 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: Accept: application/json Jul 11 11:19:01.155957 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: Accept-Encoding: gzip, deflate Jul 11 11:19:01.155957 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: Connection: keep-alive Jul 11 11:19:01.155957 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: Content-Length: 0 Jul 11 11:19:01.155957 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: Host: 10.222.0.26 Jul 11 11:19:01.155957 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: Openstack-Api-Version: compute 2.90 Jul 11 11:19:01.155957 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: Openstack-System-Scope: None Jul 11 11:19:01.155957 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: User-Agent: python-novaclient Jul 11 11:19:01.155957 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: X-Auth-Token: gAAAAABizAckK3C5IJeit5xXxpf6vqE3HbeHumJpEVhhwl5VUyQFr0wzkUkh7oTOU2JFti4hwtu2H2e7fuvgyGBCOLvKJeeC-gzpcxkX__Zh_vDHLBkMcKEiyCJMkofZMzEAg90d50FebSL6WFX5jqGNAhkacS1RpvmQcml0-S4PYPLH2pPHhI4 Jul 11 11:19:01.155957 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: X-Domain-Id: None Jul 11 11:19:01.155957 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: X-Domain-Name: None Jul 11 11:19:01.155957 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: X-Identity-Status: Confirmed Jul 11 11:19:01.155957 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: X-Is-Admin-Project: True Jul 11 11:19:01.155957 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: X-Openstack-Nova-Api-Version: 2.90 Jul 11 11:19:01.155957 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: X-Project-Domain-Id: default Jul 11 11:19:01.155957 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: X-Project-Domain-Name: Default Jul 11 11:19:01.155957 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: X-Project-Id: d16c61acfee74652b6cd4c256cd8f443 Jul 11 11:19:01.155957 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: X-Project-Name: admin Jul 11 11:19:01.155957 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: X-Role: member,admin,reader Jul 11 11:19:01.155957 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: X-Roles: member,admin,reader Jul 11 11:19:01.157472 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d16c61acfee74652b6cd4c256cd8f443"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d16c61acfee74652b6cd4c256cd8f443"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d16c61acfee74652b6cd4c256cd8f443"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d16c61acfee74652b6cd4c256cd8f443"}]}] Jul 11 11:19:01.157472 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: X-Tenant: admin Jul 11 11:19:01.157472 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: X-Tenant-Id: d16c61acfee74652b6cd4c256cd8f443 Jul 11 11:19:01.157472 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: X-Tenant-Name: admin Jul 11 11:19:01.157472 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: X-User: admin Jul 11 11:19:01.157472 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: X-User-Domain-Id: default Jul 11 11:19:01.157472 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: X-User-Domain-Name: Default Jul 11 11:19:01.157472 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: X-User-Id: 41ca161a25324736922d4952cd76a1f3 Jul 11 11:19:01.157472 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: X-User-Name: admin Jul 11 11:19:01.157472 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: method: > Jul 11 11:19:01.157472 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: exception: Flavor 84 could not be found. Jul 11 11:19:01.157472 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: action_args: {'id': '84'} Jul 11 11:19:01.157472 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: {{(pid=103794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 11:19:01.157472 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:19:01.158592 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 11 11:19:01.158592 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 11 11:19:01.158592 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 11 11:19:01.158592 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 11 11:19:01.158592 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 11 11:19:01.158592 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 11 11:19:01.158592 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 11 11:19:01.158592 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 11 11:19:01.158592 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 11 11:19:01.158592 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 11:19:01.158592 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 11 11:19:01.158592 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 11 11:19:01.158592 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 11 11:19:01.158592 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi Jul 11 11:19:01.158592 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:19:01.158592 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi Jul 11 11:19:01.158592 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:19:01.158592 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:19:01.158592 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:19:01.159955 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 11:19:01.159955 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 11:19:01.159955 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 11:19:01.159955 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 11:19:01.159955 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 11 11:19:01.159955 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 11 11:19:01.159955 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 11 11:19:01.159955 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi Jul 11 11:19:01.159955 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:19:01.159955 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi Jul 11 11:19:01.159955 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:19:01.159955 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:19:01.159955 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:19:01.159955 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 11:19:01.159955 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 11:19:01.159955 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 11 11:19:01.159955 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi Jul 11 11:19:01.159955 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi [None req-42f4d43d-21d9-47e3-a930-9b61c54afa50 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 11:19:01.161277 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: INFO nova.api.openstack.requestlog [None req-42f4d43d-21d9-47e3-a930-9b61c54afa50 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012518 Jul 11 11:19:01.161277 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: [pid: 103794|app: 0|req: 23/47] 10.222.0.26 () {60 vars in 1190 bytes} [Mon Jul 11 11:19:01 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 11 11:19:02.104787 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi [None req-31f9be30-a28f-41e7-8402-669e927dd608 admin admin] Calling method '>' {{(pid=103795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:19:02.105825 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: INFO nova.api.openstack.requestlog [None req-31f9be30-a28f-41e7-8402-669e927dd608 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Jul 11 11:19:02.106218 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: [pid: 103795|app: 0|req: 25/48] 10.222.0.26 () {56 vars in 1074 bytes} [Mon Jul 11 11:19:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:19:02.614550 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi [None req-67593e71-1c3c-499b-9fd4-7ea792a29367 admin admin] Calling method '>' {{(pid=103794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:19:02.620283 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: INFO nova.api.openstack.wsgi [None req-67593e71-1c3c-499b-9fd4-7ea792a29367 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 11 11:19:02.621783 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi [None req-67593e71-1c3c-499b-9fd4-7ea792a29367 admin admin] Request method failure captured: Jul 11 11:19:02.621783 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 11 11:19:02.621783 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: Accept: application/json Jul 11 11:19:02.621783 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: Accept-Encoding: gzip, deflate Jul 11 11:19:02.621783 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: Connection: keep-alive Jul 11 11:19:02.621783 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: Content-Length: 0 Jul 11 11:19:02.621783 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: Host: 10.222.0.26 Jul 11 11:19:02.621783 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: Openstack-Api-Version: compute 2.90 Jul 11 11:19:02.621783 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: Openstack-System-Scope: None Jul 11 11:19:02.621783 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: User-Agent: python-novaclient Jul 11 11:19:02.621783 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: X-Auth-Token: gAAAAABizAcmiscWbZFj9XPpk_y0NVMNfrxdhycFm4g9fJp2bya6KF48b5qeCcthe96g4v-_t4j8M2pWV0vZ6ukr_1zs8I0beUhRnKRPV9PNDRwbiSsNtmEsaLlxhL3HT-1HSeyjpm_XAVlg227uci4t6LCVGQXgzRuHY8upAo3Za1Pf0naISWI Jul 11 11:19:02.621783 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: X-Domain-Id: None Jul 11 11:19:02.621783 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: X-Domain-Name: None Jul 11 11:19:02.621783 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: X-Identity-Status: Confirmed Jul 11 11:19:02.621783 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: X-Is-Admin-Project: True Jul 11 11:19:02.621783 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: X-Openstack-Nova-Api-Version: 2.90 Jul 11 11:19:02.621783 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: X-Project-Domain-Id: default Jul 11 11:19:02.621783 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: X-Project-Domain-Name: Default Jul 11 11:19:02.621783 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: X-Project-Id: d16c61acfee74652b6cd4c256cd8f443 Jul 11 11:19:02.621783 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: X-Project-Name: admin Jul 11 11:19:02.621783 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: X-Role: member,admin,reader Jul 11 11:19:02.621783 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: X-Roles: member,admin,reader Jul 11 11:19:02.623327 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d16c61acfee74652b6cd4c256cd8f443"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d16c61acfee74652b6cd4c256cd8f443"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d16c61acfee74652b6cd4c256cd8f443"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d16c61acfee74652b6cd4c256cd8f443"}]}] Jul 11 11:19:02.623327 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: X-Tenant: admin Jul 11 11:19:02.623327 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: X-Tenant-Id: d16c61acfee74652b6cd4c256cd8f443 Jul 11 11:19:02.623327 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: X-Tenant-Name: admin Jul 11 11:19:02.623327 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: X-User: admin Jul 11 11:19:02.623327 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: X-User-Domain-Id: default Jul 11 11:19:02.623327 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: X-User-Domain-Name: Default Jul 11 11:19:02.623327 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: X-User-Id: 41ca161a25324736922d4952cd76a1f3 Jul 11 11:19:02.623327 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: X-User-Name: admin Jul 11 11:19:02.623327 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: method: > Jul 11 11:19:02.623327 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: exception: Flavor 451 could not be found. Jul 11 11:19:02.623327 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: action_args: {'id': '451'} Jul 11 11:19:02.623327 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: {{(pid=103794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 11:19:02.623327 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:19:02.624336 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 11 11:19:02.624336 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 11 11:19:02.624336 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 11 11:19:02.624336 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 11 11:19:02.624336 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 11 11:19:02.624336 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 11 11:19:02.624336 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 11 11:19:02.624336 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 11 11:19:02.624336 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 11 11:19:02.624336 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 11:19:02.624336 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 11 11:19:02.624336 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 11 11:19:02.624336 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 11 11:19:02.624336 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi Jul 11 11:19:02.624336 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:19:02.624336 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi Jul 11 11:19:02.624336 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:19:02.624336 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:19:02.624336 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:19:02.625663 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 11:19:02.625663 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 11:19:02.625663 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 11:19:02.625663 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 11:19:02.625663 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 11 11:19:02.625663 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 11 11:19:02.625663 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 11 11:19:02.625663 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi Jul 11 11:19:02.625663 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:19:02.625663 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi Jul 11 11:19:02.625663 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:19:02.625663 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:19:02.625663 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:19:02.625663 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 11:19:02.625663 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 11:19:02.625663 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 11 11:19:02.625663 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: ERROR nova.api.openstack.wsgi Jul 11 11:19:02.625663 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi [None req-67593e71-1c3c-499b-9fd4-7ea792a29367 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 11:19:02.626899 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: INFO nova.api.openstack.requestlog [None req-67593e71-1c3c-499b-9fd4-7ea792a29367 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.382017 Jul 11 11:19:02.626899 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: [pid: 103794|app: 0|req: 24/49] 10.222.0.26 () {60 vars in 1193 bytes} [Mon Jul 11 11:19:02 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 383 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 11 11:19:02.632633 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi [None req-86344d24-6edc-4efe-a518-95546991a81e admin admin] Calling method '>' {{(pid=103795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:19:02.646510 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: INFO nova.api.openstack.requestlog [None req-86344d24-6edc-4efe-a518-95546991a81e admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017411 Jul 11 11:19:02.647033 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: [pid: 103795|app: 0|req: 26/50] 10.222.0.26 () {60 vars in 1210 bytes} [Mon Jul 11 11:19:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:19:02.656092 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi [None req-7f4c2bae-c314-430f-baae-aae8bbc8b238 admin admin] Calling method '>' {{(pid=103794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:19:02.670624 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: INFO nova.api.openstack.requestlog [None req-7f4c2bae-c314-430f-baae-aae8bbc8b238 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018062 Jul 11 11:19:02.671134 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: [pid: 103794|app: 0|req: 25/51] 10.222.0.26 () {60 vars in 1210 bytes} [Mon Jul 11 11:19:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:19:02.680539 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi [None req-5d7276c7-0b3a-4632-be81-f6e1ab270458 admin admin] Calling method '>' {{(pid=103795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:19:02.686302 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: INFO nova.api.openstack.wsgi [None req-5d7276c7-0b3a-4632-be81-f6e1ab270458 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 11 11:19:02.687834 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi [None req-5d7276c7-0b3a-4632-be81-f6e1ab270458 admin admin] Request method failure captured: Jul 11 11:19:02.687834 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 11 11:19:02.687834 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: Accept: application/json Jul 11 11:19:02.687834 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: Accept-Encoding: gzip, deflate Jul 11 11:19:02.687834 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: Connection: keep-alive Jul 11 11:19:02.687834 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: Content-Length: 0 Jul 11 11:19:02.687834 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: Host: 10.222.0.26 Jul 11 11:19:02.687834 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: Openstack-Api-Version: compute 2.90 Jul 11 11:19:02.687834 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: Openstack-System-Scope: None Jul 11 11:19:02.687834 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: User-Agent: python-novaclient Jul 11 11:19:02.687834 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: X-Auth-Token: gAAAAABizAcmiscWbZFj9XPpk_y0NVMNfrxdhycFm4g9fJp2bya6KF48b5qeCcthe96g4v-_t4j8M2pWV0vZ6ukr_1zs8I0beUhRnKRPV9PNDRwbiSsNtmEsaLlxhL3HT-1HSeyjpm_XAVlg227uci4t6LCVGQXgzRuHY8upAo3Za1Pf0naISWI Jul 11 11:19:02.687834 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: X-Domain-Id: None Jul 11 11:19:02.687834 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: X-Domain-Name: None Jul 11 11:19:02.687834 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: X-Identity-Status: Confirmed Jul 11 11:19:02.687834 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: X-Is-Admin-Project: True Jul 11 11:19:02.687834 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: X-Openstack-Nova-Api-Version: 2.90 Jul 11 11:19:02.687834 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: X-Project-Domain-Id: default Jul 11 11:19:02.687834 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: X-Project-Domain-Name: Default Jul 11 11:19:02.687834 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: X-Project-Id: d16c61acfee74652b6cd4c256cd8f443 Jul 11 11:19:02.687834 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: X-Project-Name: admin Jul 11 11:19:02.687834 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: X-Role: member,admin,reader Jul 11 11:19:02.687834 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: X-Roles: member,admin,reader Jul 11 11:19:02.689380 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d16c61acfee74652b6cd4c256cd8f443"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d16c61acfee74652b6cd4c256cd8f443"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d16c61acfee74652b6cd4c256cd8f443"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d16c61acfee74652b6cd4c256cd8f443"}]}] Jul 11 11:19:02.689380 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: X-Tenant: admin Jul 11 11:19:02.689380 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: X-Tenant-Id: d16c61acfee74652b6cd4c256cd8f443 Jul 11 11:19:02.689380 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: X-Tenant-Name: admin Jul 11 11:19:02.689380 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: X-User: admin Jul 11 11:19:02.689380 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: X-User-Domain-Id: default Jul 11 11:19:02.689380 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: X-User-Domain-Name: Default Jul 11 11:19:02.689380 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: X-User-Id: 41ca161a25324736922d4952cd76a1f3 Jul 11 11:19:02.689380 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: X-User-Name: admin Jul 11 11:19:02.689380 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: method: > Jul 11 11:19:02.689380 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: exception: Flavor 451 could not be found. Jul 11 11:19:02.689380 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: action_args: {'id': '451'} Jul 11 11:19:02.689380 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: {{(pid=103795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 11:19:02.689380 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:19:02.690461 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 11 11:19:02.690461 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 11 11:19:02.690461 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 11 11:19:02.690461 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 11 11:19:02.690461 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 11 11:19:02.690461 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 11 11:19:02.690461 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 11 11:19:02.690461 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 11 11:19:02.690461 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 11 11:19:02.690461 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 11:19:02.690461 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 11 11:19:02.690461 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 11 11:19:02.690461 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 11 11:19:02.690461 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi Jul 11 11:19:02.690461 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:19:02.690461 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi Jul 11 11:19:02.690461 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:19:02.690461 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:19:02.690461 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:19:02.691783 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 11:19:02.691783 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 11:19:02.691783 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 11:19:02.691783 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 11:19:02.691783 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 11 11:19:02.691783 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 11 11:19:02.691783 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 11 11:19:02.691783 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi Jul 11 11:19:02.691783 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:19:02.691783 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi Jul 11 11:19:02.691783 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:19:02.691783 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:19:02.691783 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:19:02.691783 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 11:19:02.691783 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 11:19:02.691783 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 11 11:19:02.691783 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: ERROR nova.api.openstack.wsgi Jul 11 11:19:02.691783 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi [None req-5d7276c7-0b3a-4632-be81-f6e1ab270458 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103795) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 11:19:02.693060 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: INFO nova.api.openstack.requestlog [None req-5d7276c7-0b3a-4632-be81-f6e1ab270458 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012543 Jul 11 11:19:02.693060 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: [pid: 103795|app: 0|req: 27/52] 10.222.0.26 () {60 vars in 1193 bytes} [Mon Jul 11 11:19:02 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 11 11:19:03.655498 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi [None req-7f4c2bae-c314-430f-baae-aae8bbc8b238 admin admin] Calling method '>' {{(pid=103794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:19:03.656553 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: INFO nova.api.openstack.requestlog [None req-7f4c2bae-c314-430f-baae-aae8bbc8b238 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Jul 11 11:19:03.656944 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: [pid: 103794|app: 0|req: 26/53] 10.222.0.26 () {56 vars in 1074 bytes} [Mon Jul 11 11:19:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:19:04.183415 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi [None req-b7b4bd2a-f3f4-4ec7-92ec-2dfae3a05195 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:19:04.272077 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: INFO nova.api.openstack.requestlog [None req-b7b4bd2a-f3f4-4ec7-92ec-2dfae3a05195 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.477752 Jul 11 11:19:04.272617 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: [pid: 103795|app: 0|req: 28/54] 10.222.0.26 () {64 vars in 1235 bytes} [Mon Jul 11 11:19:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 11:19:05.230778 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi [None req-7f4c2bae-c314-430f-baae-aae8bbc8b238 admin admin] Calling method '>' {{(pid=103794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:19:05.231826 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: INFO nova.api.openstack.requestlog [None req-7f4c2bae-c314-430f-baae-aae8bbc8b238 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Jul 11 11:19:05.232777 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: [pid: 103794|app: 0|req: 27/55] 10.222.0.26 () {56 vars in 1074 bytes} [Mon Jul 11 11:19:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:19:05.749944 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi [None req-0fb1dc83-5247-436f-a035-223d23a5c44b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:19:05.815587 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: INFO nova.api.openstack.requestlog [None req-0fb1dc83-5247-436f-a035-223d23a5c44b admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.446852 Jul 11 11:19:05.816135 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: [pid: 103795|app: 0|req: 29/56] 10.222.0.26 () {64 vars in 1235 bytes} [Mon Jul 11 11:19:05 2022] POST /compute/v2.1/flavors => generated 405 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 11:19:06.778401 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi [None req-7f4c2bae-c314-430f-baae-aae8bbc8b238 admin admin] Calling method '>' {{(pid=103794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:19:06.779463 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: INFO nova.api.openstack.requestlog [None req-7f4c2bae-c314-430f-baae-aae8bbc8b238 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Jul 11 11:19:06.779856 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: [pid: 103794|app: 0|req: 28/57] 10.222.0.26 () {56 vars in 1074 bytes} [Mon Jul 11 11:19:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:19:07.306179 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi [None req-558ec308-6b52-403d-b05f-0c840ef12c27 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:19:07.357570 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: INFO nova.api.openstack.requestlog [None req-558ec308-6b52-403d-b05f-0c840ef12c27 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.440324 Jul 11 11:19:07.358104 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: [pid: 103795|app: 0|req: 30/58] 10.222.0.26 () {64 vars in 1235 bytes} [Mon Jul 11 11:19:06 2022] POST /compute/v2.1/flavors => generated 407 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 11:19:08.321402 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi [None req-7f4c2bae-c314-430f-baae-aae8bbc8b238 admin admin] Calling method '>' {{(pid=103794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:19:08.322417 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: INFO nova.api.openstack.requestlog [None req-7f4c2bae-c314-430f-baae-aae8bbc8b238 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Jul 11 11:19:08.322863 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: [pid: 103794|app: 0|req: 29/59] 10.222.0.26 () {56 vars in 1074 bytes} [Mon Jul 11 11:19:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:19:08.836679 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi [None req-95ef1170-04c9-44fe-9a7b-b4965cfc9fb5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:19:08.900846 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: INFO nova.api.openstack.requestlog [None req-95ef1170-04c9-44fe-9a7b-b4965cfc9fb5 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.439203 Jul 11 11:19:08.901313 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: [pid: 103795|app: 0|req: 31/60] 10.222.0.26 () {64 vars in 1235 bytes} [Mon Jul 11 11:19:08 2022] POST /compute/v2.1/flavors => generated 409 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 11:19:09.868098 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi [None req-7f4c2bae-c314-430f-baae-aae8bbc8b238 admin admin] Calling method '>' {{(pid=103794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:19:09.869138 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: INFO nova.api.openstack.requestlog [None req-7f4c2bae-c314-430f-baae-aae8bbc8b238 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001555 Jul 11 11:19:09.869533 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: [pid: 103794|app: 0|req: 30/61] 10.222.0.26 () {56 vars in 1074 bytes} [Mon Jul 11 11:19:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:19:10.385136 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi [None req-b18ed97b-afc8-4f68-9283-a6a7b1cf1bd9 admin admin] Calling method '>' {{(pid=103795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:19:10.404734 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: INFO nova.api.openstack.requestlog [None req-b18ed97b-afc8-4f68-9283-a6a7b1cf1bd9 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.396756 Jul 11 11:19:10.405272 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: [pid: 103795|app: 0|req: 32/62] 10.222.0.26 () {60 vars in 1202 bytes} [Mon Jul 11 11:19:10 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:20:02.026452 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi [None req-7f4c2bae-c314-430f-baae-aae8bbc8b238 admin admin] Calling method '>' {{(pid=103794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:20:02.027528 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: INFO nova.api.openstack.requestlog [None req-7f4c2bae-c314-430f-baae-aae8bbc8b238 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Jul 11 11:20:02.027918 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: [pid: 103794|app: 0|req: 31/63] 10.222.0.26 () {54 vars in 930 bytes} [Mon Jul 11 11:20:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:20:02.038210 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG dbcounter [-] [103795] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:20:02.408849 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi [None req-faba2179-f28b-4bde-a48b-ada8c142658b admin admin] Calling method '>' {{(pid=103795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:20:02.427576 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: INFO nova.api.openstack.requestlog [None req-faba2179-f28b-4bde-a48b-ada8c142658b admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.393831 Jul 11 11:20:02.428108 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: [pid: 103795|app: 0|req: 33/64] 10.222.0.26 () {60 vars in 1291 bytes} [Mon Jul 11 11:20:02 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:20:02.452168 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi [None req-c0da0386-1b49-4aab-882b-e2a53feba9a8 admin admin] Calling method '>' {{(pid=103794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:20:02.455500 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG dbcounter [-] [103794] Writing DB stats nova_api:SELECT=21,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:20:02.460466 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: INFO nova.api.openstack.requestlog [None req-c0da0386-1b49-4aab-882b-e2a53feba9a8 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012528 Jul 11 11:20:02.460975 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: [pid: 103794|app: 0|req: 32/65] 10.222.0.26 () {60 vars in 1282 bytes} [Mon Jul 11 11:20:02 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:20:02.472786 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi [None req-f652b3c7-f2da-4a4e-b7d5-3b150dca131a admin admin] Calling method '>' {{(pid=103795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:20:02.480345 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: INFO nova.api.openstack.requestlog [None req-f652b3c7-f2da-4a4e-b7d5-3b150dca131a admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011093 Jul 11 11:20:02.480852 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: [pid: 103795|app: 0|req: 34/66] 10.222.0.26 () {60 vars in 1285 bytes} [Mon Jul 11 11:20:02 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:20:02.491912 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi [None req-967113ee-71cd-45d0-9148-00d901b15ae2 admin admin] Calling method '>' {{(pid=103794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:20:02.499682 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: INFO nova.api.openstack.requestlog [None req-967113ee-71cd-45d0-9148-00d901b15ae2 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011247 Jul 11 11:20:02.500190 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: [pid: 103794|app: 0|req: 33/67] 10.222.0.26 () {60 vars in 1285 bytes} [Mon Jul 11 11:20:02 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:20:02.511505 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi [None req-e8de776b-a385-4bfc-86e3-80e14d885c17 admin admin] Calling method '>' {{(pid=103795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:20:02.518786 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: INFO nova.api.openstack.requestlog [None req-e8de776b-a385-4bfc-86e3-80e14d885c17 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011230 Jul 11 11:20:02.519321 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: [pid: 103795|app: 0|req: 35/68] 10.222.0.26 () {60 vars in 1282 bytes} [Mon Jul 11 11:20:02 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:23:41.192605 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi [None req-967113ee-71cd-45d0-9148-00d901b15ae2 admin admin] Calling method '>' {{(pid=103794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:23:41.194119 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: INFO nova.api.openstack.requestlog [None req-967113ee-71cd-45d0-9148-00d901b15ae2 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001930 Jul 11 11:23:41.194504 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: [pid: 103794|app: 0|req: 34/69] 10.222.0.26 () {56 vars in 1074 bytes} [Mon Jul 11 11:23:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:23:41.333749 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG dbcounter [-] [103795] Writing DB stats nova_api:SELECT=6 {{(pid=103795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:23:41.488425 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi [None req-5ad25e1e-e76e-4fce-9c1f-b878f4117b02 admin admin] Calling method '>' {{(pid=103795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:23:41.489584 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 11:23:41.489584 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: warnings.warn(msg) Jul 11 11:23:41.491388 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG oslo_concurrency.lockutils [None req-5ad25e1e-e76e-4fce-9c1f-b878f4117b02 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:23:41.491826 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG oslo_concurrency.lockutils [None req-5ad25e1e-e76e-4fce-9c1f-b878f4117b02 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:23:41.492633 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG oslo_concurrency.lockutils [None req-5ad25e1e-e76e-4fce-9c1f-b878f4117b02 admin admin] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:23:41.493059 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG oslo_concurrency.lockutils [None req-5ad25e1e-e76e-4fce-9c1f-b878f4117b02 admin admin] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:23:41.526345 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: INFO nova.api.openstack.requestlog [None req-5ad25e1e-e76e-4fce-9c1f-b878f4117b02 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.194006 Jul 11 11:23:41.526900 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: [pid: 103795|app: 0|req: 36/70] 10.222.0.26 () {60 vars in 1193 bytes} [Mon Jul 11 11:23:41 2022] GET /compute/v2.1/os-services => generated 791 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 11:23:42.350159 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi [None req-967113ee-71cd-45d0-9148-00d901b15ae2 admin admin] Calling method '>' {{(pid=103794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:23:42.351163 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: INFO nova.api.openstack.requestlog [None req-967113ee-71cd-45d0-9148-00d901b15ae2 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001951 Jul 11 11:23:42.351618 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: [pid: 103794|app: 0|req: 35/71] 10.222.0.26 () {56 vars in 1074 bytes} [Mon Jul 11 11:23:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:23:42.542026 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi [None req-5a1876a2-f022-4d21-808f-f97f653f9834 admin admin] Calling method '>' {{(pid=103795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:23:42.543190 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 11:23:42.543190 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: warnings.warn(msg) Jul 11 11:23:42.544401 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG oslo_concurrency.lockutils [None req-5a1876a2-f022-4d21-808f-f97f653f9834 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:23:42.544840 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG oslo_concurrency.lockutils [None req-5a1876a2-f022-4d21-808f-f97f653f9834 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:23:42.545610 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG oslo_concurrency.lockutils [None req-5a1876a2-f022-4d21-808f-f97f653f9834 admin admin] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:23:42.546032 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG oslo_concurrency.lockutils [None req-5a1876a2-f022-4d21-808f-f97f653f9834 admin admin] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:23:42.565922 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: INFO nova.api.openstack.requestlog [None req-5a1876a2-f022-4d21-808f-f97f653f9834 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.074313 Jul 11 11:23:42.566476 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: [pid: 103795|app: 0|req: 37/72] 10.222.0.26 () {60 vars in 1193 bytes} [Mon Jul 11 11:23:42 2022] GET /compute/v2.1/os-services => generated 791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 11 11:23:53.883854 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi [None req-967113ee-71cd-45d0-9148-00d901b15ae2 admin admin] Calling method '>' {{(pid=103794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:23:53.884855 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: INFO nova.api.openstack.requestlog [None req-967113ee-71cd-45d0-9148-00d901b15ae2 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Jul 11 11:23:53.885241 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: [pid: 103794|app: 0|req: 36/73] 10.222.0.26 () {56 vars in 1074 bytes} [Mon Jul 11 11:23:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:23:54.026320 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG dbcounter [-] [103795] Writing DB stats nova_cell0:SELECT=4 {{(pid=103795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:23:54.027190 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG dbcounter [-] [103795] Writing DB stats nova_cell1:SELECT=4 {{(pid=103795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:23:54.027823 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG dbcounter [-] [103795] Writing DB stats nova_api:SELECT=8 {{(pid=103795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:23:54.076208 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi [None req-64b61c3e-3e8b-4416-8529-57f6e07b8a03 admin admin] Calling method '>' {{(pid=103795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:23:54.077392 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 11:23:54.077392 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: warnings.warn(msg) Jul 11 11:23:54.078750 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG oslo_concurrency.lockutils [None req-64b61c3e-3e8b-4416-8529-57f6e07b8a03 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:23:54.079187 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG oslo_concurrency.lockutils [None req-64b61c3e-3e8b-4416-8529-57f6e07b8a03 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:23:54.080012 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG oslo_concurrency.lockutils [None req-64b61c3e-3e8b-4416-8529-57f6e07b8a03 admin admin] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:23:54.080435 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG oslo_concurrency.lockutils [None req-64b61c3e-3e8b-4416-8529-57f6e07b8a03 admin admin] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:23:54.120666 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: INFO nova.api.openstack.requestlog [None req-64b61c3e-3e8b-4416-8529-57f6e07b8a03 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.083930 Jul 11 11:23:54.120666 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: [pid: 103795|app: 0|req: 38/74] 10.222.0.26 () {60 vars in 1193 bytes} [Mon Jul 11 11:23:54 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:23:54.935683 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: DEBUG nova.api.openstack.wsgi [None req-967113ee-71cd-45d0-9148-00d901b15ae2 admin admin] Calling method '>' {{(pid=103794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:23:54.936690 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: INFO nova.api.openstack.requestlog [None req-967113ee-71cd-45d0-9148-00d901b15ae2 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Jul 11 11:23:54.937078 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: [pid: 103794|app: 0|req: 37/75] 10.222.0.26 () {56 vars in 1074 bytes} [Mon Jul 11 11:23:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:23:55.128319 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG nova.api.openstack.wsgi [None req-a968f385-148c-44a0-8910-1b58bfe56271 admin admin] Calling method '>' {{(pid=103795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:23:55.129482 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 11:23:55.129482 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: warnings.warn(msg) Jul 11 11:23:55.131229 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG oslo_concurrency.lockutils [None req-a968f385-148c-44a0-8910-1b58bfe56271 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:23:55.131691 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG oslo_concurrency.lockutils [None req-a968f385-148c-44a0-8910-1b58bfe56271 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:23:55.132467 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG oslo_concurrency.lockutils [None req-a968f385-148c-44a0-8910-1b58bfe56271 admin admin] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:23:55.132892 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: DEBUG oslo_concurrency.lockutils [None req-a968f385-148c-44a0-8910-1b58bfe56271 admin admin] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:23:55.154662 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: INFO nova.api.openstack.requestlog [None req-a968f385-148c-44a0-8910-1b58bfe56271 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.077883 Jul 11 11:23:55.155138 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: [pid: 103795|app: 0|req: 39/76] 10.222.0.26 () {60 vars in 1193 bytes} [Mon Jul 11 11:23:55 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:24:51.061670 dv-cinder-848429-2-iscsi devstack@n-api.service[103793]: Mon Jul 11 11:24:51 2022 - graceful shutdown triggered... Jul 11 11:24:51.061542 dv-cinder-848429-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 11 11:24:51.062675 dv-cinder-848429-2-iscsi devstack@n-api.service[103795]: Gracefully killing worker 2 (pid: 103795)... Jul 11 11:24:51.063056 dv-cinder-848429-2-iscsi devstack@n-api.service[103794]: Gracefully killing worker 1 (pid: 103794)... Jul 11 11:24:52.062560 dv-cinder-848429-2-iscsi devstack@n-api.service[103793]: worker 1 buried after 1 seconds Jul 11 11:24:52.063135 dv-cinder-848429-2-iscsi devstack@n-api.service[103793]: worker 2 buried after 1 seconds Jul 11 11:24:52.063135 dv-cinder-848429-2-iscsi devstack@n-api.service[103793]: goodbye to uWSGI. Jul 11 11:24:52.064186 dv-cinder-848429-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 11 11:24:52.064721 dv-cinder-848429-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 11 11:24:52.067776 dv-cinder-848429-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 11 11:24:52.080625 dv-cinder-848429-2-iscsi devstack@n-api.service[118300]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 11 11:24:52.082679 dv-cinder-848429-2-iscsi devstack@n-api.service[118300]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 11 11:24:52 2022] *** Jul 11 11:24:52.082679 dv-cinder-848429-2-iscsi devstack@n-api.service[118300]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 11 11:24:52.082679 dv-cinder-848429-2-iscsi devstack@n-api.service[118300]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 11 11:24:52.082679 dv-cinder-848429-2-iscsi devstack@n-api.service[118300]: nodename: dv-cinder-848429-2-iscsi Jul 11 11:24:52.082679 dv-cinder-848429-2-iscsi devstack@n-api.service[118300]: machine: x86_64 Jul 11 11:24:52.082679 dv-cinder-848429-2-iscsi devstack@n-api.service[118300]: clock source: unix Jul 11 11:24:52.082679 dv-cinder-848429-2-iscsi devstack@n-api.service[118300]: pcre jit disabled Jul 11 11:24:52.082679 dv-cinder-848429-2-iscsi devstack@n-api.service[118300]: detected number of CPU cores: 4 Jul 11 11:24:52.082679 dv-cinder-848429-2-iscsi devstack@n-api.service[118300]: current working directory: / Jul 11 11:24:52.082679 dv-cinder-848429-2-iscsi devstack@n-api.service[118300]: detected binary path: /usr/bin/uwsgi-core Jul 11 11:24:52.083386 dv-cinder-848429-2-iscsi devstack@n-api.service[118300]: your processes number limit is 47680 Jul 11 11:24:52.083386 dv-cinder-848429-2-iscsi devstack@n-api.service[118300]: your memory page size is 4096 bytes Jul 11 11:24:52.083386 dv-cinder-848429-2-iscsi devstack@n-api.service[118300]: detected max file descriptor number: 2048 Jul 11 11:24:52.083386 dv-cinder-848429-2-iscsi devstack@n-api.service[118300]: lock engine: pthread robust mutexes Jul 11 11:24:52.083386 dv-cinder-848429-2-iscsi devstack@n-api.service[118300]: thunder lock: enabled Jul 11 11:24:52.083386 dv-cinder-848429-2-iscsi devstack@n-api.service[118300]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 11 11:24:52.083386 dv-cinder-848429-2-iscsi devstack@n-api.service[118300]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 11 11:24:52.128607 dv-cinder-848429-2-iscsi devstack@n-api.service[118300]: Python main interpreter initialized at 0x56485d36b9c0 Jul 11 11:24:52.128607 dv-cinder-848429-2-iscsi devstack@n-api.service[118300]: python threads support enabled Jul 11 11:24:52.128607 dv-cinder-848429-2-iscsi devstack@n-api.service[118300]: your server socket listen backlog is limited to 100 connections Jul 11 11:24:52.128607 dv-cinder-848429-2-iscsi devstack@n-api.service[118300]: your mercy for graceful operations on workers is 90 seconds Jul 11 11:24:52.129052 dv-cinder-848429-2-iscsi devstack@n-api.service[118300]: mapped 403077 bytes (393 KB) for 2 cores Jul 11 11:24:52.129052 dv-cinder-848429-2-iscsi devstack@n-api.service[118300]: *** Operational MODE: preforking *** Jul 11 11:24:52.129335 dv-cinder-848429-2-iscsi devstack@n-api.service[118300]: *** uWSGI is running in multiple interpreter mode *** Jul 11 11:24:52.129335 dv-cinder-848429-2-iscsi devstack@n-api.service[118300]: spawned uWSGI master process (pid: 118300) Jul 11 11:24:52.129538 dv-cinder-848429-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 11 11:24:52.131285 dv-cinder-848429-2-iscsi devstack@n-api.service[118300]: spawned uWSGI worker 1 (pid: 118321, cores: 1) Jul 11 11:24:52.131285 dv-cinder-848429-2-iscsi devstack@n-api.service[118300]: spawned uWSGI worker 2 (pid: 118322, cores: 1) Jul 11 11:24:52.131285 dv-cinder-848429-2-iscsi devstack@n-api.service[118300]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 11 11:24:52.794386 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 11 11:24:52.796828 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 11 11:24:54.009200 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 11 11:24:54.009200 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: from cryptography.utils import int_from_bytes Jul 11 11:24:54.009955 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 11 11:24:54.009955 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: from cryptography.utils import int_from_bytes Jul 11 11:24:54.021141 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 11 11:24:54.021141 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: from cryptography.utils import int_from_bytes Jul 11 11:24:54.021720 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 11 11:24:54.021720 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: from cryptography.utils import int_from_bytes Jul 11 11:24:56.394251 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 11 11:24:56.394804 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 11 11:24:56.395669 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 11 11:24:56.395902 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 11 11:24:56.396174 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 11 11:24:56.396544 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.396869 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.398357 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.398357 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.398357 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.398357 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.398728 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.398728 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.399048 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.399334 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.399650 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.399975 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-848429-2-iscsi {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.400296 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.400602 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.400914 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.401233 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.401539 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.401861 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.402168 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.402685 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.404059 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.404059 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.404059 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.404450 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.404680 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.404989 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.405310 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.405633 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.405948 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.406269 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.406665 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-848429-2-iscsi {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.406987 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.407297 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.407623 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.408047 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.408369 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.408672 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.408996 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.409319 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.409632 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.409960 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.410280 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.410600 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.411562 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.411873 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.412184 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.412501 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.412823 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.413131 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.413439 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.413690 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.413998 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.414316 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.414640 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.414962 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.415213 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.415961 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.415961 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.416131 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.416400 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.416709 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.417018 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.417326 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.417630 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.417941 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.418249 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.418556 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.418874 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.419190 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.419540 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.419849 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.420172 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.420571 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.420821 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.421130 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.421470 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.421792 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.422099 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.422417 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.422736 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.423042 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.423380 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.423688 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.424009 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.424345 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.424651 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.424902 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.425202 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.425508 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.425826 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.425985 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 11 11:24:56.426503 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.426666 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 11 11:24:56.426819 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.426819 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.427408 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 11 11:24:56.427570 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.427723 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 11 11:24:56.427874 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.428024 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 11 11:24:56.428178 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.428340 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.428492 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.428649 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.428802 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.428946 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.429102 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.429253 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.429397 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.429540 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.429690 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.429841 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.429985 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.430127 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.430280 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.430422 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.430572 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.430724 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.430874 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.431017 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.431160 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.431398 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.431551 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.431712 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-848429-2-iscsi {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.431955 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.432124 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.432349 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.432595 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.432773 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.433023 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.433235 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.433385 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.433644 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.433795 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.433947 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.434104 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.434248 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.434399 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.434543 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.434543 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.434826 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.434994 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.435138 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.435328 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.435491 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.435725 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.435874 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.436023 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.436166 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.436322 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.436476 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.436619 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.436767 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.436918 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.437076 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.437230 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.437373 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.437526 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.437677 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.437820 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.437972 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.438123 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.438266 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-848429-2-iscsi {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.438418 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.438567 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.438719 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.438862 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.439011 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.439161 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.439342 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.439342 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.440284 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.440441 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.440592 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.440744 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.440894 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.441059 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.441210 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.441360 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.441600 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.441757 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.441924 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.442154 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.442325 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.442568 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.442781 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.442930 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.443176 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.443464 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.443633 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.443869 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.444021 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.444021 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.444454 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.444628 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.444782 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.444990 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.445135 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.445284 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.445442 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.445586 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.445757 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.445972 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.446127 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.446279 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.446489 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.446645 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.446789 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.446939 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.447090 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.447245 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.447436 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.447598 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.447761 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.447904 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.448054 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.448207 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.448361 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.448513 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.448657 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.448799 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.448947 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.449103 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.449254 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.449408 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.449563 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.449706 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.449857 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.450000 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.450143 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.450844 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.450844 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.451134 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.451299 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.451451 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.451613 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.451851 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.452011 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.452484 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.452757 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.452976 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.453155 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.453389 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.453619 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.453771 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.453771 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.454168 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.454168 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.454464 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.454620 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.454765 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.454907 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.455051 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.455051 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.455372 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.455372 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.455654 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.455654 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.455948 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.456183 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.456333 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.456485 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.456647 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.456800 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.456959 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.457112 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.457255 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.457397 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.457549 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.458192 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.458345 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.458489 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.458680 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.458829 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.458984 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.459136 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.459326 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.459477 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.459661 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.459816 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.459961 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.460204 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.460364 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.460510 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.460653 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.460803 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.460946 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.461101 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.461252 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.461404 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.461554 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.461698 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.461860 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.462093 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.462244 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.462244 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.462618 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.462851 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.463026 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.463268 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.463537 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.463928 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.464078 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.464241 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.464483 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.464643 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.464788 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.465095 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.465261 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.465422 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.465568 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.465743 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.465897 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.466054 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.466230 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.466380 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.467086 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.467270 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.467425 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.467591 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.467737 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.467893 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.468037 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.468181 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.468331 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.468484 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.468639 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.468797 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.468948 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.469103 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.469247 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.469398 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.469617 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.469771 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.469922 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.470066 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.470217 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.470368 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.470537 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.470689 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.470833 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.470983 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.471133 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.471342 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.471511 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.471668 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.471812 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.471963 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.472199 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.472349 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.472504 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.472757 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.472943 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.473099 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.473890 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.474058 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.474205 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.474356 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.474501 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.474657 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.474802 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.474954 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.475123 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.475374 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.475544 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.475697 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.475841 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.475998 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.476142 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.476292 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.476442 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.476585 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.476728 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.476981 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:24:56.477133 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.477133 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.477419 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.477587 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.477745 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.477891 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.478033 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.478182 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.478335 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.478480 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.478636 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.478783 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.478927 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.479068 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.479211 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.479435 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.479596 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.479756 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.479901 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.480051 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.480201 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.480354 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.480498 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.480649 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.480800 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.480945 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.481095 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.481248 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.481403 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.481553 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.481697 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.481839 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.481983 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.482135 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.482372 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.482522 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.482674 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.482903 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.483054 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.483211 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.483392 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.483550 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.483700 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.483854 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.483997 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.484160 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.484303 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.484453 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.484595 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.484738 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.484889 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.485040 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.485184 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.485337 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.485592 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.485742 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.485895 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.486047 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.486200 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.486358 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.486514 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.486658 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.486814 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.486958 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.487109 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.487272 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.487451 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.487732 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.487913 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.488061 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.488211 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.488364 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.488508 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.488666 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.488833 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.488985 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.489143 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.489297 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.489440 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.489609 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.489752 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.489895 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.490043 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.490187 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.490330 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.490503 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.490678 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.490830 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.490974 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.491117 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.491484 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.491680 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.491839 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.491982 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.492133 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.492284 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.492525 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.492685 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.492836 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.493067 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.493217 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.493369 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.493528 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.493681 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.493850 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.494003 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.494003 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.494275 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.494432 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.494586 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.494586 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.494857 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.494857 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.495152 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.495351 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.495502 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.495749 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.495910 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.496070 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.496215 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.496367 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.496511 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.496666 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.496817 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.496960 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.497112 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.497262 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.497404 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.497560 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.497709 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.497870 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.498027 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.498171 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.498312 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.498456 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.498605 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.498756 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.498916 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.499075 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.499225 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.499424 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.499583 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.499743 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.499981 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.500141 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.500298 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.500447 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.500603 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.500766 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.500917 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.501065 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.501213 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.501361 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.501517 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.501680 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.501838 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.502000 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.502157 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.502308 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.502589 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.502758 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.502911 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.503078 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.503078 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.503472 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.503631 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.503795 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.503953 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.504122 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.504273 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.504421 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.505124 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.505282 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.505433 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.505588 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.505770 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.506015 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.506181 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.506332 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.506488 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.506645 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.506806 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.506955 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.507118 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.507369 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.507538 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.507696 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.507854 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.508014 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.508185 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.508337 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.508485 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.508633 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.508790 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.508959 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.509110 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.509267 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.509424 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.509620 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.509620 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.509969 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.510121 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.510270 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.510427 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.510584 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.510740 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.510899 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.511067 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.511236 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.511413 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.511562 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.511724 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.511880 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.512037 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.512193 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.512342 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.512498 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.512674 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.512903 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.513070 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.513220 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.513402 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.513563 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.513714 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.513863 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.514018 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.514167 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.514325 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.514476 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.514632 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.514781 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.514965 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.515139 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.515307 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.515472 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.515623 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.515779 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.515936 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.516197 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.516354 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.516511 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.516686 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.516846 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.517004 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.517205 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.517377 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.517535 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.517686 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.517843 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.517999 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.518173 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.518325 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.518746 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.518904 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.519060 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.519060 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.519429 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.519581 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.519753 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.519912 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.520085 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.520824 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.520986 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.521136 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.521285 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.521285 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.521568 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.521730 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.521882 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.522029 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.522188 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.522337 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.522486 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.522649 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.522800 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.523034 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.523197 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.523393 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.523531 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.523636 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.523727 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.523727 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.523889 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.523973 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.524069 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.524165 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.524260 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.524354 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.524446 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.524533 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.524632 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.524742 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.524869 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.524960 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.525046 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.525130 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.525260 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.525378 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.525462 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.525543 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.525636 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.525732 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.525819 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.525912 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.526000 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.526085 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.526170 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.526259 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.526334 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.526416 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.526502 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.526587 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.526672 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.526766 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.526852 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.526936 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.527021 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.527117 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.527211 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.527364 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.527456 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.527532 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.527604 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.527675 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.527756 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.527831 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.527902 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.527974 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.528045 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.528138 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.528224 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.528305 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.528385 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.528480 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.528574 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.528661 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.528808 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.528905 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.528992 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.529084 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.529171 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.529265 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.529366 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.529460 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.529553 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.529640 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.529732 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.529828 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.529921 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.530014 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.530100 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.530187 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.530280 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.530380 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.530473 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.530567 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.530653 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.530746 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.530839 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.530935 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.531023 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.531118 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.531204 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.531319 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.531408 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.531511 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.531606 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.531694 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.531694 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.531858 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.531958 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.532052 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.532145 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.532238 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.532324 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.532416 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.532501 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.532582 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.532662 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.532743 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.532817 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.532894 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.533045 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.533128 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.533209 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.533295 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.533381 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.533474 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.533569 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.533650 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.533650 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.533791 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.533876 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.533968 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.533968 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.534122 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.534214 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.534300 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.534385 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.534508 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.534603 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.534696 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.534789 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.534789 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.534952 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.535049 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.535136 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.535229 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.535330 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.535405 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.535475 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.535568 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.535643 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.535715 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.535804 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.535890 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.535988 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.536082 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.536176 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.536269 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.536368 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.536456 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.536530 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.536615 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.536699 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.536783 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.536877 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.536964 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.537048 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.537144 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.537237 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.537337 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.537425 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.537618 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.537736 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.537933 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.538051 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.538240 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.538339 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.538556 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.538654 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.538868 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.538965 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.539179 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.539306 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.539517 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.539627 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.539827 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.539923 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.540134 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.540230 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.540443 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.540537 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.540748 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.540849 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.541051 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.541152 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.541355 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.541455 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.541671 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.541774 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.541974 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.542076 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.542284 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.542379 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.542586 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.542691 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.542893 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.542987 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.543194 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.543310 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.543579 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.543689 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.543908 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.544003 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.544214 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.544308 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.544520 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.544615 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.544829 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.544930 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.545133 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.545234 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.545457 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.545558 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.545741 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.545846 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.546040 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.546134 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.546352 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.546453 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.546664 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.546759 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.546976 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.547072 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.547307 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.547408 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.547613 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.547745 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.547920 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.548042 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.548236 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.548331 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.548548 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.548644 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.548853 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.548956 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.549155 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.549241 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.549458 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.549552 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.549767 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.549875 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.550071 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.550166 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.550382 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.550484 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.550688 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.550791 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.551003 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.551105 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.551348 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.551446 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.551664 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.551834 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.551971 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.552400 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.552540 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.552709 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.552852 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.553030 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.553157 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.553352 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.553489 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.553676 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.553803 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.553981 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.554112 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.554292 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.554418 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.554602 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.554730 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.554924 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.555039 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.555245 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.555374 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.555579 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.555686 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.555892 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.555987 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.556195 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.556296 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.556515 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.556612 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.556834 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.556939 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.557144 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.557247 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.557462 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.557559 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.557765 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.557869 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.558080 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.558187 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.558386 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.558495 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.558693 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.558789 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.558999 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.559108 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.559328 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.559427 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.559637 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.559733 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.559962 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.560067 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.560276 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.560372 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.560584 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.560686 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.560887 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.560990 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.561193 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.561295 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.561500 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.561600 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.561810 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.561918 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.562119 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.562215 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.562425 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.562514 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.562729 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.562823 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.563078 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.563181 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.563375 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.563469 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.563700 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.563805 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.564013 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.564114 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.564319 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.564421 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.564637 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.564740 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.564938 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.565032 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.565251 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.565351 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.565556 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.565675 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.565858 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.565971 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.566160 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.566266 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.566463 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.566567 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.566771 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.566864 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.567628 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.567746 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.567955 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.568059 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.568281 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.568378 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.568590 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.568697 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.568904 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.569001 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.569217 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.569319 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.569529 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.569635 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.569843 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.569945 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.570157 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.570266 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.570471 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.570565 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.570772 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.570865 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.571077 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.571182 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.571411 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.571508 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.571719 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.571822 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.572025 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.572135 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.572328 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.572422 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.572635 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.572737 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.572936 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.573032 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.573240 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.573354 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.573542 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.573644 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.573855 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.573950 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.574156 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.574264 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.574460 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.574554 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.574769 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.574871 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.575070 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.575172 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.575398 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.575526 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.575702 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.575841 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.576043 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.576142 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.576347 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.576452 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.576679 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.576775 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.576995 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.577144 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.577316 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.577425 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.577644 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.577738 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.577949 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.578100 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.578269 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.578373 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.578592 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.578696 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.578914 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.579048 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.579220 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.579451 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.579589 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.579690 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.579861 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.579956 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.580175 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.580279 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.580488 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.580593 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.580795 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.580889 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.581104 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.581201 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.581413 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.581516 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.581726 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.581821 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.582034 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.582247 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.582343 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.582596 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.583315 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.583503 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.583626 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.583820 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.583935 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.584135 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.584341 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.584454 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.584657 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.584760 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.584973 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.585067 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.585300 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.585409 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.585627 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.585722 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.585941 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.586034 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.586248 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.586400 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.586564 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.586660 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.586876 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.586972 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.587201 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.587360 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.587540 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.587634 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.587853 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.587944 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.588165 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.588260 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.588468 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.588571 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.588793 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.588896 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.589116 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.589230 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.589421 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.589515 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.589735 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.589840 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.590050 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.590152 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.590363 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.590464 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.590672 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.590777 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.590985 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.591080 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.591318 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.591455 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.591633 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.591744 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.591943 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.592046 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.592255 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.592351 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.592567 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.592663 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.592870 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.592971 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.593191 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.593285 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.593504 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.593609 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.593816 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.593910 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.594129 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.594226 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.594437 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.594538 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.594740 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.594841 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.595048 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.595269 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.595386 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.595597 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.595693 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.595934 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.596094 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.596263 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.596368 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.596587 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.596685 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.596903 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.596999 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.597217 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.597319 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.597542 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.597638 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.597846 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.597947 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.598246 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.598384 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.598507 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.598629 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.598764 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.598864 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.599073 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.599169 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.599419 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.599526 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.599733 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.599839 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.600039 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.600135 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.600359 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.600455 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.600667 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.600771 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.600999 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.601198 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.601328 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.601544 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.601638 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.601857 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.601954 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.602182 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.602278 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.602506 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.602602 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.602823 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.602927 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.603129 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.603231 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.603470 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.603638 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.603779 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.603881 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.604081 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.604182 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.604390 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.604538 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.604694 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.604790 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.604995 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.605088 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.605297 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.605399 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.605607 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.605702 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.605910 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.606011 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.606213 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.606357 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.606525 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.606663 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.606828 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.606930 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.607135 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.607238 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.607465 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.607561 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.607767 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.607861 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.608071 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.608214 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.608385 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.608503 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.608692 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.608835 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.609018 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.609348 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.609460 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.609660 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.609756 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.609984 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.610093 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.610305 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.610399 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.610622 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.610726 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.610941 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.611044 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.611244 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.611356 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.611584 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.611686 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.611887 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.611982 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.612198 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.612293 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.612507 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.612599 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.612823 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.612919 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.613138 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.613240 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.613439 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.613532 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.613752 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.613999 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.614094 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.614333 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.614436 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.614652 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.614749 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.614968 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.615062 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.615313 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.615413 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.615625 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.615722 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.615942 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.616180 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.616283 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.616516 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.616629 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.616835 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.616941 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.617158 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.617254 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.617487 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.617582 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.617795 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.617889 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.618102 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.618205 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.618407 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.618567 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.618737 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.618847 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.619049 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.619156 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.619383 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.619518 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.619699 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.619804 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.620009 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.620116 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.620320 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.620418 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.620630 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.620724 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.620938 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.621047 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.621249 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.621344 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.621559 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.621662 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.621871 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.622000 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.622177 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.622283 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.622487 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.622583 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.622797 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.622893 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.623108 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.623209 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.623453 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.623550 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.623772 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.623868 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.624086 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.624182 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.624400 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.624501 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.624717 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.624813 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.625028 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.625130 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.625337 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.625442 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.625645 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.625748 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.625953 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.626055 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.626269 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.626469 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.626599 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.626786 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.626925 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.627122 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.627225 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.627476 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.627636 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.627804 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.627949 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.628122 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.628267 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.628442 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.628597 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.628774 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.628908 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.629084 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.629231 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.629392 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.630083 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.630228 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.630426 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.630637 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.630745 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.630959 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.631063 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.631305 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.631417 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.631625 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.631731 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.631934 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.632037 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.632259 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.632354 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.632572 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.632675 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.632934 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.633106 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.633242 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.633458 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.633567 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.633775 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.633877 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.634102 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.634234 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.634431 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.634536 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.634732 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.634826 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.635045 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.635141 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.635374 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.635485 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.635681 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.635777 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.635984 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.636086 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.636288 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.636392 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.636595 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.636697 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.636896 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.637044 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.637198 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.637338 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.637500 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.637638 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.637802 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.637897 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.638104 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.638205 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.638404 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.638498 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.638713 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.639004 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.639004 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.639197 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.639328 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.639467 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.639632 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.639739 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.639936 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.640040 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.640239 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.640343 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.640542 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.640647 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.640848 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.640952 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.641154 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.641251 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.641457 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.641562 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.641768 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.641875 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.642071 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.642167 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.642384 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.642489 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.642691 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.642795 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.643003 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.643099 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.643330 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.643444 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.643644 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.643746 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.643979 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.644130 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.644336 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.644441 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.644600 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.644696 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.644902 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.645011 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.645749 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.645853 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.646062 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.646155 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.646372 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.646476 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.646686 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.646803 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.646997 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.647133 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.647332 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.647442 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.647661 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.647764 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.647983 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.648200 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.648303 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.648540 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.648637 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.648861 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.648960 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.649194 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.649306 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.649525 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.649639 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.649830 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.649924 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.650140 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.650255 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.650447 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.650542 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.650758 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.650864 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.651083 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.651226 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.651427 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.651533 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.651712 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.651810 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.652026 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.652121 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.652339 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.652436 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.652651 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.652750 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.652962 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.653067 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.653273 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.653369 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.653591 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.653687 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.653903 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.654009 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.654213 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.654316 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.654525 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.654623 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.654836 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.654933 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.655147 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.655268 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.655417 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 11 11:24:56.655532 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.655818 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.656138 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.656458 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.656778 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.657083 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.657395 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.657707 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.658018 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.658339 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.658672 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.658991 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.659318 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.659751 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.660064 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.660385 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.660736 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.661053 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.661381 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.661707 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.662020 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.662345 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.662661 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.662997 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.663368 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.663711 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.664043 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.664355 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.664669 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.664980 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.665298 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.665619 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.665934 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.666241 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.666550 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.666929 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.667173 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.667511 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.667821 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.668130 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.668443 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.668749 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.669057 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.669363 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.669676 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.669984 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.670290 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.670605 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.670913 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.671220 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.671550 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.671860 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.672166 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.672513 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.672853 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.673174 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.673507 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.673824 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.674152 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.674466 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.674793 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.675120 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.675474 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.675790 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.676128 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.676475 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.676790 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.677365 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.677689 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.678000 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.678315 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.678649 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.678979 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.679450 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.679645 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.679972 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.680296 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.680614 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.680928 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.681262 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.681577 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.681891 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.682211 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.682525 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.682840 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.683160 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.683515 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.683852 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.684184 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.684499 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.684830 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.685160 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.685526 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.685847 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.686199 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.686533 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.686852 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.687266 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.687499 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:24:56.687751 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 11 11:24:56.807046 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO dbcounter [None req-d4fb49e4-06fc-4237-9188-44324346a9ad None None] Registered counter for database nova_api Jul 11 11:24:56.827788 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_db.sqlalchemy.engines [None req-d4fb49e4-06fc-4237-9188-44324346a9ad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118321) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 11:24:56.835230 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writer thread running {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 11:24:56.838632 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO dbcounter [None req-02e48f13-14f3-40c2-9487-72d4d3a04d79 None None] Registered counter for database nova_api Jul 11 11:24:56.858199 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_db.sqlalchemy.engines [None req-02e48f13-14f3-40c2-9487-72d4d3a04d79 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118322) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 11:24:56.865089 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writer thread running {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 11:24:56.890753 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.context [None req-d4fb49e4-06fc-4237-9188-44324346a9ad None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),342f6239-eef4-41fd-9223-51ec0b89b6f5(cell1) {{(pid=118321) load_cells /opt/stack/nova/nova/context.py:464}} Jul 11 11:24:56.894746 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d4fb49e4-06fc-4237-9188-44324346a9ad None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:24:56.896907 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d4fb49e4-06fc-4237-9188-44324346a9ad None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:24:56.897705 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d4fb49e4-06fc-4237-9188-44324346a9ad None None] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:24:56.899711 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d4fb49e4-06fc-4237-9188-44324346a9ad None None] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:24:56.901687 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO dbcounter [None req-d4fb49e4-06fc-4237-9188-44324346a9ad None None] Registered counter for database nova_cell0 Jul 11 11:24:56.905807 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO dbcounter [None req-d4fb49e4-06fc-4237-9188-44324346a9ad None None] Registered counter for database nova_cell1 Jul 11 11:24:56.914714 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_db.sqlalchemy.engines [None req-d4fb49e4-06fc-4237-9188-44324346a9ad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118321) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 11:24:56.916608 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_db.sqlalchemy.engines [None req-d4fb49e4-06fc-4237-9188-44324346a9ad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118321) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 11:24:56.921724 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.context [None req-02e48f13-14f3-40c2-9487-72d4d3a04d79 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),342f6239-eef4-41fd-9223-51ec0b89b6f5(cell1) {{(pid=118322) load_cells /opt/stack/nova/nova/context.py:464}} Jul 11 11:24:56.922085 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writer thread running {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 11:24:56.925712 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-02e48f13-14f3-40c2-9487-72d4d3a04d79 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:24:56.928187 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-02e48f13-14f3-40c2-9487-72d4d3a04d79 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:24:56.928330 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writer thread running {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 11:24:56.929002 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-02e48f13-14f3-40c2-9487-72d4d3a04d79 None None] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:24:56.930962 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-02e48f13-14f3-40c2-9487-72d4d3a04d79 None None] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:24:56.932981 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO dbcounter [None req-02e48f13-14f3-40c2-9487-72d4d3a04d79 None None] Registered counter for database nova_cell0 Jul 11 11:24:56.937004 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO dbcounter [None req-02e48f13-14f3-40c2-9487-72d4d3a04d79 None None] Registered counter for database nova_cell1 Jul 11 11:24:56.945587 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_db.sqlalchemy.engines [None req-02e48f13-14f3-40c2-9487-72d4d3a04d79 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118322) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 11:24:56.948215 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_db.sqlalchemy.engines [None req-02e48f13-14f3-40c2-9487-72d4d3a04d79 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118322) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 11:24:56.952924 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writer thread running {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 11:24:56.955542 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writer thread running {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 11:24:57.079750 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO dbcounter [None req-d4fb49e4-06fc-4237-9188-44324346a9ad None None] Registered counter for database nova_cell0 Jul 11 11:24:57.089535 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_db.sqlalchemy.engines [None req-d4fb49e4-06fc-4237-9188-44324346a9ad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118321) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 11:24:57.094195 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writer thread running {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 11:24:57.103413 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO dbcounter [None req-02e48f13-14f3-40c2-9487-72d4d3a04d79 None None] Registered counter for database nova_cell0 Jul 11 11:24:57.110244 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_db.sqlalchemy.engines [None req-02e48f13-14f3-40c2-9487-72d4d3a04d79 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118322) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 11:24:57.114827 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writer thread running {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 11:24:57.416143 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: WARNING keystonemiddleware.auth_token [None req-d4fb49e4-06fc-4237-9188-44324346a9ad None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 11 11:24:57.423475 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: WARNING keystonemiddleware.auth_token [None req-d4fb49e4-06fc-4237-9188-44324346a9ad None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 11 11:24:57.443747 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: WARNING keystonemiddleware.auth_token [None req-02e48f13-14f3-40c2-9487-72d4d3a04d79 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 11 11:24:57.451064 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: WARNING keystonemiddleware.auth_token [None req-02e48f13-14f3-40c2-9487-72d4d3a04d79 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 11 11:24:57.766088 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: WARNING keystonemiddleware.auth_token [None req-d4fb49e4-06fc-4237-9188-44324346a9ad None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 11 11:24:57.772105 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: WARNING keystonemiddleware.auth_token [None req-d4fb49e4-06fc-4237-9188-44324346a9ad None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 11 11:24:57.777347 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56485d36b9c0 pid: 118321 (default app) Jul 11 11:24:57.793820 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: WARNING keystonemiddleware.auth_token [None req-02e48f13-14f3-40c2-9487-72d4d3a04d79 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 11 11:24:57.799789 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: WARNING keystonemiddleware.auth_token [None req-02e48f13-14f3-40c2-9487-72d4d3a04d79 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 11 11:24:57.805840 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56485d36b9c0 pid: 118322 (default app) Jul 11 11:25:39.351870 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_api:SELECT=3 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:25:39.353782 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=3 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:25:39.354834 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell0:SELECT=3 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:25:39.355713 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell0:SELECT=3 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:25:40.520851 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-c69ff50a-9d52-4a39-ba6b-b243eaff8682 tempest-VolumesSnapshotsTestJSON-1025981855 tempest-VolumesSnapshotsTestJSON-1025981855-project] Action: 'create', calling method: .version_select at 0x7fb0119a55e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1288817365"}} {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:25:42.256832 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-c69ff50a-9d52-4a39-ba6b-b243eaff8682 tempest-VolumesSnapshotsTestJSON-1025981855 tempest-VolumesSnapshotsTestJSON-1025981855-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 2.870990 Jul 11 11:25:42.256832 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1/1] 10.222.0.26 () {60 vars in 1154 bytes} [Mon Jul 11 11:25:39 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 2874 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 11 11:25:42.260525 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_api:SELECT=3 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:25:42.260525 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell0:SELECT=3 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:25:42.260525 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=3 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:25:42.260525 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell0:SELECT=3 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:25:42.576706 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-e591217e-970a-403c-9720-7d4a0aaccd52 tempest-VolumesSnapshotsTestJSON-1025981855 tempest-VolumesSnapshotsTestJSON-1025981855-project] Calling method '.version_select at 0x7fb0119f13a0>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:25:42.941239 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-e591217e-970a-403c-9720-7d4a0aaccd52 tempest-VolumesSnapshotsTestJSON-1025981855 tempest-VolumesSnapshotsTestJSON-1025981855-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/f700da5b-b835-4c76-bd00-f86c851d74e2" status: 200 len: 345 microversion: 2.1 time: 0.722640 Jul 11 11:25:42.942722 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1/2] 10.222.0.26 () {58 vars in 1244 bytes} [Mon Jul 11 11:25:42 2022] GET /compute/v2.1/os-volumes/f700da5b-b835-4c76-bd00-f86c851d74e2 => generated 345 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:25:43.964292 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-e7378899-2bde-4244-ba6d-40641f7ece7a tempest-VolumesSnapshotsTestJSON-1025981855 tempest-VolumesSnapshotsTestJSON-1025981855-project] Calling method '.version_select at 0x7fb01186d4c0>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:25:44.173239 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-e7378899-2bde-4244-ba6d-40641f7ece7a tempest-VolumesSnapshotsTestJSON-1025981855 tempest-VolumesSnapshotsTestJSON-1025981855-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/f700da5b-b835-4c76-bd00-f86c851d74e2" status: 200 len: 346 microversion: 2.1 time: 0.222336 Jul 11 11:25:44.174749 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 2/3] 10.222.0.26 () {58 vars in 1244 bytes} [Mon Jul 11 11:25:43 2022] GET /compute/v2.1/os-volumes/f700da5b-b835-4c76-bd00-f86c851d74e2 => generated 346 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:25:44.188798 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-6affe456-946a-4363-9562-c657fffd4c0c tempest-VolumesSnapshotsTestJSON-1025981855 tempest-VolumesSnapshotsTestJSON-1025981855-project] Action: 'create', calling method: .version_select at 0x7fb0118b94c0>, body: {"snapshot": {"volume_id": "f700da5b-b835-4c76-bd00-f86c851d74e2", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-282434162"}} {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:25:45.077148 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-6affe456-946a-4363-9562-c657fffd4c0c tempest-VolumesSnapshotsTestJSON-1025981855 tempest-VolumesSnapshotsTestJSON-1025981855-project] 10.222.0.26 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.893819 Jul 11 11:25:45.088992 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-b6fe6561-aabd-4ba1-8e55-72160e48ae05 tempest-VolumesSnapshotsTestJSON-1025981855 tempest-VolumesSnapshotsTestJSON-1025981855-project] Calling method '.version_select at 0x7fb01186d700>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:25:45.090449 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 2/4] 10.222.0.26 () {60 vars in 1161 bytes} [Mon Jul 11 11:25:44 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:25:45.145140 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-b6fe6561-aabd-4ba1-8e55-72160e48ae05 tempest-VolumesSnapshotsTestJSON-1025981855 tempest-VolumesSnapshotsTestJSON-1025981855-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/1440b403-4eb0-4933-92ef-27fb12ccea8e" status: 200 len: 286 microversion: 2.1 time: 0.060211 Jul 11 11:25:45.155994 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 3/5] 10.222.0.26 () {58 vars in 1250 bytes} [Mon Jul 11 11:25:45 2022] GET /compute/v2.1/os-snapshots/1440b403-4eb0-4933-92ef-27fb12ccea8e => generated 286 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:25:45.156239 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-8297d74e-7b90-4424-86c0-c8b8b79c532b tempest-VolumesSnapshotsTestJSON-1025981855 tempest-VolumesSnapshotsTestJSON-1025981855-project] Calling method '.version_select at 0x7fb0118b93a0>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:25:45.252829 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-8297d74e-7b90-4424-86c0-c8b8b79c532b tempest-VolumesSnapshotsTestJSON-1025981855 tempest-VolumesSnapshotsTestJSON-1025981855-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.100191 Jul 11 11:25:45.265587 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 3/6] 10.222.0.26 () {58 vars in 1139 bytes} [Mon Jul 11 11:25:45 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:25:45.266828 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-a387a940-27b1-4ae3-b86c-da5c429cf54f tempest-VolumesSnapshotsTestJSON-1025981855 tempest-VolumesSnapshotsTestJSON-1025981855-project] Calling method '.version_select at 0x7fb01186dca0>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:25:45.390079 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-a387a940-27b1-4ae3-b86c-da5c429cf54f tempest-VolumesSnapshotsTestJSON-1025981855 tempest-VolumesSnapshotsTestJSON-1025981855-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/1440b403-4eb0-4933-92ef-27fb12ccea8e" status: 200 len: 286 microversion: 2.1 time: 0.128664 Jul 11 11:25:45.390649 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 4/7] 10.222.0.26 () {58 vars in 1250 bytes} [Mon Jul 11 11:25:45 2022] GET /compute/v2.1/os-snapshots/1440b403-4eb0-4933-92ef-27fb12ccea8e => generated 286 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:25:46.402732 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-fed4f939-711f-42b3-b161-a6f288f9a6f8 tempest-VolumesSnapshotsTestJSON-1025981855 tempest-VolumesSnapshotsTestJSON-1025981855-project] Calling method '.version_select at 0x7fb01187d160>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:25:46.463601 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-fed4f939-711f-42b3-b161-a6f288f9a6f8 tempest-VolumesSnapshotsTestJSON-1025981855 tempest-VolumesSnapshotsTestJSON-1025981855-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/1440b403-4eb0-4933-92ef-27fb12ccea8e" status: 200 len: 286 microversion: 2.1 time: 0.065670 Jul 11 11:25:46.468303 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 4/8] 10.222.0.26 () {58 vars in 1250 bytes} [Mon Jul 11 11:25:46 2022] GET /compute/v2.1/os-snapshots/1440b403-4eb0-4933-92ef-27fb12ccea8e => generated 286 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:25:47.478754 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-8982d259-da7b-4925-8720-891a1970ba3b tempest-VolumesSnapshotsTestJSON-1025981855 tempest-VolumesSnapshotsTestJSON-1025981855-project] Calling method '.version_select at 0x7fb0118833a0>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:25:47.531306 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-8982d259-da7b-4925-8720-891a1970ba3b tempest-VolumesSnapshotsTestJSON-1025981855 tempest-VolumesSnapshotsTestJSON-1025981855-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/1440b403-4eb0-4933-92ef-27fb12ccea8e" status: 200 len: 286 microversion: 2.1 time: 0.057589 Jul 11 11:25:47.532099 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 5/9] 10.222.0.26 () {58 vars in 1250 bytes} [Mon Jul 11 11:25:47 2022] GET /compute/v2.1/os-snapshots/1440b403-4eb0-4933-92ef-27fb12ccea8e => generated 286 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:25:48.545039 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-a62d4197-0d5c-4a76-ba58-25c4a8b5396b tempest-VolumesSnapshotsTestJSON-1025981855 tempest-VolumesSnapshotsTestJSON-1025981855-project] Calling method '.version_select at 0x7fb01187d8b0>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:25:48.614513 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-a62d4197-0d5c-4a76-ba58-25c4a8b5396b tempest-VolumesSnapshotsTestJSON-1025981855 tempest-VolumesSnapshotsTestJSON-1025981855-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/1440b403-4eb0-4933-92ef-27fb12ccea8e" status: 200 len: 287 microversion: 2.1 time: 0.074377 Jul 11 11:25:48.615084 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 5/10] 10.222.0.26 () {58 vars in 1250 bytes} [Mon Jul 11 11:25:48 2022] GET /compute/v2.1/os-snapshots/1440b403-4eb0-4933-92ef-27fb12ccea8e => generated 287 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:25:48.630152 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-a47bc160-c29f-4e0f-be1e-3087c8f8ce4b tempest-VolumesSnapshotsTestJSON-1025981855 tempest-VolumesSnapshotsTestJSON-1025981855-project] Calling method '.version_select at 0x7fb01186dd30>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:25:48.838780 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-a47bc160-c29f-4e0f-be1e-3087c8f8ce4b tempest-VolumesSnapshotsTestJSON-1025981855 tempest-VolumesSnapshotsTestJSON-1025981855-project] 10.222.0.26 "DELETE /compute/v2.1/os-snapshots/1440b403-4eb0-4933-92ef-27fb12ccea8e" status: 202 len: 0 microversion: 2.1 time: 0.213108 Jul 11 11:25:48.841792 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 6/11] 10.222.0.26 () {58 vars in 1253 bytes} [Mon Jul 11 11:25:48 2022] DELETE /compute/v2.1/os-snapshots/1440b403-4eb0-4933-92ef-27fb12ccea8e => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 11:25:48.850501 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-72c72f4d-6804-4ca9-911e-a344b404799f tempest-VolumesSnapshotsTestJSON-1025981855 tempest-VolumesSnapshotsTestJSON-1025981855-project] Calling method '.version_select at 0x7fb0118b9af0>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:25:48.908931 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-72c72f4d-6804-4ca9-911e-a344b404799f tempest-VolumesSnapshotsTestJSON-1025981855 tempest-VolumesSnapshotsTestJSON-1025981855-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/1440b403-4eb0-4933-92ef-27fb12ccea8e" status: 200 len: 286 microversion: 2.1 time: 0.062137 Jul 11 11:25:48.909500 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 6/12] 10.222.0.26 () {58 vars in 1250 bytes} [Mon Jul 11 11:25:48 2022] GET /compute/v2.1/os-snapshots/1440b403-4eb0-4933-92ef-27fb12ccea8e => generated 286 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:25:49.929504 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-cfec5f17-713d-488e-a428-d8b13acdd792 tempest-VolumesSnapshotsTestJSON-1025981855 tempest-VolumesSnapshotsTestJSON-1025981855-project] Calling method '.version_select at 0x7fb01186d670>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:25:50.027708 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.wsgi [None req-cfec5f17-713d-488e-a428-d8b13acdd792 tempest-VolumesSnapshotsTestJSON-1025981855 tempest-VolumesSnapshotsTestJSON-1025981855-project] HTTP exception thrown: Snapshot 1440b403-4eb0-4933-92ef-27fb12ccea8e could not be found. Jul 11 11:25:50.031784 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-cfec5f17-713d-488e-a428-d8b13acdd792 tempest-VolumesSnapshotsTestJSON-1025981855 tempest-VolumesSnapshotsTestJSON-1025981855-project] Request method failure captured: Jul 11 11:25:50.031784 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: request: GET /compute/v2.1/os-snapshots/1440b403-4eb0-4933-92ef-27fb12ccea8e HTTP/1.1 Jul 11 11:25:50.031784 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Accept: application/json Jul 11 11:25:50.031784 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Accept-Encoding: identity Jul 11 11:25:50.031784 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Connection: close Jul 11 11:25:50.031784 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Content-Length: 0 Jul 11 11:25:50.031784 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Content-Type: application/json Jul 11 11:25:50.031784 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Host: 10.222.0.26 Jul 11 11:25:50.031784 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Openstack-System-Scope: None Jul 11 11:25:50.031784 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: User-Agent: python-urllib3/1.26.9 Jul 11 11:25:50.031784 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Auth-Token: gAAAAABizAizftheibbZYpKqviG6hoLdaSc2di9U7Qmd-l4T8zPboTnQF8gMoousf0ZBx8U4GA3ZW-8i1qbPodGjExs9hthoaybJl2ebG74dRiKqnxETm9ewKPYJu-PRqcBXXzAR6jzX-Q9bdRaLtzEjtJjAmzww71e0GNHOLWhbxTk9pm7bh7k Jul 11 11:25:50.031784 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Domain-Id: None Jul 11 11:25:50.031784 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Domain-Name: None Jul 11 11:25:50.031784 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Identity-Status: Confirmed Jul 11 11:25:50.031784 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Is-Admin-Project: True Jul 11 11:25:50.031784 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Domain-Id: default Jul 11 11:25:50.031784 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Domain-Name: Default Jul 11 11:25:50.031784 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Id: 553c41f9111e4be28dbb33b2d6d548bb Jul 11 11:25:50.031784 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1025981855 Jul 11 11:25:50.031784 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Role: member,reader Jul 11 11:25:50.031784 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Roles: member,reader Jul 11 11:25:50.033038 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_553c41f9111e4be28dbb33b2d6d548bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/553c41f9111e4be28dbb33b2d6d548bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/553c41f9111e4be28dbb33b2d6d548bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/553c41f9111e4be28dbb33b2d6d548bb"}]}] Jul 11 11:25:50.033038 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1025981855 Jul 11 11:25:50.033038 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Tenant-Id: 553c41f9111e4be28dbb33b2d6d548bb Jul 11 11:25:50.033038 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1025981855 Jul 11 11:25:50.033038 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User: tempest-VolumesSnapshotsTestJSON-1025981855-project Jul 11 11:25:50.033038 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Domain-Id: default Jul 11 11:25:50.033038 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Domain-Name: Default Jul 11 11:25:50.033038 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Id: c1aec12109d74b929ddc89afb5c75040 Jul 11 11:25:50.033038 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1025981855-project Jul 11 11:25:50.033038 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: method: Jul 11 11:25:50.033038 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: exception: Snapshot 1440b403-4eb0-4933-92ef-27fb12ccea8e could not be found. Jul 11 11:25:50.033038 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: action_args: {'id': '1440b403-4eb0-4933-92ef-27fb12ccea8e'} Jul 11 11:25:50.033038 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 11:25:50.033781 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:25:50.033781 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 11 11:25:50.033781 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 11 11:25:50.033781 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 11 11:25:50.033781 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 11 11:25:50.033781 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 11 11:25:50.033781 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 11 11:25:50.033781 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 11 11:25:50.033781 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 11 11:25:50.033781 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 11 11:25:50.033781 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 11 11:25:50.033781 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 11:25:50.033781 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 11:25:50.033781 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 11:25:50.033781 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 11:25:50.033781 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 1440b403-4eb0-4933-92ef-27fb12ccea8e could not be found. (HTTP 404) (Request-ID: req-a5eb3f18-1c20-403f-b13b-ed6438b889cc) Jul 11 11:25:50.033781 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:25:50.033781 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:25:50.036088 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:25:50.036088 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:25:50.036088 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 11 11:25:50.036088 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 11 11:25:50.036088 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 11 11:25:50.036088 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 11 11:25:50.036088 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 11 11:25:50.036088 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 11 11:25:50.036088 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 11 11:25:50.036088 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 11 11:25:50.036088 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 11 11:25:50.036088 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 11 11:25:50.036088 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 11 11:25:50.036088 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 11 11:25:50.036088 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 11 11:25:50.036088 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 11 11:25:50.036088 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 11 11:25:50.036088 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 11 11:25:50.036088 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 11 11:25:50.037002 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 11 11:25:50.037002 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 11:25:50.037002 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 11:25:50.037002 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 11:25:50.037002 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 11:25:50.037002 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 1440b403-4eb0-4933-92ef-27fb12ccea8e could not be found. Jul 11 11:25:50.037002 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:25:50.037002 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:25:50.037002 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:25:50.037002 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:25:50.037002 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:25:50.037002 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:25:50.037002 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 11:25:50.037002 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 11:25:50.037002 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 11 11:25:50.037002 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 11 11:25:50.037002 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 11:25:50.037002 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 11:25:50.037002 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 11 11:25:50.037002 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 11:25:50.037972 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 1440b403-4eb0-4933-92ef-27fb12ccea8e could not be found. Jul 11 11:25:50.037972 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:25:50.037972 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:25:50.037972 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:25:50.037972 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:25:50.037972 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:25:50.037972 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:25:50.037972 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 11:25:50.037972 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 11:25:50.037972 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 1440b403-4eb0-4933-92ef-27fb12ccea8e could not be found. Jul 11 11:25:50.037972 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:25:50.037972 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-cfec5f17-713d-488e-a428-d8b13acdd792 tempest-VolumesSnapshotsTestJSON-1025981855 tempest-VolumesSnapshotsTestJSON-1025981855-project] Returning 404 to user: Snapshot 1440b403-4eb0-4933-92ef-27fb12ccea8e could not be found. {{(pid=118321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 11:25:50.037972 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-cfec5f17-713d-488e-a428-d8b13acdd792 tempest-VolumesSnapshotsTestJSON-1025981855 tempest-VolumesSnapshotsTestJSON-1025981855-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/1440b403-4eb0-4933-92ef-27fb12ccea8e" status: 404 len: 111 microversion: 2.1 time: 0.109403 Jul 11 11:25:50.050008 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-104acca1-b8a3-4e72-926b-6edba1494876 tempest-VolumesSnapshotsTestJSON-1025981855 tempest-VolumesSnapshotsTestJSON-1025981855-project] Calling method '.version_select at 0x7fb01224f4c0>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:25:50.054077 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 7/13] 10.222.0.26 () {58 vars in 1250 bytes} [Mon Jul 11 11:25:49 2022] GET /compute/v2.1/os-snapshots/1440b403-4eb0-4933-92ef-27fb12ccea8e => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 11:25:50.320541 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-104acca1-b8a3-4e72-926b-6edba1494876 tempest-VolumesSnapshotsTestJSON-1025981855 tempest-VolumesSnapshotsTestJSON-1025981855-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/f700da5b-b835-4c76-bd00-f86c851d74e2" status: 202 len: 0 microversion: 2.1 time: 0.281041 Jul 11 11:25:50.335836 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 7/14] 10.222.0.26 () {58 vars in 1247 bytes} [Mon Jul 11 11:25:50 2022] DELETE /compute/v2.1/os-volumes/f700da5b-b835-4c76-bd00-f86c851d74e2 => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 11:25:50.338152 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-6d64869e-0dfa-457f-917b-516c47bcba7a tempest-VolumesSnapshotsTestJSON-1025981855 tempest-VolumesSnapshotsTestJSON-1025981855-project] Calling method '.version_select at 0x7fb011883e50>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:25:50.430676 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-6d64869e-0dfa-457f-917b-516c47bcba7a tempest-VolumesSnapshotsTestJSON-1025981855 tempest-VolumesSnapshotsTestJSON-1025981855-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/f700da5b-b835-4c76-bd00-f86c851d74e2" status: 200 len: 345 microversion: 2.1 time: 0.101802 Jul 11 11:25:50.431516 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 8/15] 10.222.0.26 () {58 vars in 1244 bytes} [Mon Jul 11 11:25:50 2022] GET /compute/v2.1/os-volumes/f700da5b-b835-4c76-bd00-f86c851d74e2 => generated 345 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:25:51.444156 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-f20268a3-c5a0-4c15-a787-81e5c70699d6 tempest-VolumesSnapshotsTestJSON-1025981855 tempest-VolumesSnapshotsTestJSON-1025981855-project] Calling method '.version_select at 0x7fb01187d940>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:25:51.496858 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.wsgi [None req-f20268a3-c5a0-4c15-a787-81e5c70699d6 tempest-VolumesSnapshotsTestJSON-1025981855 tempest-VolumesSnapshotsTestJSON-1025981855-project] HTTP exception thrown: Volume f700da5b-b835-4c76-bd00-f86c851d74e2 could not be found. Jul 11 11:25:51.501683 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-f20268a3-c5a0-4c15-a787-81e5c70699d6 tempest-VolumesSnapshotsTestJSON-1025981855 tempest-VolumesSnapshotsTestJSON-1025981855-project] Request method failure captured: Jul 11 11:25:51.501683 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: request: GET /compute/v2.1/os-volumes/f700da5b-b835-4c76-bd00-f86c851d74e2 HTTP/1.1 Jul 11 11:25:51.501683 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Accept: application/json Jul 11 11:25:51.501683 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Accept-Encoding: identity Jul 11 11:25:51.501683 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Connection: close Jul 11 11:25:51.501683 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Content-Length: 0 Jul 11 11:25:51.501683 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Content-Type: application/json Jul 11 11:25:51.501683 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Host: 10.222.0.26 Jul 11 11:25:51.501683 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Openstack-System-Scope: None Jul 11 11:25:51.501683 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: User-Agent: python-urllib3/1.26.9 Jul 11 11:25:51.501683 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Auth-Token: gAAAAABizAizftheibbZYpKqviG6hoLdaSc2di9U7Qmd-l4T8zPboTnQF8gMoousf0ZBx8U4GA3ZW-8i1qbPodGjExs9hthoaybJl2ebG74dRiKqnxETm9ewKPYJu-PRqcBXXzAR6jzX-Q9bdRaLtzEjtJjAmzww71e0GNHOLWhbxTk9pm7bh7k Jul 11 11:25:51.501683 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Domain-Id: None Jul 11 11:25:51.501683 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Domain-Name: None Jul 11 11:25:51.501683 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Identity-Status: Confirmed Jul 11 11:25:51.501683 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Is-Admin-Project: True Jul 11 11:25:51.501683 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Domain-Id: default Jul 11 11:25:51.501683 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Domain-Name: Default Jul 11 11:25:51.501683 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Id: 553c41f9111e4be28dbb33b2d6d548bb Jul 11 11:25:51.501683 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1025981855 Jul 11 11:25:51.501683 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Role: member,reader Jul 11 11:25:51.501683 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Roles: member,reader Jul 11 11:25:51.503692 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_553c41f9111e4be28dbb33b2d6d548bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/553c41f9111e4be28dbb33b2d6d548bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/553c41f9111e4be28dbb33b2d6d548bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/553c41f9111e4be28dbb33b2d6d548bb"}]}] Jul 11 11:25:51.503692 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1025981855 Jul 11 11:25:51.503692 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Tenant-Id: 553c41f9111e4be28dbb33b2d6d548bb Jul 11 11:25:51.503692 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1025981855 Jul 11 11:25:51.503692 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User: tempest-VolumesSnapshotsTestJSON-1025981855-project Jul 11 11:25:51.503692 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Domain-Id: default Jul 11 11:25:51.503692 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Domain-Name: Default Jul 11 11:25:51.503692 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Id: c1aec12109d74b929ddc89afb5c75040 Jul 11 11:25:51.503692 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1025981855-project Jul 11 11:25:51.503692 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: method: Jul 11 11:25:51.503692 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: exception: Volume f700da5b-b835-4c76-bd00-f86c851d74e2 could not be found. Jul 11 11:25:51.503692 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: action_args: {'id': 'f700da5b-b835-4c76-bd00-f86c851d74e2'} Jul 11 11:25:51.503692 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 11:25:51.504352 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:25:51.504352 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 11 11:25:51.504352 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 11 11:25:51.504352 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 11 11:25:51.504352 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 11 11:25:51.504352 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 11 11:25:51.504352 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 11 11:25:51.504352 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 11 11:25:51.504352 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 11 11:25:51.504352 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 11 11:25:51.504352 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 11 11:25:51.504352 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 11:25:51.504352 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 11:25:51.504352 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 11:25:51.504352 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 11:25:51.504352 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f700da5b-b835-4c76-bd00-f86c851d74e2 could not be found. (HTTP 404) (Request-ID: req-8bee714c-b102-472b-8fc2-7759e68a1131) Jul 11 11:25:51.504352 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:25:51.504352 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:25:51.504352 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:25:51.505260 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:25:51.505260 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 11 11:25:51.505260 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 11 11:25:51.505260 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 11 11:25:51.505260 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 11 11:25:51.505260 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 11 11:25:51.505260 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 11 11:25:51.505260 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 11 11:25:51.505260 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 11 11:25:51.505260 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 11 11:25:51.505260 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 11 11:25:51.505260 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 11 11:25:51.505260 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 11 11:25:51.505260 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 11 11:25:51.505260 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 11 11:25:51.505260 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 11 11:25:51.505260 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 11 11:25:51.505260 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 11 11:25:51.505260 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 11 11:25:51.506139 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 11:25:51.506139 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 11:25:51.506139 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 11:25:51.506139 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 11:25:51.506139 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f700da5b-b835-4c76-bd00-f86c851d74e2 could not be found. Jul 11 11:25:51.506139 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:25:51.506139 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:25:51.506139 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:25:51.506139 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:25:51.506139 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:25:51.506139 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:25:51.506139 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 11:25:51.506139 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 11:25:51.506139 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 11 11:25:51.506139 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 11 11:25:51.506139 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 11:25:51.506139 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 11:25:51.506139 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 11 11:25:51.506139 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 11:25:51.507057 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f700da5b-b835-4c76-bd00-f86c851d74e2 could not be found. Jul 11 11:25:51.507057 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:25:51.507057 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:25:51.507057 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:25:51.507057 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:25:51.507057 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:25:51.507057 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:25:51.507057 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 11:25:51.507057 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 11:25:51.507057 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f700da5b-b835-4c76-bd00-f86c851d74e2 could not be found. Jul 11 11:25:51.507057 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:25:51.507057 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-f20268a3-c5a0-4c15-a787-81e5c70699d6 tempest-VolumesSnapshotsTestJSON-1025981855 tempest-VolumesSnapshotsTestJSON-1025981855-project] Returning 404 to user: Volume f700da5b-b835-4c76-bd00-f86c851d74e2 could not be found. {{(pid=118322) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 11:25:51.507057 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-f20268a3-c5a0-4c15-a787-81e5c70699d6 tempest-VolumesSnapshotsTestJSON-1025981855 tempest-VolumesSnapshotsTestJSON-1025981855-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/f700da5b-b835-4c76-bd00-f86c851d74e2" status: 404 len: 109 microversion: 2.1 time: 0.065553 Jul 11 11:25:51.514240 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 8/16] 10.222.0.26 () {58 vars in 1244 bytes} [Mon Jul 11 11:25:51 2022] GET /compute/v2.1/os-volumes/f700da5b-b835-4c76-bd00-f86c851d74e2 => generated 109 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 11:25:51.516524 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-8a2200a1-9621-4cd3-9fb2-8bc596549dc7 tempest-VolumesSnapshotsTestJSON-1025981855 tempest-VolumesSnapshotsTestJSON-1025981855-project] Calling method '.version_select at 0x7fb0117e8550>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:25:51.571831 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.wsgi [None req-8a2200a1-9621-4cd3-9fb2-8bc596549dc7 tempest-VolumesSnapshotsTestJSON-1025981855 tempest-VolumesSnapshotsTestJSON-1025981855-project] HTTP exception thrown: Volume f700da5b-b835-4c76-bd00-f86c851d74e2 could not be found. Jul 11 11:25:51.575432 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-8a2200a1-9621-4cd3-9fb2-8bc596549dc7 tempest-VolumesSnapshotsTestJSON-1025981855 tempest-VolumesSnapshotsTestJSON-1025981855-project] Request method failure captured: Jul 11 11:25:51.575432 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: request: DELETE /compute/v2.1/os-volumes/f700da5b-b835-4c76-bd00-f86c851d74e2 HTTP/1.1 Jul 11 11:25:51.575432 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Accept: application/json Jul 11 11:25:51.575432 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Accept-Encoding: identity Jul 11 11:25:51.575432 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Connection: close Jul 11 11:25:51.575432 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Content-Length: 0 Jul 11 11:25:51.575432 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Content-Type: application/json Jul 11 11:25:51.575432 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Host: 10.222.0.26 Jul 11 11:25:51.575432 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Openstack-System-Scope: None Jul 11 11:25:51.575432 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: User-Agent: python-urllib3/1.26.9 Jul 11 11:25:51.575432 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Auth-Token: gAAAAABizAizftheibbZYpKqviG6hoLdaSc2di9U7Qmd-l4T8zPboTnQF8gMoousf0ZBx8U4GA3ZW-8i1qbPodGjExs9hthoaybJl2ebG74dRiKqnxETm9ewKPYJu-PRqcBXXzAR6jzX-Q9bdRaLtzEjtJjAmzww71e0GNHOLWhbxTk9pm7bh7k Jul 11 11:25:51.575432 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Domain-Id: None Jul 11 11:25:51.575432 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Domain-Name: None Jul 11 11:25:51.575432 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Identity-Status: Confirmed Jul 11 11:25:51.575432 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Is-Admin-Project: True Jul 11 11:25:51.575432 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Domain-Id: default Jul 11 11:25:51.575432 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Domain-Name: Default Jul 11 11:25:51.575432 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Id: 553c41f9111e4be28dbb33b2d6d548bb Jul 11 11:25:51.575432 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1025981855 Jul 11 11:25:51.575432 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Role: member,reader Jul 11 11:25:51.575432 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Roles: member,reader Jul 11 11:25:51.576586 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_553c41f9111e4be28dbb33b2d6d548bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/553c41f9111e4be28dbb33b2d6d548bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/553c41f9111e4be28dbb33b2d6d548bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/553c41f9111e4be28dbb33b2d6d548bb"}]}] Jul 11 11:25:51.576586 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1025981855 Jul 11 11:25:51.576586 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Tenant-Id: 553c41f9111e4be28dbb33b2d6d548bb Jul 11 11:25:51.576586 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1025981855 Jul 11 11:25:51.576586 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User: tempest-VolumesSnapshotsTestJSON-1025981855-project Jul 11 11:25:51.576586 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Domain-Id: default Jul 11 11:25:51.576586 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Domain-Name: Default Jul 11 11:25:51.576586 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Id: c1aec12109d74b929ddc89afb5c75040 Jul 11 11:25:51.576586 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1025981855-project Jul 11 11:25:51.576586 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: method: Jul 11 11:25:51.576586 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: exception: Volume f700da5b-b835-4c76-bd00-f86c851d74e2 could not be found. Jul 11 11:25:51.576586 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: action_args: {'id': 'f700da5b-b835-4c76-bd00-f86c851d74e2'} Jul 11 11:25:51.576586 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 11:25:51.577251 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:25:51.577251 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 11 11:25:51.577251 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 11 11:25:51.577251 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 11 11:25:51.577251 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 11 11:25:51.577251 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 11 11:25:51.577251 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 11 11:25:51.577251 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 11 11:25:51.577251 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 11 11:25:51.577251 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 11 11:25:51.577251 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 11 11:25:51.577251 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 11:25:51.577251 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 11:25:51.577251 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 11:25:51.577251 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 11:25:51.577251 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f700da5b-b835-4c76-bd00-f86c851d74e2 could not be found. (HTTP 404) (Request-ID: req-01f3421f-a8d0-47f6-a474-d28f6db07a42) Jul 11 11:25:51.577251 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:25:51.577251 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:25:51.577251 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:25:51.578183 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:25:51.578183 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 11 11:25:51.578183 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 11 11:25:51.578183 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 11 11:25:51.578183 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 11 11:25:51.578183 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 11 11:25:51.578183 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 11 11:25:51.578183 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 11 11:25:51.578183 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 11 11:25:51.578183 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 11 11:25:51.578183 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 11 11:25:51.578183 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 11 11:25:51.578183 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 11 11:25:51.578183 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 11 11:25:51.578183 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 11 11:25:51.578183 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 11 11:25:51.578183 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 11 11:25:51.578183 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 11 11:25:51.578183 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 11 11:25:51.579105 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 11:25:51.579105 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 11:25:51.579105 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 11:25:51.579105 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 11:25:51.579105 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f700da5b-b835-4c76-bd00-f86c851d74e2 could not be found. Jul 11 11:25:51.579105 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:25:51.579105 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:25:51.579105 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:25:51.579105 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:25:51.579105 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:25:51.579105 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:25:51.579105 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 11:25:51.579105 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 11:25:51.579105 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 11 11:25:51.579105 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 11 11:25:51.579105 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 11:25:51.579105 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 11:25:51.579105 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 11 11:25:51.579105 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 11:25:51.584084 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f700da5b-b835-4c76-bd00-f86c851d74e2 could not be found. Jul 11 11:25:51.584084 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:25:51.584084 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:25:51.584084 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:25:51.584084 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:25:51.584084 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:25:51.584084 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:25:51.584084 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 11:25:51.584084 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 11:25:51.584084 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f700da5b-b835-4c76-bd00-f86c851d74e2 could not be found. Jul 11 11:25:51.584084 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:25:51.584084 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-8a2200a1-9621-4cd3-9fb2-8bc596549dc7 tempest-VolumesSnapshotsTestJSON-1025981855 tempest-VolumesSnapshotsTestJSON-1025981855-project] Returning 404 to user: Volume f700da5b-b835-4c76-bd00-f86c851d74e2 could not be found. {{(pid=118321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 11:25:51.584084 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-8a2200a1-9621-4cd3-9fb2-8bc596549dc7 tempest-VolumesSnapshotsTestJSON-1025981855 tempest-VolumesSnapshotsTestJSON-1025981855-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/f700da5b-b835-4c76-bd00-f86c851d74e2" status: 404 len: 109 microversion: 2.1 time: 0.065675 Jul 11 11:25:51.584084 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 9/17] 10.222.0.26 () {58 vars in 1247 bytes} [Mon Jul 11 11:25:51 2022] DELETE /compute/v2.1/os-volumes/f700da5b-b835-4c76-bd00-f86c851d74e2 => generated 109 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 11:25:51.592290 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-23c64633-30a0-42b4-9b80-1934ba80e36f tempest-VolumesSnapshotsTestJSON-1025981855 tempest-VolumesSnapshotsTestJSON-1025981855-project] Calling method '.version_select at 0x7fb01187ddc0>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:25:51.644679 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.wsgi [None req-23c64633-30a0-42b4-9b80-1934ba80e36f tempest-VolumesSnapshotsTestJSON-1025981855 tempest-VolumesSnapshotsTestJSON-1025981855-project] HTTP exception thrown: Volume f700da5b-b835-4c76-bd00-f86c851d74e2 could not be found. Jul 11 11:25:51.648409 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-23c64633-30a0-42b4-9b80-1934ba80e36f tempest-VolumesSnapshotsTestJSON-1025981855 tempest-VolumesSnapshotsTestJSON-1025981855-project] Request method failure captured: Jul 11 11:25:51.648409 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: request: GET /compute/v2.1/os-volumes/f700da5b-b835-4c76-bd00-f86c851d74e2 HTTP/1.1 Jul 11 11:25:51.648409 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Accept: application/json Jul 11 11:25:51.648409 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Accept-Encoding: identity Jul 11 11:25:51.648409 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Connection: close Jul 11 11:25:51.648409 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Content-Length: 0 Jul 11 11:25:51.648409 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Content-Type: application/json Jul 11 11:25:51.648409 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Host: 10.222.0.26 Jul 11 11:25:51.648409 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Openstack-System-Scope: None Jul 11 11:25:51.648409 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: User-Agent: python-urllib3/1.26.9 Jul 11 11:25:51.648409 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Auth-Token: gAAAAABizAizftheibbZYpKqviG6hoLdaSc2di9U7Qmd-l4T8zPboTnQF8gMoousf0ZBx8U4GA3ZW-8i1qbPodGjExs9hthoaybJl2ebG74dRiKqnxETm9ewKPYJu-PRqcBXXzAR6jzX-Q9bdRaLtzEjtJjAmzww71e0GNHOLWhbxTk9pm7bh7k Jul 11 11:25:51.648409 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Domain-Id: None Jul 11 11:25:51.648409 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Domain-Name: None Jul 11 11:25:51.648409 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Identity-Status: Confirmed Jul 11 11:25:51.648409 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Is-Admin-Project: True Jul 11 11:25:51.648409 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Domain-Id: default Jul 11 11:25:51.648409 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Domain-Name: Default Jul 11 11:25:51.648409 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Id: 553c41f9111e4be28dbb33b2d6d548bb Jul 11 11:25:51.648409 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1025981855 Jul 11 11:25:51.648409 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Role: member,reader Jul 11 11:25:51.648409 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Roles: member,reader Jul 11 11:25:51.649745 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_553c41f9111e4be28dbb33b2d6d548bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/553c41f9111e4be28dbb33b2d6d548bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/553c41f9111e4be28dbb33b2d6d548bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/553c41f9111e4be28dbb33b2d6d548bb"}]}] Jul 11 11:25:51.649745 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1025981855 Jul 11 11:25:51.649745 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Tenant-Id: 553c41f9111e4be28dbb33b2d6d548bb Jul 11 11:25:51.649745 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1025981855 Jul 11 11:25:51.649745 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User: tempest-VolumesSnapshotsTestJSON-1025981855-project Jul 11 11:25:51.649745 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Domain-Id: default Jul 11 11:25:51.649745 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Domain-Name: Default Jul 11 11:25:51.649745 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Id: c1aec12109d74b929ddc89afb5c75040 Jul 11 11:25:51.649745 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1025981855-project Jul 11 11:25:51.649745 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: method: Jul 11 11:25:51.649745 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: exception: Volume f700da5b-b835-4c76-bd00-f86c851d74e2 could not be found. Jul 11 11:25:51.649745 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: action_args: {'id': 'f700da5b-b835-4c76-bd00-f86c851d74e2'} Jul 11 11:25:51.649745 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 11:25:51.650495 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:25:51.650495 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 11 11:25:51.650495 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 11 11:25:51.650495 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 11 11:25:51.650495 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 11 11:25:51.650495 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 11 11:25:51.650495 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 11 11:25:51.650495 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 11 11:25:51.650495 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 11 11:25:51.650495 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 11 11:25:51.650495 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 11 11:25:51.650495 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 11:25:51.650495 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 11:25:51.650495 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 11:25:51.650495 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 11:25:51.650495 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f700da5b-b835-4c76-bd00-f86c851d74e2 could not be found. (HTTP 404) (Request-ID: req-f5a374dd-b427-41e0-87eb-c9e7c8e59df1) Jul 11 11:25:51.650495 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:25:51.650495 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:25:51.650495 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:25:51.652220 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:25:51.652220 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 11 11:25:51.652220 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 11 11:25:51.652220 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 11 11:25:51.652220 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 11 11:25:51.652220 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 11 11:25:51.652220 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 11 11:25:51.652220 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 11 11:25:51.652220 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 11 11:25:51.652220 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 11 11:25:51.652220 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 11 11:25:51.652220 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 11 11:25:51.652220 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 11 11:25:51.652220 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 11 11:25:51.652220 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 11 11:25:51.652220 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 11 11:25:51.652220 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 11 11:25:51.652220 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 11 11:25:51.652220 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 11 11:25:51.653553 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 11:25:51.653553 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 11:25:51.653553 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 11:25:51.653553 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 11:25:51.653553 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f700da5b-b835-4c76-bd00-f86c851d74e2 could not be found. Jul 11 11:25:51.653553 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:25:51.653553 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:25:51.653553 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:25:51.653553 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:25:51.653553 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:25:51.653553 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:25:51.653553 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 11:25:51.653553 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 11:25:51.653553 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 11 11:25:51.653553 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 11 11:25:51.653553 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 11:25:51.653553 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 11:25:51.653553 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 11 11:25:51.653553 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 11:25:51.655032 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f700da5b-b835-4c76-bd00-f86c851d74e2 could not be found. Jul 11 11:25:51.655032 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:25:51.655032 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:25:51.655032 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:25:51.655032 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:25:51.655032 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:25:51.655032 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:25:51.655032 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 11:25:51.655032 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 11:25:51.655032 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f700da5b-b835-4c76-bd00-f86c851d74e2 could not be found. Jul 11 11:25:51.655032 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:25:51.655032 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-23c64633-30a0-42b4-9b80-1934ba80e36f tempest-VolumesSnapshotsTestJSON-1025981855 tempest-VolumesSnapshotsTestJSON-1025981855-project] Returning 404 to user: Volume f700da5b-b835-4c76-bd00-f86c851d74e2 could not be found. {{(pid=118322) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 11:25:51.655032 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-23c64633-30a0-42b4-9b80-1934ba80e36f tempest-VolumesSnapshotsTestJSON-1025981855 tempest-VolumesSnapshotsTestJSON-1025981855-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/f700da5b-b835-4c76-bd00-f86c851d74e2" status: 404 len: 109 microversion: 2.1 time: 0.062543 Jul 11 11:25:51.655032 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 9/18] 10.222.0.26 () {58 vars in 1244 bytes} [Mon Jul 11 11:25:51 2022] GET /compute/v2.1/os-volumes/f700da5b-b835-4c76-bd00-f86c851d74e2 => generated 109 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 11:25:53.588877 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-2ed25919-0758-4944-850b-41ef88cc232d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-454561405", "imageRef": "1bb93fc1-b713-4e67-8f76-bfec3a96168b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:25:53.774279 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.network.neutron [None req-2ed25919-0758-4944-850b-41ef88cc232d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] validate_networks() for [('ff421ce3-5a34-44ce-8897-a19d2373f4d2', None, None, None, None, None)] {{(pid=118321) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 11:25:57.883200 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.virt.hardware [None req-2ed25919-0758-4944-850b-41ef88cc232d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Flavor limits 0:0:0 {{(pid=118321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 11:25:57.883942 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.virt.hardware [None req-2ed25919-0758-4944-850b-41ef88cc232d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Image limits 0:0:0 {{(pid=118321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 11:25:57.884109 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.virt.hardware [None req-2ed25919-0758-4944-850b-41ef88cc232d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Flavor pref 0:0:0 {{(pid=118321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 11:25:57.884519 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.virt.hardware [None req-2ed25919-0758-4944-850b-41ef88cc232d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Image pref 0:0:0 {{(pid=118321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 11:25:57.885018 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.virt.hardware [None req-2ed25919-0758-4944-850b-41ef88cc232d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 11:25:57.919625 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2ed25919-0758-4944-850b-41ef88cc232d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:25:57.920078 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2ed25919-0758-4944-850b-41ef88cc232d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:25:57.920869 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2ed25919-0758-4944-850b-41ef88cc232d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:25:57.921485 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2ed25919-0758-4944-850b-41ef88cc232d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:25:58.044528 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.quota [None req-2ed25919-0758-4944-850b-41ef88cc232d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Getting quotas for project c8639f8c836d4ad79d147b855d9017f8. Resources: {'cores', 'ram', 'instances'} {{(pid=118321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 11:25:58.056126 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.quota [None req-2ed25919-0758-4944-850b-41ef88cc232d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Getting quotas for user e47c365946cf4264a2d2205ace04379d and project c8639f8c836d4ad79d147b855d9017f8. Resources: {'cores', 'ram', 'instances'} {{(pid=118321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 11:25:58.101485 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-2ed25919-0758-4944-850b-41ef88cc232d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Going to run 1 instances... {{(pid=118321) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 11:25:58.106639 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-2ed25919-0758-4944-850b-41ef88cc232d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: b39fbe8d-e6a4-4482-981f-ac21c2b52176] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb93fc1-b713-4e67-8f76-bfec3a96168b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118321) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 11:25:58.358219 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-2ed25919-0758-4944-850b-41ef88cc232d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.078324 Jul 11 11:25:58.358871 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 10/19] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jul 11 11:25:53 2022] POST /compute/v2.1/servers => generated 383 bytes in 5080 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 11 11:25:58.369815 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-dc129d66-42c8-4793-833a-1bb8fc8d9898 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:25:58.370427 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-dc129d66-42c8-4793-833a-1bb8fc8d9898 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: b39fbe8d-e6a4-4482-981f-ac21c2b52176] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:25:58.721095 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-525e1a6e-abeb-4abf-b5fa-962a6449a21d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Action: 'create', calling method: .version_select at 0x7fb0118b9f70>, body: {"keypair": {"name": "tempest-keypair-1662356650", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBERYvmmh6iEFjt5iG2QyvWHIBOlXAT10rylRIwxVdHx/xP+EFgW5f6wHSG8A3DPTPXkxyJS+jcZUoywRGRiTeabWu+WYg18L5OD0Q3OZ+R7Zd2ALaadGg/6f2Q6OZd9Y3w=="}} {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:25:58.792182 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-dc129d66-42c8-4793-833a-1bb8fc8d9898 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:25:58.818503 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-dc129d66-42c8-4793-833a-1bb8fc8d9898 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/b39fbe8d-e6a4-4482-981f-ac21c2b52176" status: 200 len: 1221 microversion: 2.1 time: 0.452451 Jul 11 11:25:58.819910 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 11/20] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:25:58 2022] GET /compute/v2.1/servers/b39fbe8d-e6a4-4482-981f-ac21c2b52176 => generated 1221 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:25:58.853541 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.quota [None req-525e1a6e-abeb-4abf-b5fa-962a6449a21d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Getting quotas for project 876864a8f283481a81ee65a1c97d0f4f. Resources: {'key_pairs'} {{(pid=118322) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 11:25:58.867451 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.quota [None req-525e1a6e-abeb-4abf-b5fa-962a6449a21d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Getting quotas for user 993a59e8746948ab8a0f11d877314e02 and project 876864a8f283481a81ee65a1c97d0f4f. Resources: {'key_pairs'} {{(pid=118322) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 11:25:59.061806 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-525e1a6e-abeb-4abf-b5fa-962a6449a21d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.766749 Jul 11 11:25:59.063737 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 10/21] 10.222.0.26 () {62 vars in 1199 bytes} [Mon Jul 11 11:25:58 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 769 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 11 11:25:59.189622 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-b86f6dd3-f001-410a-9eaa-212729edd667 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-471592137", "imageRef": "1bb93fc1-b713-4e67-8f76-bfec3a96168b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:25:59.371809 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.network.neutron [None req-b86f6dd3-f001-410a-9eaa-212729edd667 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] validate_networks() for [('ff421ce3-5a34-44ce-8897-a19d2373f4d2', None, None, None, None, None)] {{(pid=118322) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 11:25:59.519370 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-314bbdf3-bee2-4b1e-8524-9e381425ddb9 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1839479563", "imageRef": "1bb93fc1-b713-4e67-8f76-bfec3a96168b", "flavorRef": "452", "networks": [{"uuid": "fa0b6b8e-0fd2-47de-97f4-2dad2b955ce6"}]}} {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:25:59.674359 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.network.neutron [None req-314bbdf3-bee2-4b1e-8524-9e381425ddb9 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] validate_networks() for [('fa0b6b8e-0fd2-47de-97f4-2dad2b955ce6', None, None, None, None, None)] {{(pid=118321) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 11:26:01.552656 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.virt.hardware [None req-b86f6dd3-f001-410a-9eaa-212729edd667 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Flavor limits 0:0:0 {{(pid=118322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 11:26:01.554047 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.virt.hardware [None req-b86f6dd3-f001-410a-9eaa-212729edd667 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Image limits 0:0:0 {{(pid=118322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 11:26:01.554765 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.virt.hardware [None req-b86f6dd3-f001-410a-9eaa-212729edd667 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Flavor pref 0:0:0 {{(pid=118322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 11:26:01.555459 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.virt.hardware [None req-b86f6dd3-f001-410a-9eaa-212729edd667 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Image pref 0:0:0 {{(pid=118322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 11:26:01.556388 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.virt.hardware [None req-b86f6dd3-f001-410a-9eaa-212729edd667 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 11:26:01.569956 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b86f6dd3-f001-410a-9eaa-212729edd667 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:01.570610 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b86f6dd3-f001-410a-9eaa-212729edd667 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:01.571778 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b86f6dd3-f001-410a-9eaa-212729edd667 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:01.572213 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b86f6dd3-f001-410a-9eaa-212729edd667 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:01.618285 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.quota [None req-b86f6dd3-f001-410a-9eaa-212729edd667 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Getting quotas for project c8639f8c836d4ad79d147b855d9017f8. Resources: {'cores', 'ram', 'instances'} {{(pid=118322) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 11:26:01.626907 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.quota [None req-b86f6dd3-f001-410a-9eaa-212729edd667 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Getting quotas for user e47c365946cf4264a2d2205ace04379d and project c8639f8c836d4ad79d147b855d9017f8. Resources: {'cores', 'ram', 'instances'} {{(pid=118322) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 11:26:01.641522 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-b86f6dd3-f001-410a-9eaa-212729edd667 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Going to run 1 instances... {{(pid=118322) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 11:26:01.645245 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-b86f6dd3-f001-410a-9eaa-212729edd667 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 1df1a34e-6645-4776-ac7a-a03a47edeebe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb93fc1-b713-4e67-8f76-bfec3a96168b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118322) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 11:26:01.882288 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-b86f6dd3-f001-410a-9eaa-212729edd667 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.697833 Jul 11 11:26:01.884539 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 11/22] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jul 11 11:25:59 2022] POST /compute/v2.1/servers => generated 383 bytes in 2701 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 11 11:26:01.898569 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-0144f586-9843-44cd-9725-c3a0ebc3922f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:01.899468 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-0144f586-9843-44cd-9725-c3a0ebc3922f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 1df1a34e-6645-4776-ac7a-a03a47edeebe] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:02.211073 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-0144f586-9843-44cd-9725-c3a0ebc3922f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:02.252624 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-0144f586-9843-44cd-9725-c3a0ebc3922f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe" status: 200 len: 1221 microversion: 2.1 time: 0.359668 Jul 11 11:26:02.255978 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 12/23] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:01 2022] GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe => generated 1221 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:26:02.370410 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.virt.hardware [None req-314bbdf3-bee2-4b1e-8524-9e381425ddb9 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Flavor limits 0:0:0 {{(pid=118321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 11:26:02.371121 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.virt.hardware [None req-314bbdf3-bee2-4b1e-8524-9e381425ddb9 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Image limits 0:0:0 {{(pid=118321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 11:26:02.372306 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.virt.hardware [None req-314bbdf3-bee2-4b1e-8524-9e381425ddb9 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Flavor pref 0:0:0 {{(pid=118321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 11:26:02.372584 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.virt.hardware [None req-314bbdf3-bee2-4b1e-8524-9e381425ddb9 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Image pref 0:0:0 {{(pid=118321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 11:26:02.373199 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.virt.hardware [None req-314bbdf3-bee2-4b1e-8524-9e381425ddb9 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 11:26:02.391470 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-314bbdf3-bee2-4b1e-8524-9e381425ddb9 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:02.392146 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-314bbdf3-bee2-4b1e-8524-9e381425ddb9 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:02.394591 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-314bbdf3-bee2-4b1e-8524-9e381425ddb9 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:02.395721 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-314bbdf3-bee2-4b1e-8524-9e381425ddb9 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:02.437720 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.quota [None req-314bbdf3-bee2-4b1e-8524-9e381425ddb9 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Getting quotas for project 877612289735450ea6bd527ebe7b81f3. Resources: {'cores', 'ram', 'instances'} {{(pid=118321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 11:26:02.449620 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.quota [None req-314bbdf3-bee2-4b1e-8524-9e381425ddb9 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Getting quotas for user 5f9ae0e6a2534bb0b5d5e9327b01b238 and project 877612289735450ea6bd527ebe7b81f3. Resources: {'cores', 'ram', 'instances'} {{(pid=118321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 11:26:02.479102 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-314bbdf3-bee2-4b1e-8524-9e381425ddb9 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Going to run 1 instances... {{(pid=118321) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 11:26:02.489018 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-314bbdf3-bee2-4b1e-8524-9e381425ddb9 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] [instance: f9e44714-3285-489f-91df-091b85f4c56b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb93fc1-b713-4e67-8f76-bfec3a96168b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118321) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 11:26:02.661729 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-b3164c88-8d76-4924-bf72-3b5ab7ce7cb3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Action: 'create', calling method: .version_select at 0x7fb010ec5b80>, body: {"keypair": {"name": "tempest-keypair-1812882260", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSTjFfEStHphf0hRPMlnCNnG2mzomSiLJxNlOFfhNactFtIYZX081QrGpBmU6ks7efoPDaa8w1Of27IFYIaU+uvtnhT+y96YLCjKooOkikVyHXmWCzzYWuzfBspLnGgfw=="}} {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:26:02.740328 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.quota [None req-b3164c88-8d76-4924-bf72-3b5ab7ce7cb3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Getting quotas for project 1328a510264f4374baabad7b5243d8c2. Resources: {'key_pairs'} {{(pid=118322) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 11:26:02.753042 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-314bbdf3-bee2-4b1e-8524-9e381425ddb9 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.928075 Jul 11 11:26:02.758972 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 12/24] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jul 11 11:25:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 3937 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 11 11:26:02.762484 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.quota [None req-b3164c88-8d76-4924-bf72-3b5ab7ce7cb3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Getting quotas for user cbcc15c786fb43669ac34a4897735c1d and project 1328a510264f4374baabad7b5243d8c2. Resources: {'key_pairs'} {{(pid=118322) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 11:26:02.783832 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-34a54219-4424-4c6e-8f53-e15bd248f99c tempest-VolumesTestJSON-2003356164 tempest-VolumesTestJSON-2003356164-project] Calling method '.version_select at 0x7fb01069fe50>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:02.902356 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-b3164c88-8d76-4924-bf72-3b5ab7ce7cb3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.643110 Jul 11 11:26:02.903562 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 13/25] 10.222.0.26 () {60 vars in 1158 bytes} [Mon Jul 11 11:26:02 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:26:02.911108 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-8c7c2fb1-cf86-41f0-86b4-714bdab68708 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:02.911108 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-8c7c2fb1-cf86-41f0-86b4-714bdab68708 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] [instance: f9e44714-3285-489f-91df-091b85f4c56b] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:02.915071 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-34a54219-4424-4c6e-8f53-e15bd248f99c tempest-VolumesTestJSON-2003356164 tempest-VolumesTestJSON-2003356164-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/13619281-4517-4fae-b3b4-08abda06abfa" status: 200 len: 350 microversion: 2.1 time: 0.154761 Jul 11 11:26:02.915934 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 13/26] 10.222.0.26 () {58 vars in 1244 bytes} [Mon Jul 11 11:26:02 2022] GET /compute/v2.1/os-volumes/13619281-4517-4fae-b3b4-08abda06abfa => generated 350 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:26:03.162766 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-8c7c2fb1-cf86-41f0-86b4-714bdab68708 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9ae0e6a2534bb0b5d5e9327b01b238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '877612289735450ea6bd527ebe7b81f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:03.170399 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-8c7c2fb1-cf86-41f0-86b4-714bdab68708 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] 10.222.0.26 "GET /compute/v2.1/servers/f9e44714-3285-489f-91df-091b85f4c56b" status: 200 len: 1215 microversion: 2.1 time: 0.265612 Jul 11 11:26:03.177733 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 14/27] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:02 2022] GET /compute/v2.1/servers/f9e44714-3285-489f-91df-091b85f4c56b => generated 1215 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:26:03.273162 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-89f17f15-843a-402d-a602-0e7aa0af18dc tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:03.274622 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-89f17f15-843a-402d-a602-0e7aa0af18dc tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 1df1a34e-6645-4776-ac7a-a03a47edeebe] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:03.602165 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-89f17f15-843a-402d-a602-0e7aa0af18dc tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:03.624424 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-89f17f15-843a-402d-a602-0e7aa0af18dc tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe" status: 200 len: 1221 microversion: 2.1 time: 0.355457 Jul 11 11:26:03.628269 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 14/28] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:03 2022] GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe => generated 1221 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:26:04.194707 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-6bb27bae-d4af-4e50-b34a-42420d9d960f tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:04.195371 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-6bb27bae-d4af-4e50-b34a-42420d9d960f tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] [instance: f9e44714-3285-489f-91df-091b85f4c56b] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:04.469585 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-6bb27bae-d4af-4e50-b34a-42420d9d960f tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9ae0e6a2534bb0b5d5e9327b01b238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '877612289735450ea6bd527ebe7b81f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:04.477665 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-6bb27bae-d4af-4e50-b34a-42420d9d960f tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] 10.222.0.26 "GET /compute/v2.1/servers/f9e44714-3285-489f-91df-091b85f4c56b" status: 200 len: 1215 microversion: 2.1 time: 0.287225 Jul 11 11:26:04.490641 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 15/29] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:04 2022] GET /compute/v2.1/servers/f9e44714-3285-489f-91df-091b85f4c56b => generated 1215 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:26:04.508235 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-bf1e8f69-0a36-4bfc-afef-af88cfcf2483 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Action: 'create', calling method: .version_select at 0x7fb010ecadc0>, body: {"keypair": {"name": "tempest-keypair-848852803", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBKKvcAsY5eKmFf6WI1W8zMOskygxIB3MvtQ2kpAm0zDB5C2bShwAzCGQQYS7HOpoN8fF8sXPOSpt2brE8DQvmn+uYHxRtDed9D2SLOgsSciSoVTyeb2opKokGpGR4E6Tg=="}} {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:26:04.551866 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.quota [None req-bf1e8f69-0a36-4bfc-afef-af88cfcf2483 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Getting quotas for project 5779b0ffa2244901a92adbee65b10421. Resources: {'key_pairs'} {{(pid=118322) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 11:26:04.564110 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.quota [None req-bf1e8f69-0a36-4bfc-afef-af88cfcf2483 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Getting quotas for user 15ff2cacb5c1450482597a2f5fa3c8a9 and project 5779b0ffa2244901a92adbee65b10421. Resources: {'key_pairs'} {{(pid=118322) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 11:26:04.641614 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-01a56b7e-a0ca-46d6-b2a8-53c6c1802cd7 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:04.643492 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-01a56b7e-a0ca-46d6-b2a8-53c6c1802cd7 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 1df1a34e-6645-4776-ac7a-a03a47edeebe] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:04.655682 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-01a56b7e-a0ca-46d6-b2a8-53c6c1802cd7 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:04.658520 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-01a56b7e-a0ca-46d6-b2a8-53c6c1802cd7 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:04.665221 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-01a56b7e-a0ca-46d6-b2a8-53c6c1802cd7 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:04.668932 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-01a56b7e-a0ca-46d6-b2a8-53c6c1802cd7 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:04.750689 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-bf1e8f69-0a36-4bfc-afef-af88cfcf2483 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.791265 Jul 11 11:26:04.751323 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 15/30] 10.222.0.26 () {60 vars in 1158 bytes} [Mon Jul 11 11:26:03 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:26:05.266956 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-01a56b7e-a0ca-46d6-b2a8-53c6c1802cd7 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:05.299603 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-01a56b7e-a0ca-46d6-b2a8-53c6c1802cd7 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe" status: 200 len: 1225 microversion: 2.1 time: 0.657645 Jul 11 11:26:05.302730 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 16/31] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:04 2022] GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe => generated 1225 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:26:05.519993 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-1cf6e786-0e55-4dfe-bb3d-29cce2ab66de tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:05.522196 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-1cf6e786-0e55-4dfe-bb3d-29cce2ab66de tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] [instance: f9e44714-3285-489f-91df-091b85f4c56b] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:05.560297 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1cf6e786-0e55-4dfe-bb3d-29cce2ab66de tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:05.571665 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1cf6e786-0e55-4dfe-bb3d-29cce2ab66de tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:05.575995 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1cf6e786-0e55-4dfe-bb3d-29cce2ab66de tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:05.584228 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1cf6e786-0e55-4dfe-bb3d-29cce2ab66de tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:05.802781 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-e4d2f93f-db04-4d10-8973-a3c4e720272d tempest-VolumesTestJSON-2003356164 tempest-VolumesTestJSON-2003356164-project] Calling method '.version_select at 0x7fb01061fb80>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:05.978430 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-e4d2f93f-db04-4d10-8973-a3c4e720272d tempest-VolumesTestJSON-2003356164 tempest-VolumesTestJSON-2003356164-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/49072fee-eff4-4ad2-aea4-63ba7d938c01" status: 200 len: 351 microversion: 2.1 time: 0.180418 Jul 11 11:26:05.979775 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 17/32] 10.222.0.26 () {58 vars in 1244 bytes} [Mon Jul 11 11:26:05 2022] GET /compute/v2.1/os-volumes/49072fee-eff4-4ad2-aea4-63ba7d938c01 => generated 351 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:26:06.089701 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-1cf6e786-0e55-4dfe-bb3d-29cce2ab66de tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9ae0e6a2534bb0b5d5e9327b01b238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '877612289735450ea6bd527ebe7b81f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:06.119936 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-1cf6e786-0e55-4dfe-bb3d-29cce2ab66de tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] 10.222.0.26 "GET /compute/v2.1/servers/f9e44714-3285-489f-91df-091b85f4c56b" status: 200 len: 1211 microversion: 2.1 time: 0.628565 Jul 11 11:26:06.125760 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 16/33] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:05 2022] GET /compute/v2.1/servers/f9e44714-3285-489f-91df-091b85f4c56b => generated 1211 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:26:06.322612 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-80e283ef-127f-42f7-8743-87156de45212 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:06.323561 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-80e283ef-127f-42f7-8743-87156de45212 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 1df1a34e-6645-4776-ac7a-a03a47edeebe] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:06.343665 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-80e283ef-127f-42f7-8743-87156de45212 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:06.344116 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-80e283ef-127f-42f7-8743-87156de45212 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:06.344936 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-80e283ef-127f-42f7-8743-87156de45212 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:06.345910 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-80e283ef-127f-42f7-8743-87156de45212 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:06.714908 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-80e283ef-127f-42f7-8743-87156de45212 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:06.725683 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-80e283ef-127f-42f7-8743-87156de45212 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe" status: 200 len: 1273 microversion: 2.1 time: 0.405110 Jul 11 11:26:06.736282 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 18/34] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:06 2022] GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe => generated 1273 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:26:07.016028 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-a9eb946e-56c5-489d-9e2f-8e8aeaadae08 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-870987198", "imageRef": "1bb93fc1-b713-4e67-8f76-bfec3a96168b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a66f67a8-9e25-4936-aefa-ad7234de04a8"}], "security_groups": [{"name": "tempest-securitygroup--1219924432"}], "key_name": "tempest-keypair-1662356650", "user_data": "}} {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:26:07.142829 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-dd68079a-ebf7-4280-b368-aeb16eee313a tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:07.144105 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-dd68079a-ebf7-4280-b368-aeb16eee313a tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] [instance: f9e44714-3285-489f-91df-091b85f4c56b] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:07.155558 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-dd68079a-ebf7-4280-b368-aeb16eee313a tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:07.156257 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-dd68079a-ebf7-4280-b368-aeb16eee313a tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:07.157196 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-dd68079a-ebf7-4280-b368-aeb16eee313a tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:07.157816 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-dd68079a-ebf7-4280-b368-aeb16eee313a tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:07.367917 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.network.neutron [None req-a9eb946e-56c5-489d-9e2f-8e8aeaadae08 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] validate_networks() for [('a66f67a8-9e25-4936-aefa-ad7234de04a8', None, None, None, None, None)] {{(pid=118322) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 11:26:08.146711 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-dd68079a-ebf7-4280-b368-aeb16eee313a tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9ae0e6a2534bb0b5d5e9327b01b238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '877612289735450ea6bd527ebe7b81f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:08.160838 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-dd68079a-ebf7-4280-b368-aeb16eee313a tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] 10.222.0.26 "GET /compute/v2.1/servers/f9e44714-3285-489f-91df-091b85f4c56b" status: 200 len: 1275 microversion: 2.1 time: 1.023077 Jul 11 11:26:08.173881 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 19/35] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:07 2022] GET /compute/v2.1/servers/f9e44714-3285-489f-91df-091b85f4c56b => generated 1275 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:26:08.180506 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-70f5e4e0-7d8f-41d2-a02b-209099a746b2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:08.181508 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-70f5e4e0-7d8f-41d2-a02b-209099a746b2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 1df1a34e-6645-4776-ac7a-a03a47edeebe] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:08.204088 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-70f5e4e0-7d8f-41d2-a02b-209099a746b2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:08.206654 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-70f5e4e0-7d8f-41d2-a02b-209099a746b2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:08.206654 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-70f5e4e0-7d8f-41d2-a02b-209099a746b2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:08.206654 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-70f5e4e0-7d8f-41d2-a02b-209099a746b2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:08.490568 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-70f5e4e0-7d8f-41d2-a02b-209099a746b2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:08.506325 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-70f5e4e0-7d8f-41d2-a02b-209099a746b2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe" status: 200 len: 1279 microversion: 2.1 time: 0.328908 Jul 11 11:26:08.511474 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 20/36] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:08 2022] GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe => generated 1279 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:26:08.525389 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-9b3f1919-71cb-425f-a7de-aef37093dd5f tempest-VolumesTestJSON-2003356164 tempest-VolumesTestJSON-2003356164-project] Calling method '.version_select at 0x7fb0105f6670>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:08.577598 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.virt.hardware [None req-a9eb946e-56c5-489d-9e2f-8e8aeaadae08 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Flavor limits 0:0:0 {{(pid=118322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 11:26:08.578812 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.virt.hardware [None req-a9eb946e-56c5-489d-9e2f-8e8aeaadae08 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Image limits 0:0:0 {{(pid=118322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 11:26:08.580417 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.virt.hardware [None req-a9eb946e-56c5-489d-9e2f-8e8aeaadae08 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Flavor pref 0:0:0 {{(pid=118322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 11:26:08.581310 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.virt.hardware [None req-a9eb946e-56c5-489d-9e2f-8e8aeaadae08 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Image pref 0:0:0 {{(pid=118322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 11:26:08.582211 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.virt.hardware [None req-a9eb946e-56c5-489d-9e2f-8e8aeaadae08 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 11:26:08.595648 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a9eb946e-56c5-489d-9e2f-8e8aeaadae08 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:08.596920 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a9eb946e-56c5-489d-9e2f-8e8aeaadae08 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:08.598038 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a9eb946e-56c5-489d-9e2f-8e8aeaadae08 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:08.598956 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a9eb946e-56c5-489d-9e2f-8e8aeaadae08 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:08.622264 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.quota [None req-a9eb946e-56c5-489d-9e2f-8e8aeaadae08 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Getting quotas for project 876864a8f283481a81ee65a1c97d0f4f. Resources: {'cores', 'ram', 'instances'} {{(pid=118322) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 11:26:08.628054 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.quota [None req-a9eb946e-56c5-489d-9e2f-8e8aeaadae08 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Getting quotas for user 993a59e8746948ab8a0f11d877314e02 and project 876864a8f283481a81ee65a1c97d0f4f. Resources: {'cores', 'ram', 'instances'} {{(pid=118322) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 11:26:08.653240 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-a9eb946e-56c5-489d-9e2f-8e8aeaadae08 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Going to run 1 instances... {{(pid=118322) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 11:26:08.655855 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-a9eb946e-56c5-489d-9e2f-8e8aeaadae08 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb93fc1-b713-4e67-8f76-bfec3a96168b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118322) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 11:26:08.814580 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-9b3f1919-71cb-425f-a7de-aef37093dd5f tempest-VolumesTestJSON-2003356164 tempest-VolumesTestJSON-2003356164-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/266f0ca4-a8cb-4358-abc1-bd3db1cc0b1c" status: 200 len: 351 microversion: 2.1 time: 0.300765 Jul 11 11:26:08.815681 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 21/37] 10.222.0.26 () {58 vars in 1244 bytes} [Mon Jul 11 11:26:08 2022] GET /compute/v2.1/os-volumes/266f0ca4-a8cb-4358-abc1-bd3db1cc0b1c => generated 351 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:26:08.919211 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-31cf8124-c7f8-45b7-867c-af8286a32447 tempest-VolumesTestJSON-2003356164 tempest-VolumesTestJSON-2003356164-project] Calling method '.version_select at 0x7fb0105f6430>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:09.150398 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-a9eb946e-56c5-489d-9e2f-8e8aeaadae08 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.135331 Jul 11 11:26:09.152650 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 17/38] 10.222.0.26 () {62 vars in 1187 bytes} [Mon Jul 11 11:26:07 2022] POST /compute/v2.1/servers => generated 402 bytes in 2144 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 11 11:26:09.193880 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-430213ea-4897-47aa-a706-1ecce6ffa2f1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:09.199155 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-430213ea-4897-47aa-a706-1ecce6ffa2f1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:09.364055 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-31cf8124-c7f8-45b7-867c-af8286a32447 tempest-VolumesTestJSON-2003356164 tempest-VolumesTestJSON-2003356164-project] 10.222.0.26 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.540271 Jul 11 11:26:09.365010 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 22/39] 10.222.0.26 () {58 vars in 1133 bytes} [Mon Jul 11 11:26:08 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:26:09.375904 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-813d3e2d-5091-4e23-9070-06a052fc6218 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:09.378430 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-813d3e2d-5091-4e23-9070-06a052fc6218 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] [instance: f9e44714-3285-489f-91df-091b85f4c56b] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:09.421742 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-813d3e2d-5091-4e23-9070-06a052fc6218 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:09.423308 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-813d3e2d-5091-4e23-9070-06a052fc6218 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:09.424826 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-813d3e2d-5091-4e23-9070-06a052fc6218 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:09.427474 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-813d3e2d-5091-4e23-9070-06a052fc6218 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:09.569397 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-430213ea-4897-47aa-a706-1ecce6ffa2f1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:09.578407 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-430213ea-4897-47aa-a706-1ecce6ffa2f1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:09.586521 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-430213ea-4897-47aa-a706-1ecce6ffa2f1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:09.589396 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-430213ea-4897-47aa-a706-1ecce6ffa2f1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1281 microversion: 2.20 time: 0.430138 Jul 11 11:26:09.594584 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 18/40] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:26:09 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1281 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:26:09.615363 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-54ff4bd9-575b-4169-a863-96c90ffec193 tempest-VolumesTestJSON-2003356164 tempest-VolumesTestJSON-2003356164-project] Calling method '.version_select at 0x7fb0105df790>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:09.918482 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-54ff4bd9-575b-4169-a863-96c90ffec193 tempest-VolumesTestJSON-2003356164 tempest-VolumesTestJSON-2003356164-project] 10.222.0.26 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.317124 Jul 11 11:26:09.919631 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 19/41] 10.222.0.26 () {58 vars in 1148 bytes} [Mon Jul 11 11:26:09 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:26:09.929102 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-1fc96163-19d7-447c-aaab-c465516bbc85 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:09.930555 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-1fc96163-19d7-447c-aaab-c465516bbc85 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 1df1a34e-6645-4776-ac7a-a03a47edeebe] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:09.990185 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1fc96163-19d7-447c-aaab-c465516bbc85 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:09.993452 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1fc96163-19d7-447c-aaab-c465516bbc85 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:09.995466 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1fc96163-19d7-447c-aaab-c465516bbc85 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:09.999748 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1fc96163-19d7-447c-aaab-c465516bbc85 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:10.216986 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-1fc96163-19d7-447c-aaab-c465516bbc85 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:10.241485 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-1fc96163-19d7-447c-aaab-c465516bbc85 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe" status: 200 len: 1279 microversion: 2.1 time: 0.315812 Jul 11 11:26:10.255238 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 20/42] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:09 2022] GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe => generated 1279 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:26:10.261645 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-cb776b91-5ffb-4e34-a011-d468bcd63866 tempest-VolumesTestJSON-2003356164 tempest-VolumesTestJSON-2003356164-project] Calling method '.version_select at 0x7fb010600040>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:11.247041 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-cb776b91-5ffb-4e34-a011-d468bcd63866 tempest-VolumesTestJSON-2003356164 tempest-VolumesTestJSON-2003356164-project] 10.222.0.26 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.990422 Jul 11 11:26:11.248600 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 21/43] 10.222.0.26 () {58 vars in 1133 bytes} [Mon Jul 11 11:26:10 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:26:11.253601 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-d294af46-aacc-4a72-902d-69a42af95c03 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:11.264165 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-d294af46-aacc-4a72-902d-69a42af95c03 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:11.316309 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-813d3e2d-5091-4e23-9070-06a052fc6218 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9ae0e6a2534bb0b5d5e9327b01b238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '877612289735450ea6bd527ebe7b81f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:11.329255 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-813d3e2d-5091-4e23-9070-06a052fc6218 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] 10.222.0.26 "GET /compute/v2.1/servers/f9e44714-3285-489f-91df-091b85f4c56b" status: 200 len: 1315 microversion: 2.1 time: 1.962799 Jul 11 11:26:11.333806 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 23/44] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:09 2022] GET /compute/v2.1/servers/f9e44714-3285-489f-91df-091b85f4c56b => generated 1315 bytes in 1968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:26:11.354971 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-33b345de-90b4-40c8-a5e6-84b13796b4ba tempest-VolumesTestJSON-2003356164 tempest-VolumesTestJSON-2003356164-project] Calling method '.version_select at 0x7fb0105de790>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:11.442965 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-d294af46-aacc-4a72-902d-69a42af95c03 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:11.465379 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-d294af46-aacc-4a72-902d-69a42af95c03 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:11.469528 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-d294af46-aacc-4a72-902d-69a42af95c03 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:11.476104 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-d294af46-aacc-4a72-902d-69a42af95c03 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1281 microversion: 2.20 time: 0.223928 Jul 11 11:26:11.480409 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 22/45] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:26:11 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1281 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:26:11.500069 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-6346921c-e2c1-42a8-9b9f-1021f79e777e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:11.501547 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-6346921c-e2c1-42a8-9b9f-1021f79e777e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 1df1a34e-6645-4776-ac7a-a03a47edeebe] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:11.523757 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6346921c-e2c1-42a8-9b9f-1021f79e777e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:11.525630 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6346921c-e2c1-42a8-9b9f-1021f79e777e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:11.534355 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6346921c-e2c1-42a8-9b9f-1021f79e777e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:11.535002 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6346921c-e2c1-42a8-9b9f-1021f79e777e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:11.763708 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-33b345de-90b4-40c8-a5e6-84b13796b4ba tempest-VolumesTestJSON-2003356164 tempest-VolumesTestJSON-2003356164-project] 10.222.0.26 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.428004 Jul 11 11:26:11.765070 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 24/46] 10.222.0.26 () {58 vars in 1166 bytes} [Mon Jul 11 11:26:11 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:26:11.777468 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-12090f9e-fb40-47a2-ba75-9f0be8301c79 tempest-VolumesTestJSON-2003356164 tempest-VolumesTestJSON-2003356164-project] Calling method '.version_select at 0x7fb0105f6310>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:12.007616 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-6346921c-e2c1-42a8-9b9f-1021f79e777e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:12.017500 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-12090f9e-fb40-47a2-ba75-9f0be8301c79 tempest-VolumesTestJSON-2003356164 tempest-VolumesTestJSON-2003356164-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.244488 Jul 11 11:26:12.025133 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 25/47] 10.222.0.26 () {58 vars in 1169 bytes} [Mon Jul 11 11:26:11 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:26:12.026009 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-6346921c-e2c1-42a8-9b9f-1021f79e777e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe" status: 200 len: 1321 microversion: 2.1 time: 0.539504 Jul 11 11:26:12.039487 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-09298829-1fcd-4103-a352-a4ca3efd2f7c tempest-VolumesTestJSON-2003356164 tempest-VolumesTestJSON-2003356164-project] Calling method '.version_select at 0x7fb0106370d0>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:12.044792 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 23/48] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:11 2022] GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe => generated 1321 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:26:12.289079 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-09298829-1fcd-4103-a352-a4ca3efd2f7c tempest-VolumesTestJSON-2003356164 tempest-VolumesTestJSON-2003356164-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.253438 Jul 11 11:26:12.289676 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 26/49] 10.222.0.26 () {58 vars in 1154 bytes} [Mon Jul 11 11:26:12 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:26:12.303699 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-e7c0dd47-4fa5-4698-8c95-94cb80ba346b tempest-VolumesTestJSON-2003356164 tempest-VolumesTestJSON-2003356164-project] Calling method '.version_select at 0x7fb0105b59d0>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:12.351154 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-ee810cf5-f440-4c73-9254-30936e171148 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:12.352819 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-ee810cf5-f440-4c73-9254-30936e171148 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] [instance: f9e44714-3285-489f-91df-091b85f4c56b] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:12.364319 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ee810cf5-f440-4c73-9254-30936e171148 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:12.367874 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ee810cf5-f440-4c73-9254-30936e171148 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:12.370480 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ee810cf5-f440-4c73-9254-30936e171148 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:12.371699 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ee810cf5-f440-4c73-9254-30936e171148 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:12.465977 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell0:SELECT=4 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:26:12.512762 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-e7c0dd47-4fa5-4698-8c95-94cb80ba346b tempest-VolumesTestJSON-2003356164 tempest-VolumesTestJSON-2003356164-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.214988 Jul 11 11:26:12.513537 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 24/50] 10.222.0.26 () {58 vars in 1187 bytes} [Mon Jul 11 11:26:12 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:26:12.522380 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-60eb3056-ee96-4d94-b136-ff495bd8dfa7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:12.523320 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-60eb3056-ee96-4d94-b136-ff495bd8dfa7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:12.541025 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-60eb3056-ee96-4d94-b136-ff495bd8dfa7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:12.541025 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-60eb3056-ee96-4d94-b136-ff495bd8dfa7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:12.541025 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-60eb3056-ee96-4d94-b136-ff495bd8dfa7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:12.541467 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-60eb3056-ee96-4d94-b136-ff495bd8dfa7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:12.728324 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-60eb3056-ee96-4d94-b136-ff495bd8dfa7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:12.737978 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-60eb3056-ee96-4d94-b136-ff495bd8dfa7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:12.740782 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-60eb3056-ee96-4d94-b136-ff495bd8dfa7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:12.748518 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-60eb3056-ee96-4d94-b136-ff495bd8dfa7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1333 microversion: 2.20 time: 0.227596 Jul 11 11:26:12.760608 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 25/51] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:26:12 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1333 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:26:12.765968 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-8da82c5e-f815-454d-b8d2-4dab0dab98fb tempest-VolumesTestJSON-2003356164 tempest-VolumesTestJSON-2003356164-project] Calling method '.version_select at 0x7fb0105cf4c0>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:13.101802 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-8da82c5e-f815-454d-b8d2-4dab0dab98fb tempest-VolumesTestJSON-2003356164 tempest-VolumesTestJSON-2003356164-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.339504 Jul 11 11:26:13.102924 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 26/52] 10.222.0.26 () {58 vars in 1154 bytes} [Mon Jul 11 11:26:12 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:26:13.121755 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-a4198ba1-88f7-45ee-8371-49f20fdd5b60 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:13.121755 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-a4198ba1-88f7-45ee-8371-49f20fdd5b60 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 1df1a34e-6645-4776-ac7a-a03a47edeebe] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:13.178153 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a4198ba1-88f7-45ee-8371-49f20fdd5b60 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:13.181652 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a4198ba1-88f7-45ee-8371-49f20fdd5b60 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:13.188376 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a4198ba1-88f7-45ee-8371-49f20fdd5b60 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:13.200067 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a4198ba1-88f7-45ee-8371-49f20fdd5b60 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:13.869207 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-ee810cf5-f440-4c73-9254-30936e171148 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9ae0e6a2534bb0b5d5e9327b01b238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '877612289735450ea6bd527ebe7b81f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:13.878223 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-ee810cf5-f440-4c73-9254-30936e171148 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] 10.222.0.26 "GET /compute/v2.1/servers/f9e44714-3285-489f-91df-091b85f4c56b" status: 200 len: 1315 microversion: 2.1 time: 1.530990 Jul 11 11:26:13.885951 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 27/53] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:12 2022] GET /compute/v2.1/servers/f9e44714-3285-489f-91df-091b85f4c56b => generated 1315 bytes in 1539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:26:13.903614 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-5009a7f1-6ed9-4876-b897-340a70fac7fd tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:13.904640 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-5009a7f1-6ed9-4876-b897-340a70fac7fd tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:13.920131 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5009a7f1-6ed9-4876-b897-340a70fac7fd tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:13.921381 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5009a7f1-6ed9-4876-b897-340a70fac7fd tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:13.933811 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5009a7f1-6ed9-4876-b897-340a70fac7fd tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:13.934529 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5009a7f1-6ed9-4876-b897-340a70fac7fd tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:14.001835 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-a4198ba1-88f7-45ee-8371-49f20fdd5b60 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:14.019809 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-a4198ba1-88f7-45ee-8371-49f20fdd5b60 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe" status: 200 len: 1321 microversion: 2.1 time: 0.913724 Jul 11 11:26:14.023976 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 27/54] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:13 2022] GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe => generated 1321 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:26:14.195808 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-5009a7f1-6ed9-4876-b897-340a70fac7fd tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:14.226646 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-5009a7f1-6ed9-4876-b897-340a70fac7fd tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:14.233943 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-5009a7f1-6ed9-4876-b897-340a70fac7fd tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:14.242310 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-5009a7f1-6ed9-4876-b897-340a70fac7fd tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1351 microversion: 2.20 time: 0.355001 Jul 11 11:26:14.246971 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 28/55] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:26:13 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1351 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:26:14.772285 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [req-98366696-4519-4ff4-a541-b4cc68850817 req-277ba7a7-351a-4fce-9d64-d79f60353838 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9e44714-3285-489f-91df-091b85f4c56b", "tag": "2f293575-af5f-45f7-a40b-ab11778b5e6c"}]} {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:26:14.800992 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [req-98366696-4519-4ff4-a541-b4cc68850817 req-277ba7a7-351a-4fce-9d64-d79f60353838 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:14.802203 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [req-98366696-4519-4ff4-a541-b4cc68850817 req-277ba7a7-351a-4fce-9d64-d79f60353838 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:14.877061 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.compute.server_external_events [req-98366696-4519-4ff4-a541-b4cc68850817 req-277ba7a7-351a-4fce-9d64-d79f60353838 service nova] Creating event network-changed:2f293575-af5f-45f7-a40b-ab11778b5e6c for instance f9e44714-3285-489f-91df-091b85f4c56b on hv-cinder-84842 Jul 11 11:26:14.877061 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [req-98366696-4519-4ff4-a541-b4cc68850817 req-277ba7a7-351a-4fce-9d64-d79f60353838 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118322) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 11 11:26:14.877061 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8157ccbd-b41e-4a33-a089-75586d6e85ce None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:14.877061 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8157ccbd-b41e-4a33-a089-75586d6e85ce None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:14.877061 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8157ccbd-b41e-4a33-a089-75586d6e85ce None None] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:14.877621 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8157ccbd-b41e-4a33-a089-75586d6e85ce None None] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:14.903728 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.compute.rpcapi [None req-8157ccbd-b41e-4a33-a089-75586d6e85ce None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 11 11:26:14.904306 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-7cb9814d-aa96-4bff-9124-14567fd3527a tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:14.905472 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-7cb9814d-aa96-4bff-9124-14567fd3527a tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] [instance: f9e44714-3285-489f-91df-091b85f4c56b] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:14.918493 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8157ccbd-b41e-4a33-a089-75586d6e85ce None None] Releasing lock "compute-rpcapi-router" {{(pid=118322) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 11 11:26:14.924549 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell0:SELECT=18 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:26:14.929848 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7cb9814d-aa96-4bff-9124-14567fd3527a tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:14.930495 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7cb9814d-aa96-4bff-9124-14567fd3527a tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:14.931834 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7cb9814d-aa96-4bff-9124-14567fd3527a tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:14.932924 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7cb9814d-aa96-4bff-9124-14567fd3527a tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:14.982979 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-8157ccbd-b41e-4a33-a089-75586d6e85ce None None] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.370079 Jul 11 11:26:14.983780 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 28/56] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 11:26:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:26:15.038750 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-25c57095-8064-487a-9426-c30b82cce2e4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:15.042326 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-25c57095-8064-487a-9426-c30b82cce2e4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 1df1a34e-6645-4776-ac7a-a03a47edeebe] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:15.043760 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:26:15.058635 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-25c57095-8064-487a-9426-c30b82cce2e4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:15.061922 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-25c57095-8064-487a-9426-c30b82cce2e4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:15.069325 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-25c57095-8064-487a-9426-c30b82cce2e4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:15.069947 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-25c57095-8064-487a-9426-c30b82cce2e4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:15.589506 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-7cb9814d-aa96-4bff-9124-14567fd3527a tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9ae0e6a2534bb0b5d5e9327b01b238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '877612289735450ea6bd527ebe7b81f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:15.604419 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-7cb9814d-aa96-4bff-9124-14567fd3527a tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] 10.222.0.26 "GET /compute/v2.1/servers/f9e44714-3285-489f-91df-091b85f4c56b" status: 200 len: 1315 microversion: 2.1 time: 0.700063 Jul 11 11:26:15.605675 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 29/57] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:14 2022] GET /compute/v2.1/servers/f9e44714-3285-489f-91df-091b85f4c56b => generated 1315 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:26:15.612973 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-70d3b18c-66e8-499d-a87c-8df1df1f39f6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:15.627365 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-70d3b18c-66e8-499d-a87c-8df1df1f39f6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:15.641273 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-70d3b18c-66e8-499d-a87c-8df1df1f39f6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:15.645592 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-70d3b18c-66e8-499d-a87c-8df1df1f39f6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:15.646668 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-70d3b18c-66e8-499d-a87c-8df1df1f39f6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:15.647661 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-70d3b18c-66e8-499d-a87c-8df1df1f39f6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:16.272353 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-70d3b18c-66e8-499d-a87c-8df1df1f39f6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:16.292544 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-25c57095-8064-487a-9426-c30b82cce2e4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:16.298547 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-70d3b18c-66e8-499d-a87c-8df1df1f39f6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:16.305556 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-25c57095-8064-487a-9426-c30b82cce2e4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe" status: 200 len: 1321 microversion: 2.1 time: 1.271059 Jul 11 11:26:16.306127 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-70d3b18c-66e8-499d-a87c-8df1df1f39f6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:16.306262 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 29/58] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:15 2022] GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe => generated 1321 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:26:16.309833 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-70d3b18c-66e8-499d-a87c-8df1df1f39f6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1339 microversion: 2.20 time: 0.700663 Jul 11 11:26:16.320112 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 30/59] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:26:15 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1339 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:26:16.622618 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-299b2ed5-06fc-4420-90e5-db7b0df9c412 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:16.623525 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-299b2ed5-06fc-4420-90e5-db7b0df9c412 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] [instance: f9e44714-3285-489f-91df-091b85f4c56b] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:16.630675 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-299b2ed5-06fc-4420-90e5-db7b0df9c412 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:16.631427 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-299b2ed5-06fc-4420-90e5-db7b0df9c412 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:16.632385 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-299b2ed5-06fc-4420-90e5-db7b0df9c412 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:16.632992 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-299b2ed5-06fc-4420-90e5-db7b0df9c412 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:17.328329 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-0e4c48c5-0661-4382-96a4-3817bc506488 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:17.329605 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-0e4c48c5-0661-4382-96a4-3817bc506488 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 1df1a34e-6645-4776-ac7a-a03a47edeebe] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:17.381302 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0e4c48c5-0661-4382-96a4-3817bc506488 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:17.386311 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0e4c48c5-0661-4382-96a4-3817bc506488 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:17.386311 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0e4c48c5-0661-4382-96a4-3817bc506488 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:17.386796 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0e4c48c5-0661-4382-96a4-3817bc506488 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:17.481177 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-299b2ed5-06fc-4420-90e5-db7b0df9c412 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9ae0e6a2534bb0b5d5e9327b01b238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '877612289735450ea6bd527ebe7b81f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:17.493432 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-299b2ed5-06fc-4420-90e5-db7b0df9c412 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] 10.222.0.26 "GET /compute/v2.1/servers/f9e44714-3285-489f-91df-091b85f4c56b" status: 200 len: 1315 microversion: 2.1 time: 0.875320 Jul 11 11:26:17.495348 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 30/60] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:16 2022] GET /compute/v2.1/servers/f9e44714-3285-489f-91df-091b85f4c56b => generated 1315 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:26:17.513606 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-b2ad8210-6488-4ee7-9fd6-26c9d60d3d71 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:17.514398 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-b2ad8210-6488-4ee7-9fd6-26c9d60d3d71 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:17.539691 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b2ad8210-6488-4ee7-9fd6-26c9d60d3d71 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:17.540446 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b2ad8210-6488-4ee7-9fd6-26c9d60d3d71 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:17.541461 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b2ad8210-6488-4ee7-9fd6-26c9d60d3d71 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:17.542077 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b2ad8210-6488-4ee7-9fd6-26c9d60d3d71 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:17.871582 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-b2ad8210-6488-4ee7-9fd6-26c9d60d3d71 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:17.885704 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-b2ad8210-6488-4ee7-9fd6-26c9d60d3d71 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:17.887727 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-b2ad8210-6488-4ee7-9fd6-26c9d60d3d71 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:17.889088 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-b2ad8210-6488-4ee7-9fd6-26c9d60d3d71 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1339 microversion: 2.20 time: 0.390553 Jul 11 11:26:17.889864 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 31/61] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:26:17 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1339 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:26:17.909051 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-efb26b4a-af6b-46d7-b963-8d0c325a75c8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1593629140", "imageRef": "1bb93fc1-b713-4e67-8f76-bfec3a96168b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "415c4ce2-00a4-4e63-ad18-4153e0b2d10b"}], "security_groups": [{"name": "tempest-securitygroup--2069601957"}], "key_name": "tempest-keypair-1812882260", "user_data": "}} {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:26:18.214277 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-0e4c48c5-0661-4382-96a4-3817bc506488 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:18.231808 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-0e4c48c5-0661-4382-96a4-3817bc506488 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe" status: 200 len: 1321 microversion: 2.1 time: 0.908147 Jul 11 11:26:18.232749 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 31/62] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:17 2022] GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe => generated 1321 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:26:18.238785 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-ed1459a4-fdae-4f43-8854-561f27088a66 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2089023567", "imageRef": "1bb93fc1-b713-4e67-8f76-bfec3a96168b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dc5b5fb4-7eaf-48cc-a935-f2b28a6703f4"}], "security_groups": [{"name": "tempest-securitygroup--387124449"}], "key_name": "tempest-keypair-848852803", "user_data": "}} {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:26:18.241747 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.network.neutron [None req-efb26b4a-af6b-46d7-b963-8d0c325a75c8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] validate_networks() for [('415c4ce2-00a4-4e63-ad18-4153e0b2d10b', None, None, None, None, None)] {{(pid=118322) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 11:26:18.767469 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.network.neutron [None req-ed1459a4-fdae-4f43-8854-561f27088a66 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] validate_networks() for [('dc5b5fb4-7eaf-48cc-a935-f2b28a6703f4', None, None, None, None, None)] {{(pid=118321) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 11:26:20.041366 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.virt.hardware [None req-ed1459a4-fdae-4f43-8854-561f27088a66 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Flavor limits 0:0:0 {{(pid=118321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 11:26:20.042656 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.virt.hardware [None req-ed1459a4-fdae-4f43-8854-561f27088a66 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Image limits 0:0:0 {{(pid=118321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 11:26:20.043664 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.virt.hardware [None req-ed1459a4-fdae-4f43-8854-561f27088a66 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Flavor pref 0:0:0 {{(pid=118321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 11:26:20.044694 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.virt.hardware [None req-ed1459a4-fdae-4f43-8854-561f27088a66 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Image pref 0:0:0 {{(pid=118321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 11:26:20.045792 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.virt.hardware [None req-ed1459a4-fdae-4f43-8854-561f27088a66 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 11:26:20.092183 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=6 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:26:20.114476 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ed1459a4-fdae-4f43-8854-561f27088a66 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:20.115314 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ed1459a4-fdae-4f43-8854-561f27088a66 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:20.119038 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ed1459a4-fdae-4f43-8854-561f27088a66 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:20.120285 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ed1459a4-fdae-4f43-8854-561f27088a66 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:20.135865 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=65 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:26:20.150446 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.virt.hardware [None req-efb26b4a-af6b-46d7-b963-8d0c325a75c8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Flavor limits 0:0:0 {{(pid=118322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 11:26:20.151541 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.virt.hardware [None req-efb26b4a-af6b-46d7-b963-8d0c325a75c8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Image limits 0:0:0 {{(pid=118322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 11:26:20.152171 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.virt.hardware [None req-efb26b4a-af6b-46d7-b963-8d0c325a75c8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Flavor pref 0:0:0 {{(pid=118322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 11:26:20.152729 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.virt.hardware [None req-efb26b4a-af6b-46d7-b963-8d0c325a75c8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Image pref 0:0:0 {{(pid=118322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 11:26:20.153327 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.virt.hardware [None req-efb26b4a-af6b-46d7-b963-8d0c325a75c8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 11:26:20.180397 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-efb26b4a-af6b-46d7-b963-8d0c325a75c8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:20.183582 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-efb26b4a-af6b-46d7-b963-8d0c325a75c8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:20.184296 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.quota [None req-ed1459a4-fdae-4f43-8854-561f27088a66 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Getting quotas for project 5779b0ffa2244901a92adbee65b10421. Resources: {'cores', 'ram', 'instances'} {{(pid=118321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 11:26:20.185462 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-efb26b4a-af6b-46d7-b963-8d0c325a75c8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:20.187593 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-efb26b4a-af6b-46d7-b963-8d0c325a75c8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:20.198228 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.quota [None req-ed1459a4-fdae-4f43-8854-561f27088a66 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Getting quotas for user 15ff2cacb5c1450482597a2f5fa3c8a9 and project 5779b0ffa2244901a92adbee65b10421. Resources: {'cores', 'ram', 'instances'} {{(pid=118321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 11:26:20.222170 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.quota [None req-efb26b4a-af6b-46d7-b963-8d0c325a75c8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Getting quotas for project 1328a510264f4374baabad7b5243d8c2. Resources: {'cores', 'ram', 'instances'} {{(pid=118322) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 11:26:20.226958 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.quota [None req-efb26b4a-af6b-46d7-b963-8d0c325a75c8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Getting quotas for user cbcc15c786fb43669ac34a4897735c1d and project 1328a510264f4374baabad7b5243d8c2. Resources: {'cores', 'ram', 'instances'} {{(pid=118322) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 11:26:20.237597 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-ed1459a4-fdae-4f43-8854-561f27088a66 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Going to run 1 instances... {{(pid=118321) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 11:26:20.239772 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-ed1459a4-fdae-4f43-8854-561f27088a66 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb93fc1-b713-4e67-8f76-bfec3a96168b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118321) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 11:26:20.241659 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-efb26b4a-af6b-46d7-b963-8d0c325a75c8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Going to run 1 instances... {{(pid=118322) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 11:26:20.244576 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-efb26b4a-af6b-46d7-b963-8d0c325a75c8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb93fc1-b713-4e67-8f76-bfec3a96168b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118322) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 11:26:20.427132 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-efb26b4a-af6b-46d7-b963-8d0c325a75c8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.534022 Jul 11 11:26:20.430579 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 32/63] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jul 11 11:26:17 2022] POST /compute/v2.1/servers => generated 402 bytes in 2540 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 11 11:26:20.486165 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-ed1459a4-fdae-4f43-8854-561f27088a66 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.251304 Jul 11 11:26:20.488957 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 32/64] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jul 11 11:26:18 2022] POST /compute/v2.1/servers => generated 401 bytes in 2255 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 11 11:26:20.495390 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-00d8c4a9-8d42-49d3-ac08-ec20521e374d tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:20.498301 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-00d8c4a9-8d42-49d3-ac08-ec20521e374d tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] [instance: f9e44714-3285-489f-91df-091b85f4c56b] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:20.531330 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-00d8c4a9-8d42-49d3-ac08-ec20521e374d tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:20.534153 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-00d8c4a9-8d42-49d3-ac08-ec20521e374d tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:20.536293 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-00d8c4a9-8d42-49d3-ac08-ec20521e374d tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:20.541855 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-00d8c4a9-8d42-49d3-ac08-ec20521e374d tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:20.785886 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [req-8839178c-234a-4304-9a7b-8e5d65f0aa4c req-304b6665-e261-4b11-9022-ffa297c0b8e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b39fbe8d-e6a4-4482-981f-ac21c2b52176", "tag": "62a32eb2-256e-45ce-bcbf-411a778027d2"}]} {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:26:20.800337 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [req-8839178c-234a-4304-9a7b-8e5d65f0aa4c req-304b6665-e261-4b11-9022-ffa297c0b8e6 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:20.800337 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [req-8839178c-234a-4304-9a7b-8e5d65f0aa4c req-304b6665-e261-4b11-9022-ffa297c0b8e6 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:20.871783 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.compute.server_external_events [req-8839178c-234a-4304-9a7b-8e5d65f0aa4c req-304b6665-e261-4b11-9022-ffa297c0b8e6 service nova] Creating event network-changed:62a32eb2-256e-45ce-bcbf-411a778027d2 for instance b39fbe8d-e6a4-4482-981f-ac21c2b52176 on hv-cinder-84842 Jul 11 11:26:20.877310 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [req-8839178c-234a-4304-9a7b-8e5d65f0aa4c req-304b6665-e261-4b11-9022-ffa297c0b8e6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.445450 Jul 11 11:26:20.878133 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 33/65] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 11:26:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:26:20.883481 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-3fbd8864-24d7-4f2d-9dbc-11f9e88f11ae tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:20.884194 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-3fbd8864-24d7-4f2d-9dbc-11f9e88f11ae tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:20.916813 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3fbd8864-24d7-4f2d-9dbc-11f9e88f11ae tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:20.918972 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3fbd8864-24d7-4f2d-9dbc-11f9e88f11ae tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:20.920323 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3fbd8864-24d7-4f2d-9dbc-11f9e88f11ae tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:20.920911 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3fbd8864-24d7-4f2d-9dbc-11f9e88f11ae tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:21.177800 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-00d8c4a9-8d42-49d3-ac08-ec20521e374d tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9ae0e6a2534bb0b5d5e9327b01b238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '877612289735450ea6bd527ebe7b81f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:21.201282 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-00d8c4a9-8d42-49d3-ac08-ec20521e374d tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] 10.222.0.26 "GET /compute/v2.1/servers/f9e44714-3285-489f-91df-091b85f4c56b" status: 200 len: 1315 microversion: 2.1 time: 0.710375 Jul 11 11:26:21.238768 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 33/66] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:20 2022] GET /compute/v2.1/servers/f9e44714-3285-489f-91df-091b85f4c56b => generated 1315 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:26:21.247156 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-08bc5679-9d32-4558-a93f-56138d81360e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:21.247802 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-08bc5679-9d32-4558-a93f-56138d81360e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 1df1a34e-6645-4776-ac7a-a03a47edeebe] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:21.255994 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-08bc5679-9d32-4558-a93f-56138d81360e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:21.255994 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-08bc5679-9d32-4558-a93f-56138d81360e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:21.255994 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-08bc5679-9d32-4558-a93f-56138d81360e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:21.256365 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-08bc5679-9d32-4558-a93f-56138d81360e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:21.259671 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-3fbd8864-24d7-4f2d-9dbc-11f9e88f11ae tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:21.269866 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-3fbd8864-24d7-4f2d-9dbc-11f9e88f11ae tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:21.272043 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-3fbd8864-24d7-4f2d-9dbc-11f9e88f11ae tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:21.273403 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-3fbd8864-24d7-4f2d-9dbc-11f9e88f11ae tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1407 microversion: 2.20 time: 0.393907 Jul 11 11:26:21.276603 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 34/67] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:26:20 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1407 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:26:21.282611 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-4100d59d-be6c-415e-bbd8-4e4849f4bc46 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:21.283629 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-4100d59d-be6c-415e-bbd8-4e4849f4bc46 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:21.347925 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-4100d59d-be6c-415e-bbd8-4e4849f4bc46 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:21.352682 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-4100d59d-be6c-415e-bbd8-4e4849f4bc46 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1242 microversion: 2.1 time: 0.074515 Jul 11 11:26:21.353277 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 35/68] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:21 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1242 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:26:21.357912 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-c2e9787c-5e95-4484-ba85-523ec8f3904c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:21.358758 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-c2e9787c-5e95-4484-ba85-523ec8f3904c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:21.465564 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-c2e9787c-5e95-4484-ba85-523ec8f3904c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:21.484936 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-c2e9787c-5e95-4484-ba85-523ec8f3904c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1237 microversion: 2.1 time: 0.130448 Jul 11 11:26:21.486149 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 36/69] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:21 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1237 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:26:21.493394 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [req-7fee6830-b19f-4322-9b40-a61dec65e733 req-6af67cdb-ed6d-417c-b7b9-1f29873c2da1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b0ec960-6583-4639-9658-a850655eb703", "tag": "fb396fac-9f6d-4448-a468-adea47f3003f"}]} {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:26:21.505557 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [req-7fee6830-b19f-4322-9b40-a61dec65e733 req-6af67cdb-ed6d-417c-b7b9-1f29873c2da1 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:21.508834 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [req-7fee6830-b19f-4322-9b40-a61dec65e733 req-6af67cdb-ed6d-417c-b7b9-1f29873c2da1 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:21.530623 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.compute.server_external_events [req-7fee6830-b19f-4322-9b40-a61dec65e733 req-6af67cdb-ed6d-417c-b7b9-1f29873c2da1 service nova] Creating event network-changed:fb396fac-9f6d-4448-a468-adea47f3003f for instance 4b0ec960-6583-4639-9658-a850655eb703 on hv-cinder-84842 Jul 11 11:26:21.555066 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [req-7fee6830-b19f-4322-9b40-a61dec65e733 req-6af67cdb-ed6d-417c-b7b9-1f29873c2da1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067377 Jul 11 11:26:21.562056 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 37/70] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 11:26:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:26:21.638475 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-08bc5679-9d32-4558-a93f-56138d81360e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:21.668434 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-08bc5679-9d32-4558-a93f-56138d81360e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe" status: 200 len: 1321 microversion: 2.1 time: 0.426833 Jul 11 11:26:21.672074 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 34/71] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:21 2022] GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe => generated 1321 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:26:22.222794 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-0e9e3eba-7ce6-4421-bfdd-b33180f31e76 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:22.223679 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-0e9e3eba-7ce6-4421-bfdd-b33180f31e76 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] [instance: f9e44714-3285-489f-91df-091b85f4c56b] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:22.231095 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0e9e3eba-7ce6-4421-bfdd-b33180f31e76 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:22.231880 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0e9e3eba-7ce6-4421-bfdd-b33180f31e76 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:22.232792 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0e9e3eba-7ce6-4421-bfdd-b33180f31e76 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:22.234376 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0e9e3eba-7ce6-4421-bfdd-b33180f31e76 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:22.302594 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-10d9ea9a-f404-49af-bd96-d6915fdfc230 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:22.308811 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-10d9ea9a-f404-49af-bd96-d6915fdfc230 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:22.315816 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-10d9ea9a-f404-49af-bd96-d6915fdfc230 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:22.316938 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-10d9ea9a-f404-49af-bd96-d6915fdfc230 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:22.321325 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-10d9ea9a-f404-49af-bd96-d6915fdfc230 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:22.324882 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-10d9ea9a-f404-49af-bd96-d6915fdfc230 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:22.411435 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-0e9e3eba-7ce6-4421-bfdd-b33180f31e76 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9ae0e6a2534bb0b5d5e9327b01b238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '877612289735450ea6bd527ebe7b81f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:22.419544 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-0e9e3eba-7ce6-4421-bfdd-b33180f31e76 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] 10.222.0.26 "GET /compute/v2.1/servers/f9e44714-3285-489f-91df-091b85f4c56b" status: 200 len: 1315 microversion: 2.1 time: 0.201463 Jul 11 11:26:22.420200 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 38/72] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:22 2022] GET /compute/v2.1/servers/f9e44714-3285-489f-91df-091b85f4c56b => generated 1315 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:26:22.425611 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-374e3f23-80d6-4f52-84da-60497bc94229 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:22.426718 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-374e3f23-80d6-4f52-84da-60497bc94229 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:22.490181 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-374e3f23-80d6-4f52-84da-60497bc94229 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:22.498753 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-374e3f23-80d6-4f52-84da-60497bc94229 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1242 microversion: 2.1 time: 0.077171 Jul 11 11:26:22.499484 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 39/73] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:22 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1242 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:26:22.504796 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-dc90b9f4-7593-4fb5-96c6-35e353ad9782 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:22.505547 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-dc90b9f4-7593-4fb5-96c6-35e353ad9782 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:22.513663 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-dc90b9f4-7593-4fb5-96c6-35e353ad9782 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:22.514108 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-dc90b9f4-7593-4fb5-96c6-35e353ad9782 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:22.520602 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-dc90b9f4-7593-4fb5-96c6-35e353ad9782 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:22.520602 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-dc90b9f4-7593-4fb5-96c6-35e353ad9782 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:22.528301 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-10d9ea9a-f404-49af-bd96-d6915fdfc230 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:22.537878 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-10d9ea9a-f404-49af-bd96-d6915fdfc230 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:22.539454 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-10d9ea9a-f404-49af-bd96-d6915fdfc230 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:22.540892 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-10d9ea9a-f404-49af-bd96-d6915fdfc230 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1407 microversion: 2.20 time: 0.246593 Jul 11 11:26:22.541626 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 35/74] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:26:22 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1407 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:26:22.582499 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-dc90b9f4-7593-4fb5-96c6-35e353ad9782 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:22.590235 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-dc90b9f4-7593-4fb5-96c6-35e353ad9782 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1241 microversion: 2.1 time: 0.089718 Jul 11 11:26:22.591152 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 40/75] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:22 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1241 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:26:22.689602 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-9377fcda-671d-461f-8e75-74660ca50741 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:22.690653 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-9377fcda-671d-461f-8e75-74660ca50741 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 1df1a34e-6645-4776-ac7a-a03a47edeebe] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:22.698823 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9377fcda-671d-461f-8e75-74660ca50741 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:22.699356 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9377fcda-671d-461f-8e75-74660ca50741 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:22.700121 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9377fcda-671d-461f-8e75-74660ca50741 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:22.700547 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9377fcda-671d-461f-8e75-74660ca50741 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:22.844223 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-9377fcda-671d-461f-8e75-74660ca50741 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:22.856517 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-9377fcda-671d-461f-8e75-74660ca50741 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe" status: 200 len: 1321 microversion: 2.1 time: 0.171186 Jul 11 11:26:22.857099 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 36/76] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:22 2022] GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe => generated 1321 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:26:22.960349 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [req-9619b6cf-93f2-4c4c-a0d5-89962863829a req-667ef78b-dc76-4353-8c19-787550206219 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1df1a34e-6645-4776-ac7a-a03a47edeebe", "tag": "65cc413d-9788-4b74-9e0d-f6d26d9bc4f5"}]} {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:26:22.968817 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [req-9619b6cf-93f2-4c4c-a0d5-89962863829a req-667ef78b-dc76-4353-8c19-787550206219 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:22.969510 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [req-9619b6cf-93f2-4c4c-a0d5-89962863829a req-667ef78b-dc76-4353-8c19-787550206219 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:22.980487 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.compute.server_external_events [req-9619b6cf-93f2-4c4c-a0d5-89962863829a req-667ef78b-dc76-4353-8c19-787550206219 service nova] Creating event network-changed:65cc413d-9788-4b74-9e0d-f6d26d9bc4f5 for instance 1df1a34e-6645-4776-ac7a-a03a47edeebe on hv-cinder-84842 Jul 11 11:26:22.985326 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [req-9619b6cf-93f2-4c4c-a0d5-89962863829a req-667ef78b-dc76-4353-8c19-787550206219 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028754 Jul 11 11:26:22.985908 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 41/77] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 11:26:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:26:23.436663 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-ecf135f5-b332-4742-a458-7b2039b0135c tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:23.437292 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-ecf135f5-b332-4742-a458-7b2039b0135c tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] [instance: f9e44714-3285-489f-91df-091b85f4c56b] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:23.443470 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ecf135f5-b332-4742-a458-7b2039b0135c tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:23.443899 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ecf135f5-b332-4742-a458-7b2039b0135c tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:23.444692 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ecf135f5-b332-4742-a458-7b2039b0135c tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:23.445114 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ecf135f5-b332-4742-a458-7b2039b0135c tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:23.525906 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-64c9b2ca-a24d-42d0-9ad6-7b6e6d20e82a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:23.526604 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-64c9b2ca-a24d-42d0-9ad6-7b6e6d20e82a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:23.533766 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-64c9b2ca-a24d-42d0-9ad6-7b6e6d20e82a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:23.534219 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-64c9b2ca-a24d-42d0-9ad6-7b6e6d20e82a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:23.535483 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-64c9b2ca-a24d-42d0-9ad6-7b6e6d20e82a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:23.535915 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-64c9b2ca-a24d-42d0-9ad6-7b6e6d20e82a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:23.627037 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-64c9b2ca-a24d-42d0-9ad6-7b6e6d20e82a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:23.649037 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-64c9b2ca-a24d-42d0-9ad6-7b6e6d20e82a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1246 microversion: 2.1 time: 0.123056 Jul 11 11:26:23.658534 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 42/78] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:23 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1246 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:26:23.658534 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-ae9d39a4-6463-45d8-b197-bc1ea3f9aeca tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:23.658534 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-ae9d39a4-6463-45d8-b197-bc1ea3f9aeca tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:23.663972 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ae9d39a4-6463-45d8-b197-bc1ea3f9aeca tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:23.664535 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ae9d39a4-6463-45d8-b197-bc1ea3f9aeca tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:23.665405 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ae9d39a4-6463-45d8-b197-bc1ea3f9aeca tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:23.666029 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ae9d39a4-6463-45d8-b197-bc1ea3f9aeca tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:23.690655 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-ecf135f5-b332-4742-a458-7b2039b0135c tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9ae0e6a2534bb0b5d5e9327b01b238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '877612289735450ea6bd527ebe7b81f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:23.698599 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-ecf135f5-b332-4742-a458-7b2039b0135c tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] 10.222.0.26 "GET /compute/v2.1/servers/f9e44714-3285-489f-91df-091b85f4c56b" status: 200 len: 1315 microversion: 2.1 time: 0.265675 Jul 11 11:26:23.699181 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 37/79] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:23 2022] GET /compute/v2.1/servers/f9e44714-3285-489f-91df-091b85f4c56b => generated 1315 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:26:23.712534 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-6303a20d-5be6-4de3-b853-d6c3792940ea tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:23.712534 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-6303a20d-5be6-4de3-b853-d6c3792940ea tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:23.717857 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6303a20d-5be6-4de3-b853-d6c3792940ea tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:23.718294 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6303a20d-5be6-4de3-b853-d6c3792940ea tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:23.719091 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6303a20d-5be6-4de3-b853-d6c3792940ea tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:23.720114 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6303a20d-5be6-4de3-b853-d6c3792940ea tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:23.787582 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-6303a20d-5be6-4de3-b853-d6c3792940ea tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:23.795232 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-6303a20d-5be6-4de3-b853-d6c3792940ea tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1241 microversion: 2.1 time: 0.087569 Jul 11 11:26:23.795831 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 38/80] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:23 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1241 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:26:23.821874 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-ae9d39a4-6463-45d8-b197-bc1ea3f9aeca tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:23.836086 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-ae9d39a4-6463-45d8-b197-bc1ea3f9aeca tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:23.837710 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-ae9d39a4-6463-45d8-b197-bc1ea3f9aeca tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:23.838842 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-ae9d39a4-6463-45d8-b197-bc1ea3f9aeca tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1407 microversion: 2.20 time: 0.187765 Jul 11 11:26:23.839435 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 43/81] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:26:23 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1407 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:26:23.873777 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-4e77409b-7db8-4bcb-a170-234ac84b8897 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:23.876008 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-4e77409b-7db8-4bcb-a170-234ac84b8897 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 1df1a34e-6645-4776-ac7a-a03a47edeebe] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:23.882625 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4e77409b-7db8-4bcb-a170-234ac84b8897 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:23.883169 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4e77409b-7db8-4bcb-a170-234ac84b8897 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:23.884186 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4e77409b-7db8-4bcb-a170-234ac84b8897 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:23.884694 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4e77409b-7db8-4bcb-a170-234ac84b8897 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:24.027829 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-4e77409b-7db8-4bcb-a170-234ac84b8897 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:24.035597 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-4e77409b-7db8-4bcb-a170-234ac84b8897 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe" status: 200 len: 1321 microversion: 2.1 time: 0.165632 Jul 11 11:26:24.036156 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 39/82] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:23 2022] GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:26:24.666380 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-437baade-d824-4c61-8c00-6c48b93f0820 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:24.667207 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-437baade-d824-4c61-8c00-6c48b93f0820 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:24.673637 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-437baade-d824-4c61-8c00-6c48b93f0820 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:24.674173 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-437baade-d824-4c61-8c00-6c48b93f0820 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:24.675002 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-437baade-d824-4c61-8c00-6c48b93f0820 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:24.675556 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-437baade-d824-4c61-8c00-6c48b93f0820 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:24.716259 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-a696e638-9280-4bd9-a3ed-8c9cd20c3562 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:24.718173 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-a696e638-9280-4bd9-a3ed-8c9cd20c3562 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] [instance: f9e44714-3285-489f-91df-091b85f4c56b] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:24.725411 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a696e638-9280-4bd9-a3ed-8c9cd20c3562 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:24.725957 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a696e638-9280-4bd9-a3ed-8c9cd20c3562 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:24.726989 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a696e638-9280-4bd9-a3ed-8c9cd20c3562 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:24.727760 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a696e638-9280-4bd9-a3ed-8c9cd20c3562 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:24.751906 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-437baade-d824-4c61-8c00-6c48b93f0820 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:24.751906 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=100 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:26:24.755007 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-437baade-d824-4c61-8c00-6c48b93f0820 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1246 microversion: 2.1 time: 0.092949 Jul 11 11:26:24.755872 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 44/83] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:24 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1246 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:26:24.813360 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-a84e21ac-0a3e-4c03-a989-cb9b3deac7ae tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:24.814099 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-a84e21ac-0a3e-4c03-a989-cb9b3deac7ae tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:24.829661 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a84e21ac-0a3e-4c03-a989-cb9b3deac7ae tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:24.830122 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a84e21ac-0a3e-4c03-a989-cb9b3deac7ae tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:24.830886 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a84e21ac-0a3e-4c03-a989-cb9b3deac7ae tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:24.831340 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a84e21ac-0a3e-4c03-a989-cb9b3deac7ae tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:24.893478 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-a696e638-9280-4bd9-a3ed-8c9cd20c3562 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9ae0e6a2534bb0b5d5e9327b01b238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '877612289735450ea6bd527ebe7b81f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:24.903788 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-a696e638-9280-4bd9-a3ed-8c9cd20c3562 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] 10.222.0.26 "GET /compute/v2.1/servers/f9e44714-3285-489f-91df-091b85f4c56b" status: 200 len: 1315 microversion: 2.1 time: 0.192379 Jul 11 11:26:24.904539 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 40/84] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:24 2022] GET /compute/v2.1/servers/f9e44714-3285-489f-91df-091b85f4c56b => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:26:24.909838 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-6e8c474a-28fa-4a2c-a1df-1892b88074e4 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:24.910438 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-6e8c474a-28fa-4a2c-a1df-1892b88074e4 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:24.916452 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6e8c474a-28fa-4a2c-a1df-1892b88074e4 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:24.916893 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6e8c474a-28fa-4a2c-a1df-1892b88074e4 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:24.917647 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6e8c474a-28fa-4a2c-a1df-1892b88074e4 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:24.918071 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6e8c474a-28fa-4a2c-a1df-1892b88074e4 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:24.920500 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-a84e21ac-0a3e-4c03-a989-cb9b3deac7ae tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:24.933632 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-a84e21ac-0a3e-4c03-a989-cb9b3deac7ae tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1241 microversion: 2.1 time: 0.124160 Jul 11 11:26:24.934216 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 45/85] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:24 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1241 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:26:25.054987 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-418d90bd-7641-4647-9072-ac7b28b25776 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:25.055872 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-418d90bd-7641-4647-9072-ac7b28b25776 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 1df1a34e-6645-4776-ac7a-a03a47edeebe] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:25.064946 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-418d90bd-7641-4647-9072-ac7b28b25776 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:25.065608 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-418d90bd-7641-4647-9072-ac7b28b25776 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:25.066552 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-418d90bd-7641-4647-9072-ac7b28b25776 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:25.067129 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-418d90bd-7641-4647-9072-ac7b28b25776 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:25.163336 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-6e8c474a-28fa-4a2c-a1df-1892b88074e4 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:25.176451 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-6e8c474a-28fa-4a2c-a1df-1892b88074e4 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:25.179496 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-6e8c474a-28fa-4a2c-a1df-1892b88074e4 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:25.181103 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-6e8c474a-28fa-4a2c-a1df-1892b88074e4 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1407 microversion: 2.20 time: 0.275476 Jul 11 11:26:25.182453 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 41/86] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:26:24 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1407 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:26:25.244352 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-418d90bd-7641-4647-9072-ac7b28b25776 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:25.252675 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-418d90bd-7641-4647-9072-ac7b28b25776 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe" status: 200 len: 1321 microversion: 2.1 time: 0.203911 Jul 11 11:26:25.253485 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 46/87] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:25 2022] GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe => generated 1321 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:26:25.773329 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-8afdfdf0-60df-4dca-abce-19ab70f4290b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:25.773329 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-8afdfdf0-60df-4dca-abce-19ab70f4290b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:25.780655 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8afdfdf0-60df-4dca-abce-19ab70f4290b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:25.781149 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8afdfdf0-60df-4dca-abce-19ab70f4290b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:25.782462 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8afdfdf0-60df-4dca-abce-19ab70f4290b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:25.783055 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8afdfdf0-60df-4dca-abce-19ab70f4290b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:25.909446 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-8afdfdf0-60df-4dca-abce-19ab70f4290b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:25.921208 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-e76fe5a1-a5f9-4898-b4d0-e2c3565396a0 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:25.928230 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-e76fe5a1-a5f9-4898-b4d0-e2c3565396a0 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] [instance: f9e44714-3285-489f-91df-091b85f4c56b] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:25.931018 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-8afdfdf0-60df-4dca-abce-19ab70f4290b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1238 microversion: 2.1 time: 0.162491 Jul 11 11:26:25.931690 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 42/88] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:25 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1238 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:26:25.944805 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e76fe5a1-a5f9-4898-b4d0-e2c3565396a0 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:25.945264 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e76fe5a1-a5f9-4898-b4d0-e2c3565396a0 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:25.946163 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e76fe5a1-a5f9-4898-b4d0-e2c3565396a0 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:25.946602 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e76fe5a1-a5f9-4898-b4d0-e2c3565396a0 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:25.951434 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-04880a9d-fb28-4c46-9351-e92f9a01b3ae tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:25.953819 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-04880a9d-fb28-4c46-9351-e92f9a01b3ae tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:25.966988 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-04880a9d-fb28-4c46-9351-e92f9a01b3ae tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:25.969012 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-04880a9d-fb28-4c46-9351-e92f9a01b3ae tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:25.971742 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-04880a9d-fb28-4c46-9351-e92f9a01b3ae tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:25.975853 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-04880a9d-fb28-4c46-9351-e92f9a01b3ae tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:26.123415 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-04880a9d-fb28-4c46-9351-e92f9a01b3ae tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:26.147834 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-04880a9d-fb28-4c46-9351-e92f9a01b3ae tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1233 microversion: 2.1 time: 0.200454 Jul 11 11:26:26.159286 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 43/89] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:25 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1233 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:26:26.206743 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-6b6917e4-f3e6-4e11-ab29-7bc20cc27bc1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:26.207516 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-6b6917e4-f3e6-4e11-ab29-7bc20cc27bc1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:26.228485 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6b6917e4-f3e6-4e11-ab29-7bc20cc27bc1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:26.229285 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6b6917e4-f3e6-4e11-ab29-7bc20cc27bc1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:26.230497 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6b6917e4-f3e6-4e11-ab29-7bc20cc27bc1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:26.231608 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6b6917e4-f3e6-4e11-ab29-7bc20cc27bc1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:26.351570 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-e76fe5a1-a5f9-4898-b4d0-e2c3565396a0 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9ae0e6a2534bb0b5d5e9327b01b238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '877612289735450ea6bd527ebe7b81f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:26.357957 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-e76fe5a1-a5f9-4898-b4d0-e2c3565396a0 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] 10.222.0.26 "GET /compute/v2.1/servers/f9e44714-3285-489f-91df-091b85f4c56b" status: 200 len: 1315 microversion: 2.1 time: 0.440505 Jul 11 11:26:26.363479 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 47/90] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:25 2022] GET /compute/v2.1/servers/f9e44714-3285-489f-91df-091b85f4c56b => generated 1315 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:26:26.370845 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-541c1d11-3914-4280-8667-e49a623b8216 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:26.371535 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-541c1d11-3914-4280-8667-e49a623b8216 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 1df1a34e-6645-4776-ac7a-a03a47edeebe] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:26.382950 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-541c1d11-3914-4280-8667-e49a623b8216 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:26.383784 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-541c1d11-3914-4280-8667-e49a623b8216 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:26.384831 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-541c1d11-3914-4280-8667-e49a623b8216 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:26.385288 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-541c1d11-3914-4280-8667-e49a623b8216 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:26.417952 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-6b6917e4-f3e6-4e11-ab29-7bc20cc27bc1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:26.426772 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-6b6917e4-f3e6-4e11-ab29-7bc20cc27bc1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:26.429306 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-6b6917e4-f3e6-4e11-ab29-7bc20cc27bc1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:26.430864 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-6b6917e4-f3e6-4e11-ab29-7bc20cc27bc1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1407 microversion: 2.20 time: 0.233991 Jul 11 11:26:26.432025 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 44/91] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:26:26 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1407 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:26:26.710989 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-541c1d11-3914-4280-8667-e49a623b8216 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:26.723554 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-541c1d11-3914-4280-8667-e49a623b8216 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe" status: 200 len: 1321 microversion: 2.1 time: 0.359536 Jul 11 11:26:26.729535 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 48/92] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:26 2022] GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe => generated 1321 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:26:26.961128 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-d3ad718e-db35-4ed8-b3fc-a0e249affb11 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:26.961748 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-d3ad718e-db35-4ed8-b3fc-a0e249affb11 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:26.975876 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d3ad718e-db35-4ed8-b3fc-a0e249affb11 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:26.977389 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d3ad718e-db35-4ed8-b3fc-a0e249affb11 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:26.979479 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d3ad718e-db35-4ed8-b3fc-a0e249affb11 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:26.980203 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d3ad718e-db35-4ed8-b3fc-a0e249affb11 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:27.097323 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-d3ad718e-db35-4ed8-b3fc-a0e249affb11 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:27.109468 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-d3ad718e-db35-4ed8-b3fc-a0e249affb11 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1302 microversion: 2.1 time: 0.156422 Jul 11 11:26:27.110774 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 45/93] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:26 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1302 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:26:27.171183 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-97283ce9-0867-4d8d-a3c0-53357d576cc8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:27.178981 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-97283ce9-0867-4d8d-a3c0-53357d576cc8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:27.198903 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-97283ce9-0867-4d8d-a3c0-53357d576cc8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:27.199450 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-97283ce9-0867-4d8d-a3c0-53357d576cc8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:27.202514 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-97283ce9-0867-4d8d-a3c0-53357d576cc8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:27.203206 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-97283ce9-0867-4d8d-a3c0-53357d576cc8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:27.286105 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-97283ce9-0867-4d8d-a3c0-53357d576cc8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:27.307578 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-97283ce9-0867-4d8d-a3c0-53357d576cc8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1307 microversion: 2.1 time: 0.144873 Jul 11 11:26:27.308929 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 49/94] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:27 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1307 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:26:27.376101 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-21efa279-350b-4f7b-b844-99ea001dd6c2 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:27.376737 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-21efa279-350b-4f7b-b844-99ea001dd6c2 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] [instance: f9e44714-3285-489f-91df-091b85f4c56b] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:27.382961 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-21efa279-350b-4f7b-b844-99ea001dd6c2 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:27.383443 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-21efa279-350b-4f7b-b844-99ea001dd6c2 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:27.384260 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-21efa279-350b-4f7b-b844-99ea001dd6c2 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:27.384731 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-21efa279-350b-4f7b-b844-99ea001dd6c2 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:27.449152 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-4a93ca35-1935-4c56-a3ae-4ba0378392eb tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:27.449959 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-4a93ca35-1935-4c56-a3ae-4ba0378392eb tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:27.459102 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4a93ca35-1935-4c56-a3ae-4ba0378392eb tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:27.459644 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4a93ca35-1935-4c56-a3ae-4ba0378392eb tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:27.461384 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4a93ca35-1935-4c56-a3ae-4ba0378392eb tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:27.461944 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4a93ca35-1935-4c56-a3ae-4ba0378392eb tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:27.571347 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-21efa279-350b-4f7b-b844-99ea001dd6c2 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9ae0e6a2534bb0b5d5e9327b01b238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '877612289735450ea6bd527ebe7b81f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:27.579856 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-21efa279-350b-4f7b-b844-99ea001dd6c2 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] 10.222.0.26 "GET /compute/v2.1/servers/f9e44714-3285-489f-91df-091b85f4c56b" status: 200 len: 1315 microversion: 2.1 time: 0.208043 Jul 11 11:26:27.588411 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 46/95] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:27 2022] GET /compute/v2.1/servers/f9e44714-3285-489f-91df-091b85f4c56b => generated 1315 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:26:27.615702 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-4a93ca35-1935-4c56-a3ae-4ba0378392eb tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:27.623682 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-4a93ca35-1935-4c56-a3ae-4ba0378392eb tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:27.625196 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-4a93ca35-1935-4c56-a3ae-4ba0378392eb tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:27.660741 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-4a93ca35-1935-4c56-a3ae-4ba0378392eb tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1407 microversion: 2.20 time: 0.181899 Jul 11 11:26:27.660741 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 50/96] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:26:27 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1407 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 11:26:27.741842 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-33e29564-8242-4105-bda4-6f4d2fab201e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:27.742444 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-33e29564-8242-4105-bda4-6f4d2fab201e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 1df1a34e-6645-4776-ac7a-a03a47edeebe] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:27.748343 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-33e29564-8242-4105-bda4-6f4d2fab201e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:27.748794 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-33e29564-8242-4105-bda4-6f4d2fab201e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:27.749534 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-33e29564-8242-4105-bda4-6f4d2fab201e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:27.749959 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-33e29564-8242-4105-bda4-6f4d2fab201e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:27.902742 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-33e29564-8242-4105-bda4-6f4d2fab201e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:27.902742 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-33e29564-8242-4105-bda4-6f4d2fab201e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe" status: 200 len: 1321 microversion: 2.1 time: 0.159122 Jul 11 11:26:27.902742 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 47/97] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:27 2022] GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:26:28.127705 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-b4301ce5-580b-4bd3-a825-26f08d714bd9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:28.128236 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-b4301ce5-580b-4bd3-a825-26f08d714bd9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:28.134140 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b4301ce5-580b-4bd3-a825-26f08d714bd9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:28.138598 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b4301ce5-580b-4bd3-a825-26f08d714bd9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:28.139433 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b4301ce5-580b-4bd3-a825-26f08d714bd9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:28.139885 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b4301ce5-580b-4bd3-a825-26f08d714bd9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:28.203587 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-b4301ce5-580b-4bd3-a825-26f08d714bd9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:28.215306 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-b4301ce5-580b-4bd3-a825-26f08d714bd9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1312 microversion: 2.1 time: 0.091759 Jul 11 11:26:28.257359 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 51/98] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:28 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1312 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:26:28.327606 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-22826ae0-12ff-45b4-ab0c-0c586fc10457 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:28.328100 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-22826ae0-12ff-45b4-ab0c-0c586fc10457 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:28.335035 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-22826ae0-12ff-45b4-ab0c-0c586fc10457 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:28.335589 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-22826ae0-12ff-45b4-ab0c-0c586fc10457 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:28.336311 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-22826ae0-12ff-45b4-ab0c-0c586fc10457 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:28.336768 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-22826ae0-12ff-45b4-ab0c-0c586fc10457 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:28.418212 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-22826ae0-12ff-45b4-ab0c-0c586fc10457 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:28.426696 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-22826ae0-12ff-45b4-ab0c-0c586fc10457 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1295 microversion: 2.1 time: 0.103016 Jul 11 11:26:28.427621 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 48/99] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:28 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1295 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:26:28.564083 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [req-ecd2887c-8165-4d51-a19e-8bd9064804df req-8449e51e-9fd9-4adf-94a3-303903de0e4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b39fbe8d-e6a4-4482-981f-ac21c2b52176", "name": "network-vif-plugged", "status": "completed", "tag": "62a32eb2-256e-45ce-bcbf-411a778027d2"}]} {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:26:28.573365 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [req-ecd2887c-8165-4d51-a19e-8bd9064804df req-8449e51e-9fd9-4adf-94a3-303903de0e4f service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:28.573871 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [req-ecd2887c-8165-4d51-a19e-8bd9064804df req-8449e51e-9fd9-4adf-94a3-303903de0e4f service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:28.585773 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.compute.server_external_events [req-ecd2887c-8165-4d51-a19e-8bd9064804df req-8449e51e-9fd9-4adf-94a3-303903de0e4f service nova] Creating event network-vif-plugged:62a32eb2-256e-45ce-bcbf-411a778027d2 for instance b39fbe8d-e6a4-4482-981f-ac21c2b52176 on hv-cinder-84842 Jul 11 11:26:28.590896 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [req-ecd2887c-8165-4d51-a19e-8bd9064804df req-8449e51e-9fd9-4adf-94a3-303903de0e4f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085226 Jul 11 11:26:28.591788 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 52/100] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 11:26:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:26:28.598084 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-4b2a74ad-fa7a-4660-8c3d-4cd35d96e52a tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:28.598909 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-4b2a74ad-fa7a-4660-8c3d-4cd35d96e52a tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] [instance: f9e44714-3285-489f-91df-091b85f4c56b] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:28.605393 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4b2a74ad-fa7a-4660-8c3d-4cd35d96e52a tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:28.605834 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4b2a74ad-fa7a-4660-8c3d-4cd35d96e52a tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:28.606594 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4b2a74ad-fa7a-4660-8c3d-4cd35d96e52a tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:28.607021 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4b2a74ad-fa7a-4660-8c3d-4cd35d96e52a tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:28.633764 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=100 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:26:28.669150 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-082f1b2b-6238-49e2-9f2c-5b64cccbd869 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:28.669946 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-082f1b2b-6238-49e2-9f2c-5b64cccbd869 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:28.678908 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-082f1b2b-6238-49e2-9f2c-5b64cccbd869 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:28.679391 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-082f1b2b-6238-49e2-9f2c-5b64cccbd869 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:28.680173 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-082f1b2b-6238-49e2-9f2c-5b64cccbd869 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:28.680634 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-082f1b2b-6238-49e2-9f2c-5b64cccbd869 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:28.921756 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-4b2a74ad-fa7a-4660-8c3d-4cd35d96e52a tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9ae0e6a2534bb0b5d5e9327b01b238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '877612289735450ea6bd527ebe7b81f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:28.931197 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-4b2a74ad-fa7a-4660-8c3d-4cd35d96e52a tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] 10.222.0.26 "GET /compute/v2.1/servers/f9e44714-3285-489f-91df-091b85f4c56b" status: 200 len: 1315 microversion: 2.1 time: 0.336853 Jul 11 11:26:28.934078 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 49/101] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:28 2022] GET /compute/v2.1/servers/f9e44714-3285-489f-91df-091b85f4c56b => generated 1315 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:26:28.944183 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-797d5839-dc78-45bf-9f79-46038bc5683a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:28.948205 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-797d5839-dc78-45bf-9f79-46038bc5683a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 1df1a34e-6645-4776-ac7a-a03a47edeebe] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:28.966816 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-797d5839-dc78-45bf-9f79-46038bc5683a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:28.968837 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-797d5839-dc78-45bf-9f79-46038bc5683a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:28.971159 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-797d5839-dc78-45bf-9f79-46038bc5683a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:28.971874 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-797d5839-dc78-45bf-9f79-46038bc5683a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:29.211847 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-797d5839-dc78-45bf-9f79-46038bc5683a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:29.221293 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-797d5839-dc78-45bf-9f79-46038bc5683a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe" status: 200 len: 1321 microversion: 2.1 time: 0.285138 Jul 11 11:26:29.223404 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 50/102] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:28 2022] GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe => generated 1321 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:26:29.281298 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-a93ee9ba-7be5-463c-9818-218e157ded70 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:29.281998 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-a93ee9ba-7be5-463c-9818-218e157ded70 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:29.288801 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a93ee9ba-7be5-463c-9818-218e157ded70 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:29.289546 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a93ee9ba-7be5-463c-9818-218e157ded70 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:29.290328 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a93ee9ba-7be5-463c-9818-218e157ded70 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:29.290761 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a93ee9ba-7be5-463c-9818-218e157ded70 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:29.401179 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-082f1b2b-6238-49e2-9f2c-5b64cccbd869 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:29.410130 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-082f1b2b-6238-49e2-9f2c-5b64cccbd869 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:29.428351 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-082f1b2b-6238-49e2-9f2c-5b64cccbd869 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:29.428351 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-082f1b2b-6238-49e2-9f2c-5b64cccbd869 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1407 microversion: 2.20 time: 0.752607 Jul 11 11:26:29.428351 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 53/103] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:26:28 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1407 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 11:26:29.446840 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-a67902b2-3233-4671-9efe-89db3bf928d9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:29.447489 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-a67902b2-3233-4671-9efe-89db3bf928d9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:29.458486 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a67902b2-3233-4671-9efe-89db3bf928d9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:29.458933 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a67902b2-3233-4671-9efe-89db3bf928d9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:29.467865 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a67902b2-3233-4671-9efe-89db3bf928d9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:29.468508 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a67902b2-3233-4671-9efe-89db3bf928d9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:29.615843 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-a93ee9ba-7be5-463c-9818-218e157ded70 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:29.624205 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-a93ee9ba-7be5-463c-9818-218e157ded70 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1368 microversion: 2.1 time: 0.347015 Jul 11 11:26:29.635929 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 51/104] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:29 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1368 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:26:29.810621 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-a67902b2-3233-4671-9efe-89db3bf928d9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:29.820228 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-a67902b2-3233-4671-9efe-89db3bf928d9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1362 microversion: 2.1 time: 0.377348 Jul 11 11:26:29.831951 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 54/105] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:29 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1362 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:26:29.954470 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-4a4dc9dd-f554-49cc-b262-908142e0b880 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:29.955514 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-4a4dc9dd-f554-49cc-b262-908142e0b880 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] [instance: f9e44714-3285-489f-91df-091b85f4c56b] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:29.963077 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4a4dc9dd-f554-49cc-b262-908142e0b880 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:29.964128 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4a4dc9dd-f554-49cc-b262-908142e0b880 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:29.965301 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4a4dc9dd-f554-49cc-b262-908142e0b880 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:29.966128 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4a4dc9dd-f554-49cc-b262-908142e0b880 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:30.136072 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell0:SELECT=2 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:26:30.174302 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-4a4dc9dd-f554-49cc-b262-908142e0b880 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9ae0e6a2534bb0b5d5e9327b01b238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '877612289735450ea6bd527ebe7b81f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:30.183187 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-4a4dc9dd-f554-49cc-b262-908142e0b880 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] 10.222.0.26 "GET /compute/v2.1/servers/f9e44714-3285-489f-91df-091b85f4c56b" status: 200 len: 1315 microversion: 2.1 time: 0.235768 Jul 11 11:26:30.186034 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 52/106] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:29 2022] GET /compute/v2.1/servers/f9e44714-3285-489f-91df-091b85f4c56b => generated 1315 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:26:30.247179 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-61635aa2-0640-404f-bea9-d82a9e4b5d9b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:30.247179 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-61635aa2-0640-404f-bea9-d82a9e4b5d9b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 1df1a34e-6645-4776-ac7a-a03a47edeebe] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:30.249449 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell0:SELECT=8 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:26:30.257891 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-61635aa2-0640-404f-bea9-d82a9e4b5d9b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:30.258631 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-61635aa2-0640-404f-bea9-d82a9e4b5d9b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:30.259812 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-61635aa2-0640-404f-bea9-d82a9e4b5d9b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:30.260769 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-61635aa2-0640-404f-bea9-d82a9e4b5d9b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:30.440952 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-8eedbf32-332e-408e-8197-a187ff47db23 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:30.441693 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-8eedbf32-332e-408e-8197-a187ff47db23 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:30.444683 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell0:SELECT=6 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:26:30.454166 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8eedbf32-332e-408e-8197-a187ff47db23 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:30.454887 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8eedbf32-332e-408e-8197-a187ff47db23 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:30.457223 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8eedbf32-332e-408e-8197-a187ff47db23 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:30.457857 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8eedbf32-332e-408e-8197-a187ff47db23 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:30.775175 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-61635aa2-0640-404f-bea9-d82a9e4b5d9b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:30.794622 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-61635aa2-0640-404f-bea9-d82a9e4b5d9b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe" status: 200 len: 1321 microversion: 2.1 time: 0.551076 Jul 11 11:26:30.806925 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 55/107] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:30 2022] GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe => generated 1321 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:26:30.811497 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-c27f7a2c-f41f-41a8-9a13-88bce07bb535 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:30.812113 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-c27f7a2c-f41f-41a8-9a13-88bce07bb535 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:30.842062 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c27f7a2c-f41f-41a8-9a13-88bce07bb535 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:30.842575 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c27f7a2c-f41f-41a8-9a13-88bce07bb535 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:30.861872 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c27f7a2c-f41f-41a8-9a13-88bce07bb535 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:30.861872 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c27f7a2c-f41f-41a8-9a13-88bce07bb535 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:30.949070 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-8eedbf32-332e-408e-8197-a187ff47db23 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:30.968027 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-8eedbf32-332e-408e-8197-a187ff47db23 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:30.971824 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-8eedbf32-332e-408e-8197-a187ff47db23 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:30.975220 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-8eedbf32-332e-408e-8197-a187ff47db23 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1407 microversion: 2.20 time: 0.539999 Jul 11 11:26:30.993773 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 53/108] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:26:30 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1407 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 11:26:30.995834 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [req-d327ce5a-86b0-4d75-ba3a-4c704e24796a req-505e14ab-1f92-4546-a697-bcdf516f10f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ae01e39-7148-4e87-9ae0-a95832b38101", "tag": "b54d0e28-6ca3-4d14-ab22-34f6f328aee6"}]} {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:26:31.009942 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [req-d327ce5a-86b0-4d75-ba3a-4c704e24796a req-505e14ab-1f92-4546-a697-bcdf516f10f8 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:31.010772 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [req-d327ce5a-86b0-4d75-ba3a-4c704e24796a req-505e14ab-1f92-4546-a697-bcdf516f10f8 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:31.036849 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.compute.server_external_events [req-d327ce5a-86b0-4d75-ba3a-4c704e24796a req-505e14ab-1f92-4546-a697-bcdf516f10f8 service nova] Creating event network-changed:b54d0e28-6ca3-4d14-ab22-34f6f328aee6 for instance 3ae01e39-7148-4e87-9ae0-a95832b38101 on hv-cinder-84842 Jul 11 11:26:31.040886 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [req-d327ce5a-86b0-4d75-ba3a-4c704e24796a req-505e14ab-1f92-4546-a697-bcdf516f10f8 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118321) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 11 11:26:31.044982 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6a5141c4-e448-4b23-aba4-3e0e7efc3524 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:31.045793 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6a5141c4-e448-4b23-aba4-3e0e7efc3524 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:31.047490 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6a5141c4-e448-4b23-aba4-3e0e7efc3524 None None] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:31.048650 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6a5141c4-e448-4b23-aba4-3e0e7efc3524 None None] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:31.077278 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.compute.rpcapi [None req-6a5141c4-e448-4b23-aba4-3e0e7efc3524 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 11 11:26:31.080648 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6a5141c4-e448-4b23-aba4-3e0e7efc3524 None None] Releasing lock "compute-rpcapi-router" {{(pid=118321) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 11 11:26:31.103055 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-6a5141c4-e448-4b23-aba4-3e0e7efc3524 None None] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112192 Jul 11 11:26:31.104628 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 54/109] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 11:26:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:26:31.113241 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-6b90800a-9ca1-46d0-8cec-4e02bd16ee2a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:31.114022 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-6b90800a-9ca1-46d0-8cec-4e02bd16ee2a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:31.124011 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6b90800a-9ca1-46d0-8cec-4e02bd16ee2a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:31.124961 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6b90800a-9ca1-46d0-8cec-4e02bd16ee2a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:31.126452 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6b90800a-9ca1-46d0-8cec-4e02bd16ee2a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:31.126932 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6b90800a-9ca1-46d0-8cec-4e02bd16ee2a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:31.319991 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-6b90800a-9ca1-46d0-8cec-4e02bd16ee2a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:31.327730 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-6b90800a-9ca1-46d0-8cec-4e02bd16ee2a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1362 microversion: 2.1 time: 0.219660 Jul 11 11:26:31.337415 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 55/110] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:31 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1362 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:26:31.337415 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-9aad2135-f721-479e-b32d-577771a6488b tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:31.337415 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-9aad2135-f721-479e-b32d-577771a6488b tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] [instance: f9e44714-3285-489f-91df-091b85f4c56b] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:31.338581 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-c27f7a2c-f41f-41a8-9a13-88bce07bb535 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:31.348233 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9aad2135-f721-479e-b32d-577771a6488b tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:31.349314 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9aad2135-f721-479e-b32d-577771a6488b tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:31.350330 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9aad2135-f721-479e-b32d-577771a6488b tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:31.350759 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9aad2135-f721-479e-b32d-577771a6488b tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:31.352111 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-c27f7a2c-f41f-41a8-9a13-88bce07bb535 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1368 microversion: 2.1 time: 0.551819 Jul 11 11:26:31.352708 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 56/111] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:30 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1368 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:26:31.368487 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [req-fe40d484-3dfe-4fec-9f09-84a1ef2ccd61 req-ed3c8750-12e3-442e-890a-8ad53b6ea14b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a79e2f0-60e3-40b6-aac8-665c0d755ecb", "tag": "b79b3356-e75e-4e92-8475-6ae3bacc0147"}]} {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:26:31.377766 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [req-fe40d484-3dfe-4fec-9f09-84a1ef2ccd61 req-ed3c8750-12e3-442e-890a-8ad53b6ea14b service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:31.378213 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [req-fe40d484-3dfe-4fec-9f09-84a1ef2ccd61 req-ed3c8750-12e3-442e-890a-8ad53b6ea14b service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:31.392891 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.compute.server_external_events [req-fe40d484-3dfe-4fec-9f09-84a1ef2ccd61 req-ed3c8750-12e3-442e-890a-8ad53b6ea14b service nova] Creating event network-changed:b79b3356-e75e-4e92-8475-6ae3bacc0147 for instance 2a79e2f0-60e3-40b6-aac8-665c0d755ecb on hv-cinder-84842 Jul 11 11:26:31.397334 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [req-fe40d484-3dfe-4fec-9f09-84a1ef2ccd61 req-ed3c8750-12e3-442e-890a-8ad53b6ea14b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032424 Jul 11 11:26:31.398528 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 57/112] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 11:26:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:26:31.528558 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-9aad2135-f721-479e-b32d-577771a6488b tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9ae0e6a2534bb0b5d5e9327b01b238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '877612289735450ea6bd527ebe7b81f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:31.536792 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-9aad2135-f721-479e-b32d-577771a6488b tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] 10.222.0.26 "GET /compute/v2.1/servers/f9e44714-3285-489f-91df-091b85f4c56b" status: 200 len: 1315 microversion: 2.1 time: 0.206227 Jul 11 11:26:31.537375 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 56/113] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:31 2022] GET /compute/v2.1/servers/f9e44714-3285-489f-91df-091b85f4c56b => generated 1315 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:26:31.814972 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-e6e6548a-b6dc-450a-9033-0fd1cec1d6a2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:31.815698 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-e6e6548a-b6dc-450a-9033-0fd1cec1d6a2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 1df1a34e-6645-4776-ac7a-a03a47edeebe] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:31.822281 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e6e6548a-b6dc-450a-9033-0fd1cec1d6a2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:31.827390 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e6e6548a-b6dc-450a-9033-0fd1cec1d6a2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:31.827390 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e6e6548a-b6dc-450a-9033-0fd1cec1d6a2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:31.827390 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e6e6548a-b6dc-450a-9033-0fd1cec1d6a2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:31.995394 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-4bce1ec9-a9ad-4c8f-adeb-b623a1b09ad4 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:31.996075 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-4bce1ec9-a9ad-4c8f-adeb-b623a1b09ad4 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:32.010828 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4bce1ec9-a9ad-4c8f-adeb-b623a1b09ad4 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:32.011498 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4bce1ec9-a9ad-4c8f-adeb-b623a1b09ad4 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:32.012280 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4bce1ec9-a9ad-4c8f-adeb-b623a1b09ad4 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:32.012710 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4bce1ec9-a9ad-4c8f-adeb-b623a1b09ad4 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:32.197943 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-e6e6548a-b6dc-450a-9033-0fd1cec1d6a2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:32.206137 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-e6e6548a-b6dc-450a-9033-0fd1cec1d6a2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe" status: 200 len: 1321 microversion: 2.1 time: 0.395726 Jul 11 11:26:32.206769 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 58/114] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:31 2022] GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe => generated 1321 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:26:32.222323 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-4bce1ec9-a9ad-4c8f-adeb-b623a1b09ad4 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:32.230005 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-4bce1ec9-a9ad-4c8f-adeb-b623a1b09ad4 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:32.231525 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-4bce1ec9-a9ad-4c8f-adeb-b623a1b09ad4 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:32.232608 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-4bce1ec9-a9ad-4c8f-adeb-b623a1b09ad4 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1407 microversion: 2.20 time: 0.242399 Jul 11 11:26:32.233181 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 57/115] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:26:31 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1407 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:26:32.344338 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-8b7fc2e8-265c-434d-ba44-7892e9cc3a68 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:32.344909 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-8b7fc2e8-265c-434d-ba44-7892e9cc3a68 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:32.351139 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8b7fc2e8-265c-434d-ba44-7892e9cc3a68 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:32.351625 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8b7fc2e8-265c-434d-ba44-7892e9cc3a68 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:32.352381 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8b7fc2e8-265c-434d-ba44-7892e9cc3a68 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:32.352810 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8b7fc2e8-265c-434d-ba44-7892e9cc3a68 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:32.368858 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-727dff8b-c2c8-47f2-b330-3eaf2f579897 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:32.369489 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-727dff8b-c2c8-47f2-b330-3eaf2f579897 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:32.376069 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-727dff8b-c2c8-47f2-b330-3eaf2f579897 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:32.376556 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-727dff8b-c2c8-47f2-b330-3eaf2f579897 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:32.377364 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-727dff8b-c2c8-47f2-b330-3eaf2f579897 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:32.377812 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-727dff8b-c2c8-47f2-b330-3eaf2f579897 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:32.495931 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell0:SELECT=44 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:26:32.509177 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-8b7fc2e8-265c-434d-ba44-7892e9cc3a68 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:32.518699 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-8b7fc2e8-265c-434d-ba44-7892e9cc3a68 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1362 microversion: 2.1 time: 0.178138 Jul 11 11:26:32.519285 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 59/116] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:32 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1362 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:26:32.537618 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-727dff8b-c2c8-47f2-b330-3eaf2f579897 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:32.556971 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-727dff8b-c2c8-47f2-b330-3eaf2f579897 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1368 microversion: 2.1 time: 0.183363 Jul 11 11:26:32.556971 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 58/117] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:32 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1368 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:26:32.557140 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-94f5a9b8-3639-4a05-bfd9-f0f6fe61dae1 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:32.557140 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-94f5a9b8-3639-4a05-bfd9-f0f6fe61dae1 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] [instance: f9e44714-3285-489f-91df-091b85f4c56b] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:32.561669 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-94f5a9b8-3639-4a05-bfd9-f0f6fe61dae1 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:32.562117 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-94f5a9b8-3639-4a05-bfd9-f0f6fe61dae1 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:32.563466 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-94f5a9b8-3639-4a05-bfd9-f0f6fe61dae1 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:32.563900 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-94f5a9b8-3639-4a05-bfd9-f0f6fe61dae1 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:32.697030 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-94f5a9b8-3639-4a05-bfd9-f0f6fe61dae1 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9ae0e6a2534bb0b5d5e9327b01b238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '877612289735450ea6bd527ebe7b81f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:32.705043 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-94f5a9b8-3639-4a05-bfd9-f0f6fe61dae1 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] 10.222.0.26 "GET /compute/v2.1/servers/f9e44714-3285-489f-91df-091b85f4c56b" status: 200 len: 1315 microversion: 2.1 time: 0.155144 Jul 11 11:26:32.705731 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [req-d0c445e0-5201-41dd-a9b3-275f99ce5ed8 req-0d163913-2f52-419c-88f9-f2e71c89ba5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9e44714-3285-489f-91df-091b85f4c56b", "name": "network-vif-plugged", "status": "completed", "tag": "2f293575-af5f-45f7-a40b-ab11778b5e6c"}]} {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:26:32.705965 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 60/118] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:32 2022] GET /compute/v2.1/servers/f9e44714-3285-489f-91df-091b85f4c56b => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:26:32.719080 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [req-d0c445e0-5201-41dd-a9b3-275f99ce5ed8 req-0d163913-2f52-419c-88f9-f2e71c89ba5c service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:32.719666 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [req-d0c445e0-5201-41dd-a9b3-275f99ce5ed8 req-0d163913-2f52-419c-88f9-f2e71c89ba5c service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:32.731279 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.compute.server_external_events [req-d0c445e0-5201-41dd-a9b3-275f99ce5ed8 req-0d163913-2f52-419c-88f9-f2e71c89ba5c service nova] Creating event network-vif-plugged:2f293575-af5f-45f7-a40b-ab11778b5e6c for instance f9e44714-3285-489f-91df-091b85f4c56b on hv-cinder-84842 Jul 11 11:26:32.736387 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [req-d0c445e0-5201-41dd-a9b3-275f99ce5ed8 req-0d163913-2f52-419c-88f9-f2e71c89ba5c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038989 Jul 11 11:26:32.740577 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 59/119] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 11:26:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:26:33.222672 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-fe9d713b-bca5-4723-882f-7ec784d510d0 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:33.223866 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-fe9d713b-bca5-4723-882f-7ec784d510d0 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 1df1a34e-6645-4776-ac7a-a03a47edeebe] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:33.231159 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fe9d713b-bca5-4723-882f-7ec784d510d0 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:33.231968 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fe9d713b-bca5-4723-882f-7ec784d510d0 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:33.234490 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fe9d713b-bca5-4723-882f-7ec784d510d0 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:33.236120 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fe9d713b-bca5-4723-882f-7ec784d510d0 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:33.252127 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-32b97d7a-3b7f-47e7-b85f-2b7fd992924d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:33.252697 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-32b97d7a-3b7f-47e7-b85f-2b7fd992924d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:33.259312 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-32b97d7a-3b7f-47e7-b85f-2b7fd992924d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:33.259784 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-32b97d7a-3b7f-47e7-b85f-2b7fd992924d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:33.260545 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-32b97d7a-3b7f-47e7-b85f-2b7fd992924d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:33.260965 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-32b97d7a-3b7f-47e7-b85f-2b7fd992924d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:33.536856 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-32b97d7a-3b7f-47e7-b85f-2b7fd992924d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:33.550947 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-32b97d7a-3b7f-47e7-b85f-2b7fd992924d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:33.552834 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-32b97d7a-3b7f-47e7-b85f-2b7fd992924d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:33.554574 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-32b97d7a-3b7f-47e7-b85f-2b7fd992924d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1407 microversion: 2.20 time: 0.307198 Jul 11 11:26:33.566022 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 60/120] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:26:33 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1407 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 11:26:33.572340 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-09d9f273-9909-47f7-80e9-13d720d0c7d3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:33.573151 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-09d9f273-9909-47f7-80e9-13d720d0c7d3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:33.581638 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-09d9f273-9909-47f7-80e9-13d720d0c7d3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:33.582240 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-09d9f273-9909-47f7-80e9-13d720d0c7d3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:33.583154 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-09d9f273-9909-47f7-80e9-13d720d0c7d3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:33.583760 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-09d9f273-9909-47f7-80e9-13d720d0c7d3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:33.763636 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-09d9f273-9909-47f7-80e9-13d720d0c7d3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:33.773217 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-09d9f273-9909-47f7-80e9-13d720d0c7d3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1362 microversion: 2.1 time: 0.205612 Jul 11 11:26:33.774274 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 61/121] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:33 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1362 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:26:33.779422 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-9920b51b-8649-4ae4-a266-941adfe2929b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:33.780265 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-9920b51b-8649-4ae4-a266-941adfe2929b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:33.789415 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9920b51b-8649-4ae4-a266-941adfe2929b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:33.790129 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9920b51b-8649-4ae4-a266-941adfe2929b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:33.790903 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9920b51b-8649-4ae4-a266-941adfe2929b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:33.791417 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9920b51b-8649-4ae4-a266-941adfe2929b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:33.793396 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-fe9d713b-bca5-4723-882f-7ec784d510d0 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:33.802484 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-fe9d713b-bca5-4723-882f-7ec784d510d0 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe" status: 200 len: 1321 microversion: 2.1 time: 0.583806 Jul 11 11:26:33.803325 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 61/122] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:33 2022] GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe => generated 1321 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:26:33.808444 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-436a35ee-b916-4665-818a-723e717c5147 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:33.809244 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-436a35ee-b916-4665-818a-723e717c5147 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] [instance: f9e44714-3285-489f-91df-091b85f4c56b] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:33.815548 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-436a35ee-b916-4665-818a-723e717c5147 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:33.816273 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-436a35ee-b916-4665-818a-723e717c5147 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:33.817424 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-436a35ee-b916-4665-818a-723e717c5147 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:33.818036 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-436a35ee-b916-4665-818a-723e717c5147 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:33.967227 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-9920b51b-8649-4ae4-a266-941adfe2929b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:33.975736 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-9920b51b-8649-4ae4-a266-941adfe2929b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1368 microversion: 2.1 time: 0.200361 Jul 11 11:26:33.986545 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 62/123] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:33 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1368 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:26:34.040915 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-436a35ee-b916-4665-818a-723e717c5147 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9ae0e6a2534bb0b5d5e9327b01b238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '877612289735450ea6bd527ebe7b81f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:34.044327 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=100 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:26:34.049081 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-436a35ee-b916-4665-818a-723e717c5147 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] 10.222.0.26 "GET /compute/v2.1/servers/f9e44714-3285-489f-91df-091b85f4c56b" status: 200 len: 1315 microversion: 2.1 time: 0.244641 Jul 11 11:26:34.055581 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 62/124] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:33 2022] GET /compute/v2.1/servers/f9e44714-3285-489f-91df-091b85f4c56b => generated 1315 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:26:34.574696 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-142831ea-f989-4bed-bd71-13992b436872 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:34.575458 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-142831ea-f989-4bed-bd71-13992b436872 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:34.589241 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-142831ea-f989-4bed-bd71-13992b436872 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:34.589241 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-142831ea-f989-4bed-bd71-13992b436872 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:34.589241 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-142831ea-f989-4bed-bd71-13992b436872 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:34.589241 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-142831ea-f989-4bed-bd71-13992b436872 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:34.731083 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-142831ea-f989-4bed-bd71-13992b436872 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:34.741150 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-142831ea-f989-4bed-bd71-13992b436872 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:34.751402 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-142831ea-f989-4bed-bd71-13992b436872 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:34.763092 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-142831ea-f989-4bed-bd71-13992b436872 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1407 microversion: 2.20 time: 0.183839 Jul 11 11:26:34.763092 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 63/125] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:26:34 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1407 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:26:34.763688 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [req-1087ffbe-db75-4f77-9c14-ce058c4d7006 req-3eb73765-27e5-4611-9d5e-aaacb420352c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1df1a34e-6645-4776-ac7a-a03a47edeebe", "name": "network-vif-plugged", "status": "completed", "tag": "65cc413d-9788-4b74-9e0d-f6d26d9bc4f5"}, {"server_uuid": "4b0ec960-6583-4639-9658-a850655eb703", "name": "network-vif-plugged", "status": "completed", "tag": "fb396fac-9f6d-4448-a468-adea47f3003f"}]} {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:26:34.770455 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [req-1087ffbe-db75-4f77-9c14-ce058c4d7006 req-3eb73765-27e5-4611-9d5e-aaacb420352c service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:34.770893 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [req-1087ffbe-db75-4f77-9c14-ce058c4d7006 req-3eb73765-27e5-4611-9d5e-aaacb420352c service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:34.784146 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.compute.server_external_events [req-1087ffbe-db75-4f77-9c14-ce058c4d7006 req-3eb73765-27e5-4611-9d5e-aaacb420352c service nova] Creating event network-vif-plugged:65cc413d-9788-4b74-9e0d-f6d26d9bc4f5 for instance 1df1a34e-6645-4776-ac7a-a03a47edeebe on hv-cinder-84842 Jul 11 11:26:34.790966 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.compute.server_external_events [req-1087ffbe-db75-4f77-9c14-ce058c4d7006 req-3eb73765-27e5-4611-9d5e-aaacb420352c service nova] Creating event network-vif-plugged:fb396fac-9f6d-4448-a468-adea47f3003f for instance 4b0ec960-6583-4639-9658-a850655eb703 on hv-cinder-84842 Jul 11 11:26:34.791670 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-d8f07e63-c643-40c8-a507-592506cb248c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:34.791772 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [req-1087ffbe-db75-4f77-9c14-ce058c4d7006 req-3eb73765-27e5-4611-9d5e-aaacb420352c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.041703 Jul 11 11:26:34.792439 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-d8f07e63-c643-40c8-a507-592506cb248c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:34.792741 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 63/126] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 11:26:34 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:26:34.804230 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d8f07e63-c643-40c8-a507-592506cb248c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:34.804363 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d8f07e63-c643-40c8-a507-592506cb248c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:34.805114 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d8f07e63-c643-40c8-a507-592506cb248c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:34.805744 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d8f07e63-c643-40c8-a507-592506cb248c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:34.831917 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-68b4f091-5042-41dc-95a1-55ba0a0e101e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:34.840101 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-68b4f091-5042-41dc-95a1-55ba0a0e101e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 1df1a34e-6645-4776-ac7a-a03a47edeebe] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:34.851616 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-68b4f091-5042-41dc-95a1-55ba0a0e101e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:34.852478 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-68b4f091-5042-41dc-95a1-55ba0a0e101e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:34.853671 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-68b4f091-5042-41dc-95a1-55ba0a0e101e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:34.854320 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-68b4f091-5042-41dc-95a1-55ba0a0e101e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:34.985673 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-d8f07e63-c643-40c8-a507-592506cb248c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:35.007349 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-d8f07e63-c643-40c8-a507-592506cb248c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1362 microversion: 2.1 time: 0.220305 Jul 11 11:26:35.022219 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 64/127] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:34 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1362 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:26:35.035429 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-f353bbff-206e-471f-9315-a3953902b45c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:35.038726 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-f353bbff-206e-471f-9315-a3953902b45c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:35.063577 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f353bbff-206e-471f-9315-a3953902b45c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:35.064462 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f353bbff-206e-471f-9315-a3953902b45c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:35.077769 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f353bbff-206e-471f-9315-a3953902b45c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:35.080133 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f353bbff-206e-471f-9315-a3953902b45c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:35.082101 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-68b4f091-5042-41dc-95a1-55ba0a0e101e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:35.093312 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-68b4f091-5042-41dc-95a1-55ba0a0e101e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe" status: 200 len: 1321 microversion: 2.1 time: 0.272390 Jul 11 11:26:35.096665 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 64/128] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:34 2022] GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe => generated 1321 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:26:35.106519 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-aa5480f7-bb30-4005-8ac6-189f8ee1aef9 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:35.110706 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-aa5480f7-bb30-4005-8ac6-189f8ee1aef9 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] [instance: f9e44714-3285-489f-91df-091b85f4c56b] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:35.133609 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-aa5480f7-bb30-4005-8ac6-189f8ee1aef9 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:35.133609 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-aa5480f7-bb30-4005-8ac6-189f8ee1aef9 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:35.133609 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-aa5480f7-bb30-4005-8ac6-189f8ee1aef9 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:35.133609 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-aa5480f7-bb30-4005-8ac6-189f8ee1aef9 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:35.311392 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-f353bbff-206e-471f-9315-a3953902b45c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:35.320658 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-f353bbff-206e-471f-9315-a3953902b45c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1368 microversion: 2.1 time: 0.297052 Jul 11 11:26:35.322631 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 65/129] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:35 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1368 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:26:35.438993 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-aa5480f7-bb30-4005-8ac6-189f8ee1aef9 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9ae0e6a2534bb0b5d5e9327b01b238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '877612289735450ea6bd527ebe7b81f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:35.447696 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-aa5480f7-bb30-4005-8ac6-189f8ee1aef9 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] 10.222.0.26 "GET /compute/v2.1/servers/f9e44714-3285-489f-91df-091b85f4c56b" status: 200 len: 1315 microversion: 2.1 time: 0.349890 Jul 11 11:26:35.451151 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 65/130] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:35 2022] GET /compute/v2.1/servers/f9e44714-3285-489f-91df-091b85f4c56b => generated 1315 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:26:35.772193 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-a5d6a7c0-c03a-4fd5-8a05-ab2107ebaffd tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:35.773104 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-a5d6a7c0-c03a-4fd5-8a05-ab2107ebaffd tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:35.780899 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a5d6a7c0-c03a-4fd5-8a05-ab2107ebaffd tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:35.781833 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a5d6a7c0-c03a-4fd5-8a05-ab2107ebaffd tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:35.782849 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a5d6a7c0-c03a-4fd5-8a05-ab2107ebaffd tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:35.783778 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a5d6a7c0-c03a-4fd5-8a05-ab2107ebaffd tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:35.929794 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-a5d6a7c0-c03a-4fd5-8a05-ab2107ebaffd tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:35.956534 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-a5d6a7c0-c03a-4fd5-8a05-ab2107ebaffd tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:35.958584 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-a5d6a7c0-c03a-4fd5-8a05-ab2107ebaffd tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:35.959967 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-a5d6a7c0-c03a-4fd5-8a05-ab2107ebaffd tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1407 microversion: 2.20 time: 0.193133 Jul 11 11:26:35.971985 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 66/131] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:26:35 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1407 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:26:36.026843 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-ebc90293-a435-47e3-ae69-af3c74c3bd10 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:36.027530 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-ebc90293-a435-47e3-ae69-af3c74c3bd10 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:36.034522 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ebc90293-a435-47e3-ae69-af3c74c3bd10 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:36.034971 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ebc90293-a435-47e3-ae69-af3c74c3bd10 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:36.035758 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ebc90293-a435-47e3-ae69-af3c74c3bd10 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:36.036185 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ebc90293-a435-47e3-ae69-af3c74c3bd10 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:36.110777 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-5d223694-fa9f-409e-86ea-f41feadeb0fd tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:36.111428 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-5d223694-fa9f-409e-86ea-f41feadeb0fd tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 1df1a34e-6645-4776-ac7a-a03a47edeebe] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:36.117667 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5d223694-fa9f-409e-86ea-f41feadeb0fd tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:36.118113 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5d223694-fa9f-409e-86ea-f41feadeb0fd tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:36.118899 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5d223694-fa9f-409e-86ea-f41feadeb0fd tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:36.119608 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5d223694-fa9f-409e-86ea-f41feadeb0fd tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:36.141418 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=100 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:26:36.223635 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-ebc90293-a435-47e3-ae69-af3c74c3bd10 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:36.233862 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-ebc90293-a435-47e3-ae69-af3c74c3bd10 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1362 microversion: 2.1 time: 0.209389 Jul 11 11:26:36.235679 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 66/132] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:36 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1362 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:26:36.331480 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-5d223694-fa9f-409e-86ea-f41feadeb0fd tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:36.340963 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-f343126a-f82f-4987-983e-c35012394b20 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:36.341823 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-f343126a-f82f-4987-983e-c35012394b20 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:36.349570 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-5d223694-fa9f-409e-86ea-f41feadeb0fd tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe" status: 200 len: 1321 microversion: 2.1 time: 0.242689 Jul 11 11:26:36.353136 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f343126a-f82f-4987-983e-c35012394b20 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:36.353577 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f343126a-f82f-4987-983e-c35012394b20 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:36.354331 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f343126a-f82f-4987-983e-c35012394b20 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:36.355120 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 67/133] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:36 2022] GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe => generated 1321 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:26:36.355890 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f343126a-f82f-4987-983e-c35012394b20 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:36.466488 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-0941a4d1-5247-4518-957c-38669d8bfd96 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:36.475287 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-0941a4d1-5247-4518-957c-38669d8bfd96 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] [instance: f9e44714-3285-489f-91df-091b85f4c56b] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:36.485100 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0941a4d1-5247-4518-957c-38669d8bfd96 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:36.485969 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0941a4d1-5247-4518-957c-38669d8bfd96 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:36.487866 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0941a4d1-5247-4518-957c-38669d8bfd96 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:36.488502 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0941a4d1-5247-4518-957c-38669d8bfd96 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:36.544321 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-f343126a-f82f-4987-983e-c35012394b20 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:36.567813 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-f343126a-f82f-4987-983e-c35012394b20 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1368 microversion: 2.1 time: 0.232879 Jul 11 11:26:36.579478 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 67/134] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:36 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1368 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:26:36.685469 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-0941a4d1-5247-4518-957c-38669d8bfd96 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9ae0e6a2534bb0b5d5e9327b01b238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '877612289735450ea6bd527ebe7b81f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:36.695280 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-0941a4d1-5247-4518-957c-38669d8bfd96 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] 10.222.0.26 "GET /compute/v2.1/servers/f9e44714-3285-489f-91df-091b85f4c56b" status: 200 len: 1502 microversion: 2.1 time: 0.233185 Jul 11 11:26:36.708502 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 68/135] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:36 2022] GET /compute/v2.1/servers/f9e44714-3285-489f-91df-091b85f4c56b => generated 1502 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:26:36.925087 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [req-4eb8a380-3100-4a35-8157-e7b775f2b478 req-34cca476-28f7-4145-b908-e95ea981bbf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ae01e39-7148-4e87-9ae0-a95832b38101", "name": "network-vif-plugged", "status": "completed", "tag": "b54d0e28-6ca3-4d14-ab22-34f6f328aee6"}]} {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:26:36.930609 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:26:36.934997 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [req-4eb8a380-3100-4a35-8157-e7b775f2b478 req-34cca476-28f7-4145-b908-e95ea981bbf5 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:36.935512 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [req-4eb8a380-3100-4a35-8157-e7b775f2b478 req-34cca476-28f7-4145-b908-e95ea981bbf5 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:36.946441 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.compute.server_external_events [req-4eb8a380-3100-4a35-8157-e7b775f2b478 req-34cca476-28f7-4145-b908-e95ea981bbf5 service nova] Creating event network-vif-plugged:b54d0e28-6ca3-4d14-ab22-34f6f328aee6 for instance 3ae01e39-7148-4e87-9ae0-a95832b38101 on hv-cinder-84842 Jul 11 11:26:36.951890 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [req-4eb8a380-3100-4a35-8157-e7b775f2b478 req-34cca476-28f7-4145-b908-e95ea981bbf5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031520 Jul 11 11:26:36.952891 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 68/136] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 11:26:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:26:36.980966 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-aae63084-6857-48fa-9065-ab71deeb5c26 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:36.981574 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-aae63084-6857-48fa-9065-ab71deeb5c26 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:36.990072 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-aae63084-6857-48fa-9065-ab71deeb5c26 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:36.990494 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-aae63084-6857-48fa-9065-ab71deeb5c26 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:36.991186 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-aae63084-6857-48fa-9065-ab71deeb5c26 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:36.991791 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-aae63084-6857-48fa-9065-ab71deeb5c26 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:37.154598 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-aae63084-6857-48fa-9065-ab71deeb5c26 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:37.163713 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-aae63084-6857-48fa-9065-ab71deeb5c26 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:37.165758 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-aae63084-6857-48fa-9065-ab71deeb5c26 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:37.167054 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-aae63084-6857-48fa-9065-ab71deeb5c26 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1407 microversion: 2.20 time: 0.190002 Jul 11 11:26:37.168835 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 69/137] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:26:36 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1407 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:26:37.257536 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-b9b39e92-91de-41b9-8378-d548a08894c4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:37.257536 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-b9b39e92-91de-41b9-8378-d548a08894c4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:37.264006 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b9b39e92-91de-41b9-8378-d548a08894c4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:37.264636 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b9b39e92-91de-41b9-8378-d548a08894c4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:37.265603 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b9b39e92-91de-41b9-8378-d548a08894c4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:37.266905 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b9b39e92-91de-41b9-8378-d548a08894c4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:37.372878 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-569f3911-3e1b-4f46-857d-eb75354ee59c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:37.377465 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-569f3911-3e1b-4f46-857d-eb75354ee59c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 1df1a34e-6645-4776-ac7a-a03a47edeebe] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:37.382290 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-569f3911-3e1b-4f46-857d-eb75354ee59c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:37.382964 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-569f3911-3e1b-4f46-857d-eb75354ee59c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:37.384611 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-569f3911-3e1b-4f46-857d-eb75354ee59c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:37.385240 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-569f3911-3e1b-4f46-857d-eb75354ee59c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:37.412688 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-b9b39e92-91de-41b9-8378-d548a08894c4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:37.421807 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-b9b39e92-91de-41b9-8378-d548a08894c4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1362 microversion: 2.1 time: 0.173101 Jul 11 11:26:37.423669 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 69/138] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:37 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:26:37.560635 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-569f3911-3e1b-4f46-857d-eb75354ee59c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:37.569503 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-569f3911-3e1b-4f46-857d-eb75354ee59c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe" status: 200 len: 1321 microversion: 2.1 time: 0.200824 Jul 11 11:26:37.580733 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 70/139] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:37 2022] GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe => generated 1321 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:26:37.587595 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-bbb9ebd0-0872-4d90-9f14-3bc0b4b43745 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:37.588442 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-bbb9ebd0-0872-4d90-9f14-3bc0b4b43745 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:37.603776 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-bbb9ebd0-0872-4d90-9f14-3bc0b4b43745 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:37.603776 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-bbb9ebd0-0872-4d90-9f14-3bc0b4b43745 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:37.621835 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-bbb9ebd0-0872-4d90-9f14-3bc0b4b43745 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:37.621835 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-bbb9ebd0-0872-4d90-9f14-3bc0b4b43745 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:37.821948 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-bbb9ebd0-0872-4d90-9f14-3bc0b4b43745 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:37.829691 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-bbb9ebd0-0872-4d90-9f14-3bc0b4b43745 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1368 microversion: 2.1 time: 0.248338 Jul 11 11:26:37.830250 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 70/140] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:37 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1368 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:26:38.186077 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-11ba1d2f-0950-4a9d-987c-4cb9b9155e8e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:38.186805 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-11ba1d2f-0950-4a9d-987c-4cb9b9155e8e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:38.193746 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-11ba1d2f-0950-4a9d-987c-4cb9b9155e8e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:38.194201 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-11ba1d2f-0950-4a9d-987c-4cb9b9155e8e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:38.194956 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-11ba1d2f-0950-4a9d-987c-4cb9b9155e8e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:38.195418 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-11ba1d2f-0950-4a9d-987c-4cb9b9155e8e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:38.333307 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-11ba1d2f-0950-4a9d-987c-4cb9b9155e8e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:38.341571 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-11ba1d2f-0950-4a9d-987c-4cb9b9155e8e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:38.343067 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-11ba1d2f-0950-4a9d-987c-4cb9b9155e8e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:38.345001 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-11ba1d2f-0950-4a9d-987c-4cb9b9155e8e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1600 microversion: 2.20 time: 0.162623 Jul 11 11:26:38.345150 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 71/141] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:26:38 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1600 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:26:38.362694 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-6040c857-179c-4262-a062-bc2fb662b411 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:38.363299 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-6040c857-179c-4262-a062-bc2fb662b411 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:38.370002 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6040c857-179c-4262-a062-bc2fb662b411 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:38.370454 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6040c857-179c-4262-a062-bc2fb662b411 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:38.371289 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6040c857-179c-4262-a062-bc2fb662b411 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:38.373800 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6040c857-179c-4262-a062-bc2fb662b411 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:38.454223 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-59eceed7-8dc3-4ede-a0b0-e4d122f3c20d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:38.456798 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-59eceed7-8dc3-4ede-a0b0-e4d122f3c20d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:38.473425 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-59eceed7-8dc3-4ede-a0b0-e4d122f3c20d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:38.476573 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-59eceed7-8dc3-4ede-a0b0-e4d122f3c20d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:38.477540 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-59eceed7-8dc3-4ede-a0b0-e4d122f3c20d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:38.478153 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-59eceed7-8dc3-4ede-a0b0-e4d122f3c20d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:38.563631 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-6040c857-179c-4262-a062-bc2fb662b411 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.205166 Jul 11 11:26:38.564992 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 71/142] 10.222.0.26 () {60 vars in 1315 bytes} [Mon Jul 11 11:26:38 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703/os-interface => generated 285 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 11:26:38.589025 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-a178f732-21b5-4fcb-8675-088e74549a31 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:38.589636 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-a178f732-21b5-4fcb-8675-088e74549a31 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 1df1a34e-6645-4776-ac7a-a03a47edeebe] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:38.596864 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a178f732-21b5-4fcb-8675-088e74549a31 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:38.597632 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a178f732-21b5-4fcb-8675-088e74549a31 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:38.598555 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a178f732-21b5-4fcb-8675-088e74549a31 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:38.599231 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a178f732-21b5-4fcb-8675-088e74549a31 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:38.872454 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-a178f732-21b5-4fcb-8675-088e74549a31 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:38.885392 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-a178f732-21b5-4fcb-8675-088e74549a31 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe" status: 200 len: 1515 microversion: 2.1 time: 0.297939 Jul 11 11:26:38.885392 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 72/143] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:38 2022] GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe => generated 1515 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:26:38.888763 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-eb7b315a-6d17-4ba7-9d39-35b3f466387d tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2cc03811-fb69-4a29-8b03-2acd3d5db252"}} {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:26:38.890047 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-eb7b315a-6d17-4ba7-9d39-35b3f466387d tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] [instance: f9e44714-3285-489f-91df-091b85f4c56b] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:38.897621 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-eb7b315a-6d17-4ba7-9d39-35b3f466387d tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:38.898320 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-eb7b315a-6d17-4ba7-9d39-35b3f466387d tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:38.900203 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-eb7b315a-6d17-4ba7-9d39-35b3f466387d tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:38.901446 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-eb7b315a-6d17-4ba7-9d39-35b3f466387d tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:38.980679 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-59eceed7-8dc3-4ede-a0b0-e4d122f3c20d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:38.988550 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-59eceed7-8dc3-4ede-a0b0-e4d122f3c20d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1362 microversion: 2.1 time: 0.552294 Jul 11 11:26:38.998999 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 72/144] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:38 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1362 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:26:39.004200 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-53cb14de-6665-4f23-81d9-a3f0d47d3c5d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:39.004989 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-53cb14de-6665-4f23-81d9-a3f0d47d3c5d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:39.012399 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-53cb14de-6665-4f23-81d9-a3f0d47d3c5d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:39.013005 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-53cb14de-6665-4f23-81d9-a3f0d47d3c5d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:39.013777 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-53cb14de-6665-4f23-81d9-a3f0d47d3c5d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:39.014207 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-53cb14de-6665-4f23-81d9-a3f0d47d3c5d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:39.279992 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-53cb14de-6665-4f23-81d9-a3f0d47d3c5d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:39.288093 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-53cb14de-6665-4f23-81d9-a3f0d47d3c5d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1368 microversion: 2.1 time: 0.287644 Jul 11 11:26:39.288666 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 73/145] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:38 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1368 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:26:39.307554 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-f2e022a9-fb82-430d-9649-f340c87cedc0 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:26:39.307554 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-f2e022a9-fb82-430d-9649-f340c87cedc0 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 1df1a34e-6645-4776-ac7a-a03a47edeebe] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:39.317724 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f2e022a9-fb82-430d-9649-f340c87cedc0 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:39.318427 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f2e022a9-fb82-430d-9649-f340c87cedc0 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:39.319199 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f2e022a9-fb82-430d-9649-f340c87cedc0 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:39.319948 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f2e022a9-fb82-430d-9649-f340c87cedc0 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:39.383511 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.objects.instance [None req-f2e022a9-fb82-430d-9649-f340c87cedc0 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lazy-loading 'flavor' on Instance uuid 1df1a34e-6645-4776-ac7a-a03a47edeebe {{(pid=118321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 11:26:39.747951 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-f2e022a9-fb82-430d-9649-f340c87cedc0 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "POST /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe/action" status: 200 len: 32 microversion: 2.1 time: 0.447091 Jul 11 11:26:39.751539 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 74/146] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Jul 11 11:26:39 2022] POST /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe/action => generated 32 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 11 11:26:39.759689 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [req-c391bee3-b4ff-44b8-abd7-cc8e5c038719 req-c2ed2fd4-46e7-4372-bead-a8667d147b91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a79e2f0-60e3-40b6-aac8-665c0d755ecb", "name": "network-vif-plugged", "status": "completed", "tag": "b79b3356-e75e-4e92-8475-6ae3bacc0147"}]} {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:26:39.768228 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [req-c391bee3-b4ff-44b8-abd7-cc8e5c038719 req-c2ed2fd4-46e7-4372-bead-a8667d147b91 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:39.768713 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [req-c391bee3-b4ff-44b8-abd7-cc8e5c038719 req-c2ed2fd4-46e7-4372-bead-a8667d147b91 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:39.779322 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.compute.server_external_events [req-c391bee3-b4ff-44b8-abd7-cc8e5c038719 req-c2ed2fd4-46e7-4372-bead-a8667d147b91 service nova] Creating event network-vif-plugged:b79b3356-e75e-4e92-8475-6ae3bacc0147 for instance 2a79e2f0-60e3-40b6-aac8-665c0d755ecb on hv-cinder-84842 Jul 11 11:26:39.784043 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [req-c391bee3-b4ff-44b8-abd7-cc8e5c038719 req-c2ed2fd4-46e7-4372-bead-a8667d147b91 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031115 Jul 11 11:26:39.784626 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 75/147] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 11:26:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:26:39.789426 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-d5a95913-cd38-4cf6-8216-1ae5de227a80 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:39.790100 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-d5a95913-cd38-4cf6-8216-1ae5de227a80 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 1df1a34e-6645-4776-ac7a-a03a47edeebe] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:39.792017 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:26:39.796727 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d5a95913-cd38-4cf6-8216-1ae5de227a80 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:39.797680 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d5a95913-cd38-4cf6-8216-1ae5de227a80 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:39.798424 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d5a95913-cd38-4cf6-8216-1ae5de227a80 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:39.798848 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d5a95913-cd38-4cf6-8216-1ae5de227a80 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:40.046295 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-d5a95913-cd38-4cf6-8216-1ae5de227a80 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:40.054692 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-d5a95913-cd38-4cf6-8216-1ae5de227a80 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe" status: 200 len: 1521 microversion: 2.1 time: 0.268928 Jul 11 11:26:40.055474 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 76/148] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:39 2022] GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe => generated 1521 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:26:40.059876 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-9d338a8f-0a41-4483-83d2-31bb6be1b802 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:40.060527 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-9d338a8f-0a41-4483-83d2-31bb6be1b802 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:40.066179 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9d338a8f-0a41-4483-83d2-31bb6be1b802 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:40.078037 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9d338a8f-0a41-4483-83d2-31bb6be1b802 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:40.081823 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9d338a8f-0a41-4483-83d2-31bb6be1b802 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:40.082298 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9d338a8f-0a41-4483-83d2-31bb6be1b802 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:40.306465 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-9d338a8f-0a41-4483-83d2-31bb6be1b802 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:40.314142 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-9d338a8f-0a41-4483-83d2-31bb6be1b802 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1362 microversion: 2.1 time: 0.257745 Jul 11 11:26:40.314719 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 77/149] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:40 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1362 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:26:40.323046 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-14ea6489-9fec-49d4-b695-d0d7d9704650 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:40.325042 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-14ea6489-9fec-49d4-b695-d0d7d9704650 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:40.335818 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-14ea6489-9fec-49d4-b695-d0d7d9704650 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:40.336655 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-eb7b315a-6d17-4ba7-9d39-35b3f466387d tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] 10.222.0.26 "POST /compute/v2.1/servers/f9e44714-3285-489f-91df-091b85f4c56b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.452008 Jul 11 11:26:40.338088 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-14ea6489-9fec-49d4-b695-d0d7d9704650 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:40.339031 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-14ea6489-9fec-49d4-b695-d0d7d9704650 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:40.344382 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 73/150] 10.222.0.26 () {60 vars in 1322 bytes} [Mon Jul 11 11:26:38 2022] POST /compute/v2.1/servers/f9e44714-3285-489f-91df-091b85f4c56b/os-volume_attachments => generated 194 bytes in 1460 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:26:40.346529 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-14ea6489-9fec-49d4-b695-d0d7d9704650 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:40.617511 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-14ea6489-9fec-49d4-b695-d0d7d9704650 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:40.624713 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [req-f67ca846-4b01-4d64-a194-2e3a8b458e5b req-1d4bdfcd-00ab-42f4-a980-057b91ec12a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b0ec960-6583-4639-9658-a850655eb703", "tag": "fb396fac-9f6d-4448-a468-adea47f3003f"}]} {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:26:40.635047 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [req-f67ca846-4b01-4d64-a194-2e3a8b458e5b req-1d4bdfcd-00ab-42f4-a980-057b91ec12a4 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:40.635748 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [req-f67ca846-4b01-4d64-a194-2e3a8b458e5b req-1d4bdfcd-00ab-42f4-a980-057b91ec12a4 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:40.643453 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-14ea6489-9fec-49d4-b695-d0d7d9704650 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1368 microversion: 2.1 time: 0.322050 Jul 11 11:26:40.645085 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 78/151] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:40 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1368 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:26:40.657102 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.compute.server_external_events [req-f67ca846-4b01-4d64-a194-2e3a8b458e5b req-1d4bdfcd-00ab-42f4-a980-057b91ec12a4 service nova] Creating event network-changed:fb396fac-9f6d-4448-a468-adea47f3003f for instance 4b0ec960-6583-4639-9658-a850655eb703 on hv-cinder-84842 Jul 11 11:26:40.665418 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [req-f67ca846-4b01-4d64-a194-2e3a8b458e5b req-1d4bdfcd-00ab-42f4-a980-057b91ec12a4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045516 Jul 11 11:26:40.673507 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 74/152] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 11:26:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:26:41.082618 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-1b56727d-9530-479e-a326-34a267375a13 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:41.084000 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-1b56727d-9530-479e-a326-34a267375a13 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 1df1a34e-6645-4776-ac7a-a03a47edeebe] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:41.092770 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1b56727d-9530-479e-a326-34a267375a13 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:41.094274 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1b56727d-9530-479e-a326-34a267375a13 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:41.096222 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1b56727d-9530-479e-a326-34a267375a13 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:41.096957 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1b56727d-9530-479e-a326-34a267375a13 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:41.127195 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell0:SELECT=2 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:26:41.332835 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-15f4544b-5e2c-4a7d-a002-adf84df1d9de tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:41.333544 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-15f4544b-5e2c-4a7d-a002-adf84df1d9de tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:41.351125 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-15f4544b-5e2c-4a7d-a002-adf84df1d9de tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:41.351838 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-15f4544b-5e2c-4a7d-a002-adf84df1d9de tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:41.352377 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-15f4544b-5e2c-4a7d-a002-adf84df1d9de tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:41.352842 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-15f4544b-5e2c-4a7d-a002-adf84df1d9de tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:41.483450 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-1b56727d-9530-479e-a326-34a267375a13 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:41.519603 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-1b56727d-9530-479e-a326-34a267375a13 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe" status: 200 len: 1521 microversion: 2.1 time: 0.442809 Jul 11 11:26:41.527742 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 79/153] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:41 2022] GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe => generated 1521 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:26:41.574327 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-15f4544b-5e2c-4a7d-a002-adf84df1d9de tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:41.582493 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-15f4544b-5e2c-4a7d-a002-adf84df1d9de tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1362 microversion: 2.1 time: 0.254380 Jul 11 11:26:41.583071 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 75/154] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:41 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1362 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:26:41.661928 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-8f94764e-2874-4aa9-a079-8f8923523efa tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:41.662532 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-8f94764e-2874-4aa9-a079-8f8923523efa tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:41.668614 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8f94764e-2874-4aa9-a079-8f8923523efa tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:41.669056 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8f94764e-2874-4aa9-a079-8f8923523efa tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:41.670260 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8f94764e-2874-4aa9-a079-8f8923523efa tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:41.670260 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8f94764e-2874-4aa9-a079-8f8923523efa tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:41.817379 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-8f94764e-2874-4aa9-a079-8f8923523efa tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:41.825624 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-8f94764e-2874-4aa9-a079-8f8923523efa tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1559 microversion: 2.1 time: 0.167468 Jul 11 11:26:41.835984 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 80/155] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:41 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:26:41.845226 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-aa949a5d-968e-4019-b20a-16532fa4b8fe tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:41.845686 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-aa949a5d-968e-4019-b20a-16532fa4b8fe tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:41.853728 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-aa949a5d-968e-4019-b20a-16532fa4b8fe tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:41.854235 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-aa949a5d-968e-4019-b20a-16532fa4b8fe tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:41.854978 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-aa949a5d-968e-4019-b20a-16532fa4b8fe tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:41.855484 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-aa949a5d-968e-4019-b20a-16532fa4b8fe tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:41.944357 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-aa949a5d-968e-4019-b20a-16532fa4b8fe tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.103512 Jul 11 11:26:41.944956 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 76/156] 10.222.0.26 () {58 vars in 1274 bytes} [Mon Jul 11 11:26:41 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-interface => generated 285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:26:42.541536 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-7663f4af-4e30-4a58-9e94-1cf875c0afd1 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:42.542141 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-7663f4af-4e30-4a58-9e94-1cf875c0afd1 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 1df1a34e-6645-4776-ac7a-a03a47edeebe] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:42.555997 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7663f4af-4e30-4a58-9e94-1cf875c0afd1 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:42.556436 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7663f4af-4e30-4a58-9e94-1cf875c0afd1 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:42.557530 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7663f4af-4e30-4a58-9e94-1cf875c0afd1 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:42.558330 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7663f4af-4e30-4a58-9e94-1cf875c0afd1 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:42.600661 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-c1bbf457-56e3-4b91-958f-ea87c1f34854 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:42.601337 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-c1bbf457-56e3-4b91-958f-ea87c1f34854 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:42.607830 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c1bbf457-56e3-4b91-958f-ea87c1f34854 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:42.611324 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c1bbf457-56e3-4b91-958f-ea87c1f34854 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:42.612370 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c1bbf457-56e3-4b91-958f-ea87c1f34854 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:42.612963 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c1bbf457-56e3-4b91-958f-ea87c1f34854 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:42.746600 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-7663f4af-4e30-4a58-9e94-1cf875c0afd1 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:42.754847 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-7663f4af-4e30-4a58-9e94-1cf875c0afd1 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe" status: 200 len: 1521 microversion: 2.1 time: 0.217754 Jul 11 11:26:42.755461 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 81/157] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:42 2022] GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:26:43.086188 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-c1bbf457-56e3-4b91-958f-ea87c1f34854 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:43.086188 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-c1bbf457-56e3-4b91-958f-ea87c1f34854 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1362 microversion: 2.1 time: 0.488671 Jul 11 11:26:43.086188 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 77/158] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:42 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1362 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:26:43.719878 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [req-0c279d4e-b498-4ab1-b1e4-936a2dba8e34 req-49f0e023-88e4-4ea3-8d62-8b27e848d9e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ae01e39-7148-4e87-9ae0-a95832b38101", "tag": "b54d0e28-6ca3-4d14-ab22-34f6f328aee6"}]} {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:26:43.738227 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [req-0c279d4e-b498-4ab1-b1e4-936a2dba8e34 req-49f0e023-88e4-4ea3-8d62-8b27e848d9e8 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:43.738817 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [req-0c279d4e-b498-4ab1-b1e4-936a2dba8e34 req-49f0e023-88e4-4ea3-8d62-8b27e848d9e8 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:43.751490 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.compute.server_external_events [req-0c279d4e-b498-4ab1-b1e4-936a2dba8e34 req-49f0e023-88e4-4ea3-8d62-8b27e848d9e8 service nova] Creating event network-changed:b54d0e28-6ca3-4d14-ab22-34f6f328aee6 for instance 3ae01e39-7148-4e87-9ae0-a95832b38101 on hv-cinder-84842 Jul 11 11:26:43.757098 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [req-0c279d4e-b498-4ab1-b1e4-936a2dba8e34 req-49f0e023-88e4-4ea3-8d62-8b27e848d9e8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040839 Jul 11 11:26:43.757796 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 82/159] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 11:26:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:26:43.772111 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-35e3012b-02f6-4ad7-ac64-c0dd4f19d7d6 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:43.772715 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-35e3012b-02f6-4ad7-ac64-c0dd4f19d7d6 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 1df1a34e-6645-4776-ac7a-a03a47edeebe] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:43.778896 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-35e3012b-02f6-4ad7-ac64-c0dd4f19d7d6 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:43.779400 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-35e3012b-02f6-4ad7-ac64-c0dd4f19d7d6 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:43.780163 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-35e3012b-02f6-4ad7-ac64-c0dd4f19d7d6 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:43.780586 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-35e3012b-02f6-4ad7-ac64-c0dd4f19d7d6 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:43.922816 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-35e3012b-02f6-4ad7-ac64-c0dd4f19d7d6 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:43.932418 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-35e3012b-02f6-4ad7-ac64-c0dd4f19d7d6 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe" status: 200 len: 1521 microversion: 2.1 time: 0.164115 Jul 11 11:26:43.933230 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 78/160] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:43 2022] GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:26:44.102635 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-f5dc673a-9353-4e7d-802b-287550bce33b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:44.103378 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-f5dc673a-9353-4e7d-802b-287550bce33b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:44.110217 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f5dc673a-9353-4e7d-802b-287550bce33b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:44.110666 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f5dc673a-9353-4e7d-802b-287550bce33b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:44.111473 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f5dc673a-9353-4e7d-802b-287550bce33b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:44.111906 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f5dc673a-9353-4e7d-802b-287550bce33b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:44.115953 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:26:44.250814 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-f5dc673a-9353-4e7d-802b-287550bce33b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:44.258222 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-f5dc673a-9353-4e7d-802b-287550bce33b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1362 microversion: 2.1 time: 0.159911 Jul 11 11:26:44.258878 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 83/161] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:44 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:26:44.950251 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-47f5cdf8-2c00-4e01-a7ee-2251fb12e877 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:44.950861 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-47f5cdf8-2c00-4e01-a7ee-2251fb12e877 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 1df1a34e-6645-4776-ac7a-a03a47edeebe] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:44.963096 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-47f5cdf8-2c00-4e01-a7ee-2251fb12e877 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:44.963574 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-47f5cdf8-2c00-4e01-a7ee-2251fb12e877 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:44.966687 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-47f5cdf8-2c00-4e01-a7ee-2251fb12e877 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:44.971433 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-47f5cdf8-2c00-4e01-a7ee-2251fb12e877 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:45.247714 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-47f5cdf8-2c00-4e01-a7ee-2251fb12e877 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:45.258393 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-47f5cdf8-2c00-4e01-a7ee-2251fb12e877 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe" status: 200 len: 1521 microversion: 2.1 time: 0.312482 Jul 11 11:26:45.259367 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 79/162] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:44 2022] GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe => generated 1521 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:26:45.276561 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-0ffe3042-dbfe-441b-8b03-074f549a674a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:45.277278 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-0ffe3042-dbfe-441b-8b03-074f549a674a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:45.286676 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0ffe3042-dbfe-441b-8b03-074f549a674a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:45.287273 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0ffe3042-dbfe-441b-8b03-074f549a674a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:45.288053 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0ffe3042-dbfe-441b-8b03-074f549a674a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:45.288493 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0ffe3042-dbfe-441b-8b03-074f549a674a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:45.482123 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-0ffe3042-dbfe-441b-8b03-074f549a674a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:45.491812 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-0ffe3042-dbfe-441b-8b03-074f549a674a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1362 microversion: 2.1 time: 0.219183 Jul 11 11:26:45.492803 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 84/163] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:45 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1362 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:26:46.279152 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-009b3b59-2837-45ae-a8db-370d0be2e2ff tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:46.279834 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-009b3b59-2837-45ae-a8db-370d0be2e2ff tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 1df1a34e-6645-4776-ac7a-a03a47edeebe] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:46.288111 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-009b3b59-2837-45ae-a8db-370d0be2e2ff tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:46.290975 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-009b3b59-2837-45ae-a8db-370d0be2e2ff tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:46.291800 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-009b3b59-2837-45ae-a8db-370d0be2e2ff tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:46.292237 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-009b3b59-2837-45ae-a8db-370d0be2e2ff tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:46.466957 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-009b3b59-2837-45ae-a8db-370d0be2e2ff tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:46.471491 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:26:46.476465 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-009b3b59-2837-45ae-a8db-370d0be2e2ff tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe" status: 200 len: 1521 microversion: 2.1 time: 0.201126 Jul 11 11:26:46.479367 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 80/164] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:46 2022] GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:26:46.511160 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-a996e1a3-d715-45e5-9b52-7767094f3ebe tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:46.512365 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-a996e1a3-d715-45e5-9b52-7767094f3ebe tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:46.518207 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a996e1a3-d715-45e5-9b52-7767094f3ebe tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:46.518873 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a996e1a3-d715-45e5-9b52-7767094f3ebe tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:46.519655 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a996e1a3-d715-45e5-9b52-7767094f3ebe tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:46.520171 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a996e1a3-d715-45e5-9b52-7767094f3ebe tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:46.650906 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-a996e1a3-d715-45e5-9b52-7767094f3ebe tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:46.658161 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-a996e1a3-d715-45e5-9b52-7767094f3ebe tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1548 microversion: 2.1 time: 0.152506 Jul 11 11:26:46.658731 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 85/165] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:46 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1548 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:26:46.676734 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-5598d85f-f729-4549-8d57-bb147a4b072e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:46.677356 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-5598d85f-f729-4549-8d57-bb147a4b072e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:46.684647 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5598d85f-f729-4549-8d57-bb147a4b072e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:46.685089 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5598d85f-f729-4549-8d57-bb147a4b072e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:46.685950 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5598d85f-f729-4549-8d57-bb147a4b072e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:46.686472 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5598d85f-f729-4549-8d57-bb147a4b072e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:46.779028 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-5598d85f-f729-4549-8d57-bb147a4b072e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101788 Jul 11 11:26:46.779028 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 81/166] 10.222.0.26 () {58 vars in 1274 bytes} [Mon Jul 11 11:26:46 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:26:47.494024 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-f945a0f2-26a0-4ab0-8ad1-be5bee56dfc3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:47.495138 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-f945a0f2-26a0-4ab0-8ad1-be5bee56dfc3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 1df1a34e-6645-4776-ac7a-a03a47edeebe] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:47.501666 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f945a0f2-26a0-4ab0-8ad1-be5bee56dfc3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:47.502103 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f945a0f2-26a0-4ab0-8ad1-be5bee56dfc3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:47.502878 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f945a0f2-26a0-4ab0-8ad1-be5bee56dfc3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:47.503330 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f945a0f2-26a0-4ab0-8ad1-be5bee56dfc3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:47.646125 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-f945a0f2-26a0-4ab0-8ad1-be5bee56dfc3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:47.654900 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-f945a0f2-26a0-4ab0-8ad1-be5bee56dfc3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe" status: 200 len: 1521 microversion: 2.1 time: 0.165004 Jul 11 11:26:47.658969 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 86/167] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:47 2022] GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:26:48.143542 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [req-d0e78026-9d65-4a32-b898-8ff87e96fea7 req-550a7efa-a25b-4171-bff8-768a43fbf9d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a79e2f0-60e3-40b6-aac8-665c0d755ecb", "tag": "b79b3356-e75e-4e92-8475-6ae3bacc0147"}]} {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:26:48.153451 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [req-d0e78026-9d65-4a32-b898-8ff87e96fea7 req-550a7efa-a25b-4171-bff8-768a43fbf9d4 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:48.153970 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [req-d0e78026-9d65-4a32-b898-8ff87e96fea7 req-550a7efa-a25b-4171-bff8-768a43fbf9d4 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:48.165953 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.compute.server_external_events [req-d0e78026-9d65-4a32-b898-8ff87e96fea7 req-550a7efa-a25b-4171-bff8-768a43fbf9d4 service nova] Creating event network-changed:b79b3356-e75e-4e92-8475-6ae3bacc0147 for instance 2a79e2f0-60e3-40b6-aac8-665c0d755ecb on hv-cinder-84842 Jul 11 11:26:48.172532 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [req-d0e78026-9d65-4a32-b898-8ff87e96fea7 req-550a7efa-a25b-4171-bff8-768a43fbf9d4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034213 Jul 11 11:26:48.173164 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 82/168] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 11:26:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:26:48.675182 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-72eb1fd4-f2b9-435c-a579-7c1de1a339f8 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:48.676378 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-72eb1fd4-f2b9-435c-a579-7c1de1a339f8 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 1df1a34e-6645-4776-ac7a-a03a47edeebe] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:48.682614 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-72eb1fd4-f2b9-435c-a579-7c1de1a339f8 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:48.683139 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-72eb1fd4-f2b9-435c-a579-7c1de1a339f8 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:48.684182 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-72eb1fd4-f2b9-435c-a579-7c1de1a339f8 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:48.684687 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-72eb1fd4-f2b9-435c-a579-7c1de1a339f8 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:48.872290 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-72eb1fd4-f2b9-435c-a579-7c1de1a339f8 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:48.879938 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-72eb1fd4-f2b9-435c-a579-7c1de1a339f8 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe" status: 200 len: 1521 microversion: 2.1 time: 0.208591 Jul 11 11:26:48.880807 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 87/169] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:48 2022] GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:26:49.898059 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-6ea67fc4-15be-4d9d-a269-b723eca800b2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:49.898767 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-6ea67fc4-15be-4d9d-a269-b723eca800b2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 1df1a34e-6645-4776-ac7a-a03a47edeebe] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:49.909459 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6ea67fc4-15be-4d9d-a269-b723eca800b2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:49.909914 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6ea67fc4-15be-4d9d-a269-b723eca800b2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:49.910696 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6ea67fc4-15be-4d9d-a269-b723eca800b2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:49.911206 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6ea67fc4-15be-4d9d-a269-b723eca800b2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:50.042256 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-6ea67fc4-15be-4d9d-a269-b723eca800b2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:50.050266 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-6ea67fc4-15be-4d9d-a269-b723eca800b2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe" status: 200 len: 1521 microversion: 2.1 time: 0.157182 Jul 11 11:26:50.056578 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 83/170] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:49 2022] GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:26:51.066644 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-675328ce-2073-4a69-b1ac-accb24fcebae tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:51.067226 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-675328ce-2073-4a69-b1ac-accb24fcebae tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 1df1a34e-6645-4776-ac7a-a03a47edeebe] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:51.073407 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-675328ce-2073-4a69-b1ac-accb24fcebae tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:51.073897 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-675328ce-2073-4a69-b1ac-accb24fcebae tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:51.074682 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-675328ce-2073-4a69-b1ac-accb24fcebae tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:51.075593 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-675328ce-2073-4a69-b1ac-accb24fcebae tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:51.224265 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-675328ce-2073-4a69-b1ac-accb24fcebae tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:51.231778 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-675328ce-2073-4a69-b1ac-accb24fcebae tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe" status: 200 len: 1521 microversion: 2.1 time: 0.168928 Jul 11 11:26:51.232343 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 88/171] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:51 2022] GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:26:52.249247 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-868337a6-92bb-49f0-aa3f-27801c6bb7f4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:52.250448 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-868337a6-92bb-49f0-aa3f-27801c6bb7f4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 1df1a34e-6645-4776-ac7a-a03a47edeebe] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:52.257563 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-868337a6-92bb-49f0-aa3f-27801c6bb7f4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:52.258078 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-868337a6-92bb-49f0-aa3f-27801c6bb7f4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:52.258795 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-868337a6-92bb-49f0-aa3f-27801c6bb7f4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:52.259230 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-868337a6-92bb-49f0-aa3f-27801c6bb7f4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:52.398413 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-868337a6-92bb-49f0-aa3f-27801c6bb7f4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:52.406860 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-868337a6-92bb-49f0-aa3f-27801c6bb7f4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe" status: 200 len: 1521 microversion: 2.1 time: 0.161572 Jul 11 11:26:52.407714 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 84/172] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:52 2022] GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:26:53.360382 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-bcff5a52-b231-4366-ae61-d179a7cce2e0 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:53.360925 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-bcff5a52-b231-4366-ae61-d179a7cce2e0 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] [instance: f9e44714-3285-489f-91df-091b85f4c56b] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:53.366622 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bcff5a52-b231-4366-ae61-d179a7cce2e0 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:53.367480 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bcff5a52-b231-4366-ae61-d179a7cce2e0 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:53.367818 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bcff5a52-b231-4366-ae61-d179a7cce2e0 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:53.368240 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bcff5a52-b231-4366-ae61-d179a7cce2e0 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:53.395361 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-bcff5a52-b231-4366-ae61-d179a7cce2e0 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] [instance: f9e44714-3285-489f-91df-091b85f4c56b] Going to try to terminate instance {{(pid=118321) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 11:26:53.424827 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-8d269b34-f8f2-47ba-8fe1-aa4c08105ad9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:53.426334 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-8d269b34-f8f2-47ba-8fe1-aa4c08105ad9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 1df1a34e-6645-4776-ac7a-a03a47edeebe] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:53.432679 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8d269b34-f8f2-47ba-8fe1-aa4c08105ad9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:53.433121 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8d269b34-f8f2-47ba-8fe1-aa4c08105ad9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:53.433867 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8d269b34-f8f2-47ba-8fe1-aa4c08105ad9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:53.434293 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8d269b34-f8f2-47ba-8fe1-aa4c08105ad9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:53.565817 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-8d269b34-f8f2-47ba-8fe1-aa4c08105ad9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:53.573402 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-8d269b34-f8f2-47ba-8fe1-aa4c08105ad9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe" status: 200 len: 1521 microversion: 2.1 time: 0.152362 Jul 11 11:26:53.574283 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 85/173] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:53 2022] GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:26:53.777538 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-bcff5a52-b231-4366-ae61-d179a7cce2e0 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f9e44714-3285-489f-91df-091b85f4c56b" status: 204 len: 0 microversion: 2.1 time: 0.415962 Jul 11 11:26:53.781609 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 89/174] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 11 11:26:53 2022] DELETE /compute/v2.1/servers/f9e44714-3285-489f-91df-091b85f4c56b => generated 0 bytes in 423 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 11 11:26:53.787876 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-1a09560b-4ca0-42fc-84e7-475a2dff5d4e tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:53.788501 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-1a09560b-4ca0-42fc-84e7-475a2dff5d4e tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] [instance: f9e44714-3285-489f-91df-091b85f4c56b] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:53.805002 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1a09560b-4ca0-42fc-84e7-475a2dff5d4e tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:53.805614 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1a09560b-4ca0-42fc-84e7-475a2dff5d4e tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:53.806564 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1a09560b-4ca0-42fc-84e7-475a2dff5d4e tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:53.807158 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1a09560b-4ca0-42fc-84e7-475a2dff5d4e tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:53.952370 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-1a09560b-4ca0-42fc-84e7-475a2dff5d4e tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9ae0e6a2534bb0b5d5e9327b01b238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '877612289735450ea6bd527ebe7b81f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:53.961740 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-1a09560b-4ca0-42fc-84e7-475a2dff5d4e tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] 10.222.0.26 "GET /compute/v2.1/servers/f9e44714-3285-489f-91df-091b85f4c56b" status: 200 len: 1554 microversion: 2.1 time: 0.178973 Jul 11 11:26:53.969388 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 86/175] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:53 2022] GET /compute/v2.1/servers/f9e44714-3285-489f-91df-091b85f4c56b => generated 1554 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:26:54.591396 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-2e1dca8e-c9cd-4029-a42b-30b04625f8a1 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:54.592086 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-2e1dca8e-c9cd-4029-a42b-30b04625f8a1 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 1df1a34e-6645-4776-ac7a-a03a47edeebe] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:54.598574 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2e1dca8e-c9cd-4029-a42b-30b04625f8a1 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:54.598953 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2e1dca8e-c9cd-4029-a42b-30b04625f8a1 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:54.599724 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2e1dca8e-c9cd-4029-a42b-30b04625f8a1 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:54.600156 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2e1dca8e-c9cd-4029-a42b-30b04625f8a1 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:54.727523 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-2e1dca8e-c9cd-4029-a42b-30b04625f8a1 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:54.735329 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-2e1dca8e-c9cd-4029-a42b-30b04625f8a1 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe" status: 200 len: 1521 microversion: 2.1 time: 0.148126 Jul 11 11:26:54.735897 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 90/176] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:54 2022] GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:26:54.979507 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-66694435-1c7b-43de-be13-246e643ba408 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:54.980099 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-66694435-1c7b-43de-be13-246e643ba408 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] [instance: f9e44714-3285-489f-91df-091b85f4c56b] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:54.986693 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-66694435-1c7b-43de-be13-246e643ba408 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:54.987144 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-66694435-1c7b-43de-be13-246e643ba408 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:54.987936 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-66694435-1c7b-43de-be13-246e643ba408 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:54.988369 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-66694435-1c7b-43de-be13-246e643ba408 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:55.143821 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-66694435-1c7b-43de-be13-246e643ba408 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9ae0e6a2534bb0b5d5e9327b01b238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '877612289735450ea6bd527ebe7b81f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:55.155135 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-66694435-1c7b-43de-be13-246e643ba408 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] 10.222.0.26 "GET /compute/v2.1/servers/f9e44714-3285-489f-91df-091b85f4c56b" status: 200 len: 1554 microversion: 2.1 time: 0.179751 Jul 11 11:26:55.155753 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 87/177] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:54 2022] GET /compute/v2.1/servers/f9e44714-3285-489f-91df-091b85f4c56b => generated 1554 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:26:55.753101 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-9ec116bd-7588-4e8d-a553-c8b43dade7d5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:55.753788 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-9ec116bd-7588-4e8d-a553-c8b43dade7d5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 1df1a34e-6645-4776-ac7a-a03a47edeebe] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:55.759771 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9ec116bd-7588-4e8d-a553-c8b43dade7d5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:55.760219 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9ec116bd-7588-4e8d-a553-c8b43dade7d5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:55.760978 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9ec116bd-7588-4e8d-a553-c8b43dade7d5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:55.761464 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9ec116bd-7588-4e8d-a553-c8b43dade7d5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:55.899838 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-9ec116bd-7588-4e8d-a553-c8b43dade7d5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:55.907758 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-9ec116bd-7588-4e8d-a553-c8b43dade7d5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe" status: 200 len: 1521 microversion: 2.1 time: 0.159406 Jul 11 11:26:55.908326 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 91/178] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:55 2022] GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:26:56.172340 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-8b1bb863-341d-43b7-8afd-9e8634336173 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:56.172935 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-8b1bb863-341d-43b7-8afd-9e8634336173 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] [instance: f9e44714-3285-489f-91df-091b85f4c56b] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:56.179976 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8b1bb863-341d-43b7-8afd-9e8634336173 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:56.188400 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8b1bb863-341d-43b7-8afd-9e8634336173 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:56.188400 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8b1bb863-341d-43b7-8afd-9e8634336173 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:56.188400 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8b1bb863-341d-43b7-8afd-9e8634336173 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:56.334447 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-8b1bb863-341d-43b7-8afd-9e8634336173 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9ae0e6a2534bb0b5d5e9327b01b238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '877612289735450ea6bd527ebe7b81f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:56.349113 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-8b1bb863-341d-43b7-8afd-9e8634336173 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] 10.222.0.26 "GET /compute/v2.1/servers/f9e44714-3285-489f-91df-091b85f4c56b" status: 200 len: 1554 microversion: 2.1 time: 0.180558 Jul 11 11:26:56.349700 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 88/179] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:56 2022] GET /compute/v2.1/servers/f9e44714-3285-489f-91df-091b85f4c56b => generated 1554 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:26:56.911678 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [req-53183a6d-2638-40a8-9436-4f8ecce1bdf8 req-a430c254-977f-4b3a-8ced-6efc99953304 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9e44714-3285-489f-91df-091b85f4c56b", "name": "network-vif-deleted", "tag": "2f293575-af5f-45f7-a40b-ab11778b5e6c"}]} {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:26:56.924177 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [req-53183a6d-2638-40a8-9436-4f8ecce1bdf8 req-a430c254-977f-4b3a-8ced-6efc99953304 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:56.924177 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [req-53183a6d-2638-40a8-9436-4f8ecce1bdf8 req-a430c254-977f-4b3a-8ced-6efc99953304 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:56.927728 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-d2dbe450-feb7-464d-87f9-4753e9882363 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:56.929672 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-d2dbe450-feb7-464d-87f9-4753e9882363 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 1df1a34e-6645-4776-ac7a-a03a47edeebe] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:56.937511 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.compute.server_external_events [req-53183a6d-2638-40a8-9436-4f8ecce1bdf8 req-a430c254-977f-4b3a-8ced-6efc99953304 service nova] Creating event network-vif-deleted:2f293575-af5f-45f7-a40b-ab11778b5e6c for instance f9e44714-3285-489f-91df-091b85f4c56b on hv-cinder-84842 Jul 11 11:26:56.939191 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d2dbe450-feb7-464d-87f9-4753e9882363 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:56.939856 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d2dbe450-feb7-464d-87f9-4753e9882363 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:56.941576 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d2dbe450-feb7-464d-87f9-4753e9882363 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:56.942387 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d2dbe450-feb7-464d-87f9-4753e9882363 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:56.943857 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [req-53183a6d-2638-40a8-9436-4f8ecce1bdf8 req-a430c254-977f-4b3a-8ced-6efc99953304 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035476 Jul 11 11:26:56.944643 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 92/180] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 11:26:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:26:57.100552 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-d2dbe450-feb7-464d-87f9-4753e9882363 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:57.109073 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-d2dbe450-feb7-464d-87f9-4753e9882363 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe" status: 200 len: 1521 microversion: 2.1 time: 0.187757 Jul 11 11:26:57.109824 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 89/181] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:56 2022] GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:26:57.366299 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-733aa82e-8ea7-49b3-bebe-dd0afd30e6ea tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:57.367215 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-733aa82e-8ea7-49b3-bebe-dd0afd30e6ea tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] [instance: f9e44714-3285-489f-91df-091b85f4c56b] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:57.373900 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-733aa82e-8ea7-49b3-bebe-dd0afd30e6ea tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:57.374421 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-733aa82e-8ea7-49b3-bebe-dd0afd30e6ea tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:57.375422 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-733aa82e-8ea7-49b3-bebe-dd0afd30e6ea tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:57.375950 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-733aa82e-8ea7-49b3-bebe-dd0afd30e6ea tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:57.438211 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-733aa82e-8ea7-49b3-bebe-dd0afd30e6ea tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9ae0e6a2534bb0b5d5e9327b01b238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '877612289735450ea6bd527ebe7b81f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:57.446074 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-733aa82e-8ea7-49b3-bebe-dd0afd30e6ea tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] 10.222.0.26 "GET /compute/v2.1/servers/f9e44714-3285-489f-91df-091b85f4c56b" status: 200 len: 1346 microversion: 2.1 time: 0.083930 Jul 11 11:26:57.448151 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 93/182] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:57 2022] GET /compute/v2.1/servers/f9e44714-3285-489f-91df-091b85f4c56b => generated 1346 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:26:58.126763 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-377fb609-6cfb-463c-8e1d-dc791bf43454 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:58.127400 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-377fb609-6cfb-463c-8e1d-dc791bf43454 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 1df1a34e-6645-4776-ac7a-a03a47edeebe] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:58.134077 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-377fb609-6cfb-463c-8e1d-dc791bf43454 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:58.134548 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-377fb609-6cfb-463c-8e1d-dc791bf43454 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:58.135313 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-377fb609-6cfb-463c-8e1d-dc791bf43454 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:58.143136 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-377fb609-6cfb-463c-8e1d-dc791bf43454 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:58.311979 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-377fb609-6cfb-463c-8e1d-dc791bf43454 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:58.320232 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-377fb609-6cfb-463c-8e1d-dc791bf43454 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe" status: 200 len: 1521 microversion: 2.1 time: 0.198126 Jul 11 11:26:58.328696 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 90/183] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:58 2022] GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:26:58.463010 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-5cc023bc-b724-4cc2-8b30-bdedb9dda358 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:58.463655 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-5cc023bc-b724-4cc2-8b30-bdedb9dda358 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] [instance: f9e44714-3285-489f-91df-091b85f4c56b] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:58.476116 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5cc023bc-b724-4cc2-8b30-bdedb9dda358 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:58.479368 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5cc023bc-b724-4cc2-8b30-bdedb9dda358 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:58.479368 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5cc023bc-b724-4cc2-8b30-bdedb9dda358 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:58.479368 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5cc023bc-b724-4cc2-8b30-bdedb9dda358 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:58.523742 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5cc023bc-b724-4cc2-8b30-bdedb9dda358 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:58.524194 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5cc023bc-b724-4cc2-8b30-bdedb9dda358 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:58.524635 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.objects.instance [None req-5cc023bc-b724-4cc2-8b30-bdedb9dda358 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lazy-loading 'fault' on Instance uuid f9e44714-3285-489f-91df-091b85f4c56b {{(pid=118321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 11:26:58.578968 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-5cc023bc-b724-4cc2-8b30-bdedb9dda358 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9ae0e6a2534bb0b5d5e9327b01b238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '877612289735450ea6bd527ebe7b81f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:58.588415 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-5cc023bc-b724-4cc2-8b30-bdedb9dda358 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] 10.222.0.26 "GET /compute/v2.1/servers/f9e44714-3285-489f-91df-091b85f4c56b" status: 200 len: 1351 microversion: 2.1 time: 0.129947 Jul 11 11:26:58.589310 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 94/184] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:58 2022] GET /compute/v2.1/servers/f9e44714-3285-489f-91df-091b85f4c56b => generated 1351 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:26:59.337823 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-d854b571-27c7-4343-bfb5-0300ab93699a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:59.338431 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-d854b571-27c7-4343-bfb5-0300ab93699a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 1df1a34e-6645-4776-ac7a-a03a47edeebe] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:59.344918 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d854b571-27c7-4343-bfb5-0300ab93699a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:59.345365 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d854b571-27c7-4343-bfb5-0300ab93699a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:59.346119 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d854b571-27c7-4343-bfb5-0300ab93699a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:59.346548 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d854b571-27c7-4343-bfb5-0300ab93699a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:59.478884 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-d854b571-27c7-4343-bfb5-0300ab93699a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:26:59.487058 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-d854b571-27c7-4343-bfb5-0300ab93699a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe" status: 200 len: 1521 microversion: 2.1 time: 0.153214 Jul 11 11:26:59.487665 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 91/185] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:59 2022] GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:26:59.604702 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-f4e0a6d4-fbef-4a88-8c60-21069e5b40dd tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:59.605309 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-f4e0a6d4-fbef-4a88-8c60-21069e5b40dd tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] [instance: f9e44714-3285-489f-91df-091b85f4c56b] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:59.611900 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f4e0a6d4-fbef-4a88-8c60-21069e5b40dd tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:59.612345 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f4e0a6d4-fbef-4a88-8c60-21069e5b40dd tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:59.613096 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f4e0a6d4-fbef-4a88-8c60-21069e5b40dd tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:59.613527 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f4e0a6d4-fbef-4a88-8c60-21069e5b40dd tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:59.626623 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.wsgi [None req-f4e0a6d4-fbef-4a88-8c60-21069e5b40dd tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] HTTP exception thrown: Instance f9e44714-3285-489f-91df-091b85f4c56b could not be found. Jul 11 11:26:59.631576 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-f4e0a6d4-fbef-4a88-8c60-21069e5b40dd tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Request method failure captured: Jul 11 11:26:59.631576 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: request: GET /compute/v2.1/servers/f9e44714-3285-489f-91df-091b85f4c56b HTTP/1.1 Jul 11 11:26:59.631576 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Accept: application/json Jul 11 11:26:59.631576 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Accept-Encoding: identity Jul 11 11:26:59.631576 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Connection: close Jul 11 11:26:59.631576 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Content-Length: 0 Jul 11 11:26:59.631576 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Content-Type: application/json Jul 11 11:26:59.631576 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Host: 10.222.0.26 Jul 11 11:26:59.631576 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Openstack-System-Scope: None Jul 11 11:26:59.631576 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: User-Agent: python-urllib3/1.26.9 Jul 11 11:26:59.631576 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Auth-Token: gAAAAABizAjGPXXvw_FwMVPhq6F8JiaT2yJs2baUpX5Ly3AmUDQH12XOYeQWHbMXox03eISWyHg-FUjZWGOWUiEPKeK8l3p5i0J_kNiBkXRYFdb63EiamUPmWI2c7j82u135JqddWjvFTnEikoTB6zEqRVvobHqX5WNILMTUm35H-NVLs-ZNZGg Jul 11 11:26:59.631576 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Domain-Id: None Jul 11 11:26:59.631576 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Domain-Name: None Jul 11 11:26:59.631576 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Identity-Status: Confirmed Jul 11 11:26:59.631576 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Is-Admin-Project: True Jul 11 11:26:59.631576 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Domain-Id: default Jul 11 11:26:59.631576 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Domain-Name: Default Jul 11 11:26:59.631576 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Id: 877612289735450ea6bd527ebe7b81f3 Jul 11 11:26:59.631576 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Name: tempest-DeleteServersTestJSON-500205929 Jul 11 11:26:59.631576 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Role: member,reader Jul 11 11:26:59.631576 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Roles: member,reader Jul 11 11:26:59.633304 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_877612289735450ea6bd527ebe7b81f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/877612289735450ea6bd527ebe7b81f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/877612289735450ea6bd527ebe7b81f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/877612289735450ea6bd527ebe7b81f3"}]}] Jul 11 11:26:59.633304 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Tenant: tempest-DeleteServersTestJSON-500205929 Jul 11 11:26:59.633304 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Tenant-Id: 877612289735450ea6bd527ebe7b81f3 Jul 11 11:26:59.633304 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Tenant-Name: tempest-DeleteServersTestJSON-500205929 Jul 11 11:26:59.633304 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User: tempest-DeleteServersTestJSON-500205929-project Jul 11 11:26:59.633304 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Domain-Id: default Jul 11 11:26:59.633304 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Domain-Name: Default Jul 11 11:26:59.633304 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Id: 5f9ae0e6a2534bb0b5d5e9327b01b238 Jul 11 11:26:59.633304 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Name: tempest-DeleteServersTestJSON-500205929-project Jul 11 11:26:59.633304 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: method: > Jul 11 11:26:59.633304 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: exception: Instance f9e44714-3285-489f-91df-091b85f4c56b could not be found. Jul 11 11:26:59.633304 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: action_args: {'id': 'f9e44714-3285-489f-91df-091b85f4c56b'} Jul 11 11:26:59.634178 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 11:26:59.634178 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:26:59.634178 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 11:26:59.634178 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 11:26:59.634178 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 11:26:59.634178 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 11:26:59.634178 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 11:26:59.634178 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 11:26:59.634178 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 11:26:59.634178 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 11:26:59.634178 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9e44714-3285-489f-91df-091b85f4c56b could not be found. Jul 11 11:26:59.634178 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:26:59.634178 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:26:59.634178 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:26:59.634178 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:26:59.634178 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:26:59.634178 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:26:59.634178 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 11:26:59.634178 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 11:26:59.634178 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 11:26:59.636155 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 11:26:59.636155 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 11:26:59.636155 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 11:26:59.636155 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 11:26:59.636155 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 11:26:59.636155 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 11:26:59.636155 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 11:26:59.636155 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9e44714-3285-489f-91df-091b85f4c56b could not be found. Jul 11 11:26:59.636155 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:26:59.636155 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:26:59.636155 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:26:59.636155 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:26:59.636155 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:26:59.636155 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:26:59.636155 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 11:26:59.636155 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 11:26:59.636155 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9e44714-3285-489f-91df-091b85f4c56b could not be found. Jul 11 11:26:59.636155 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:26:59.637551 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-f4e0a6d4-fbef-4a88-8c60-21069e5b40dd tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Returning 404 to user: Instance f9e44714-3285-489f-91df-091b85f4c56b could not be found. {{(pid=118321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 11:26:59.637551 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-f4e0a6d4-fbef-4a88-8c60-21069e5b40dd tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] 10.222.0.26 "GET /compute/v2.1/servers/f9e44714-3285-489f-91df-091b85f4c56b" status: 404 len: 111 microversion: 2.1 time: 0.031887 Jul 11 11:26:59.637551 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 95/186] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:26:59 2022] GET /compute/v2.1/servers/f9e44714-3285-489f-91df-091b85f4c56b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 11:26:59.745108 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-9c3e1e61-43da-4793-b202-18bab784e91a tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:26:59.746131 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-9c3e1e61-43da-4793-b202-18bab784e91a tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] [instance: f9e44714-3285-489f-91df-091b85f4c56b] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:26:59.752054 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9c3e1e61-43da-4793-b202-18bab784e91a tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:59.752494 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9c3e1e61-43da-4793-b202-18bab784e91a tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:59.753240 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9c3e1e61-43da-4793-b202-18bab784e91a tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:26:59.753684 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9c3e1e61-43da-4793-b202-18bab784e91a tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:26:59.770802 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.wsgi [None req-9c3e1e61-43da-4793-b202-18bab784e91a tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] HTTP exception thrown: Instance f9e44714-3285-489f-91df-091b85f4c56b could not be found. Jul 11 11:26:59.774811 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-9c3e1e61-43da-4793-b202-18bab784e91a tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Request method failure captured: Jul 11 11:26:59.774811 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: request: GET /compute/v2.1/servers/f9e44714-3285-489f-91df-091b85f4c56b/os-volume_attachments HTTP/1.1 Jul 11 11:26:59.774811 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Accept: application/json Jul 11 11:26:59.774811 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Accept-Encoding: identity Jul 11 11:26:59.774811 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Connection: close Jul 11 11:26:59.774811 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Content-Length: 0 Jul 11 11:26:59.774811 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Content-Type: application/json Jul 11 11:26:59.774811 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Host: 10.222.0.26 Jul 11 11:26:59.774811 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Openstack-System-Scope: None Jul 11 11:26:59.774811 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: User-Agent: python-urllib3/1.26.9 Jul 11 11:26:59.774811 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Auth-Token: gAAAAABizAjGPXXvw_FwMVPhq6F8JiaT2yJs2baUpX5Ly3AmUDQH12XOYeQWHbMXox03eISWyHg-FUjZWGOWUiEPKeK8l3p5i0J_kNiBkXRYFdb63EiamUPmWI2c7j82u135JqddWjvFTnEikoTB6zEqRVvobHqX5WNILMTUm35H-NVLs-ZNZGg Jul 11 11:26:59.774811 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Domain-Id: None Jul 11 11:26:59.774811 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Domain-Name: None Jul 11 11:26:59.774811 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Identity-Status: Confirmed Jul 11 11:26:59.774811 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Is-Admin-Project: True Jul 11 11:26:59.774811 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Domain-Id: default Jul 11 11:26:59.774811 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Domain-Name: Default Jul 11 11:26:59.774811 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Id: 877612289735450ea6bd527ebe7b81f3 Jul 11 11:26:59.774811 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Name: tempest-DeleteServersTestJSON-500205929 Jul 11 11:26:59.774811 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Role: member,reader Jul 11 11:26:59.774811 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Roles: member,reader Jul 11 11:26:59.776003 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_877612289735450ea6bd527ebe7b81f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/877612289735450ea6bd527ebe7b81f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/877612289735450ea6bd527ebe7b81f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/877612289735450ea6bd527ebe7b81f3"}]}] Jul 11 11:26:59.776003 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Tenant: tempest-DeleteServersTestJSON-500205929 Jul 11 11:26:59.776003 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Tenant-Id: 877612289735450ea6bd527ebe7b81f3 Jul 11 11:26:59.776003 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Tenant-Name: tempest-DeleteServersTestJSON-500205929 Jul 11 11:26:59.776003 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User: tempest-DeleteServersTestJSON-500205929-project Jul 11 11:26:59.776003 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Domain-Id: default Jul 11 11:26:59.776003 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Domain-Name: Default Jul 11 11:26:59.776003 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Id: 5f9ae0e6a2534bb0b5d5e9327b01b238 Jul 11 11:26:59.776003 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Name: tempest-DeleteServersTestJSON-500205929-project Jul 11 11:26:59.776003 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: method: > Jul 11 11:26:59.776003 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: exception: Instance f9e44714-3285-489f-91df-091b85f4c56b could not be found. Jul 11 11:26:59.776003 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: action_args: {'server_id': 'f9e44714-3285-489f-91df-091b85f4c56b'} Jul 11 11:26:59.776722 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 11:26:59.776722 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:26:59.776722 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 11:26:59.776722 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 11:26:59.776722 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 11:26:59.776722 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 11:26:59.776722 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 11:26:59.776722 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 11:26:59.776722 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 11:26:59.776722 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 11:26:59.776722 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9e44714-3285-489f-91df-091b85f4c56b could not be found. Jul 11 11:26:59.776722 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:26:59.776722 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:26:59.776722 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:26:59.776722 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:26:59.776722 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:26:59.776722 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:26:59.776722 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 11:26:59.776722 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 11:26:59.776722 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 11:26:59.777965 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 11:26:59.777965 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 11 11:26:59.777965 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 11 11:26:59.777965 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 11 11:26:59.777965 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 11 11:26:59.777965 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 11 11:26:59.777965 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 11 11:26:59.777965 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 11:26:59.777965 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 11:26:59.777965 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9e44714-3285-489f-91df-091b85f4c56b could not be found. Jul 11 11:26:59.777965 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:26:59.777965 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:26:59.777965 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:26:59.777965 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:26:59.777965 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:26:59.777965 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:26:59.777965 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 11:26:59.777965 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 11:26:59.777965 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9e44714-3285-489f-91df-091b85f4c56b could not be found. Jul 11 11:26:59.777965 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:26:59.779387 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-9c3e1e61-43da-4793-b202-18bab784e91a tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Returning 404 to user: Instance f9e44714-3285-489f-91df-091b85f4c56b could not be found. {{(pid=118322) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 11:26:59.779387 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-9c3e1e61-43da-4793-b202-18bab784e91a tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] 10.222.0.26 "GET /compute/v2.1/servers/f9e44714-3285-489f-91df-091b85f4c56b/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.035432 Jul 11 11:26:59.779387 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 92/187] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:26:59 2022] GET /compute/v2.1/servers/f9e44714-3285-489f-91df-091b85f4c56b/os-volume_attachments => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 11:27:00.504504 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-99449758-4adc-4e8a-bca6-377772071b3c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:00.505114 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-99449758-4adc-4e8a-bca6-377772071b3c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 1df1a34e-6645-4776-ac7a-a03a47edeebe] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:00.511157 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-99449758-4adc-4e8a-bca6-377772071b3c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:00.511634 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-99449758-4adc-4e8a-bca6-377772071b3c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:00.513129 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-99449758-4adc-4e8a-bca6-377772071b3c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:00.513129 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-99449758-4adc-4e8a-bca6-377772071b3c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:00.639563 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-99449758-4adc-4e8a-bca6-377772071b3c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:00.647573 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-99449758-4adc-4e8a-bca6-377772071b3c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe" status: 200 len: 1521 microversion: 2.1 time: 0.147431 Jul 11 11:27:00.648141 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 96/188] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:27:00 2022] GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:27:01.214233 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-2f437983-cba9-45b6-a570-1b4d3b07b517 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:01.215042 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-2f437983-cba9-45b6-a570-1b4d3b07b517 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] [instance: f9e44714-3285-489f-91df-091b85f4c56b] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:01.221682 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2f437983-cba9-45b6-a570-1b4d3b07b517 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:01.222197 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2f437983-cba9-45b6-a570-1b4d3b07b517 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:01.222962 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2f437983-cba9-45b6-a570-1b4d3b07b517 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:01.223583 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2f437983-cba9-45b6-a570-1b4d3b07b517 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:01.237179 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.wsgi [None req-2f437983-cba9-45b6-a570-1b4d3b07b517 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] HTTP exception thrown: Instance f9e44714-3285-489f-91df-091b85f4c56b could not be found. Jul 11 11:27:01.239403 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-2f437983-cba9-45b6-a570-1b4d3b07b517 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Request method failure captured: Jul 11 11:27:01.239403 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: request: DELETE /compute/v2.1/servers/f9e44714-3285-489f-91df-091b85f4c56b HTTP/1.1 Jul 11 11:27:01.239403 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Accept: application/json Jul 11 11:27:01.239403 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Accept-Encoding: identity Jul 11 11:27:01.239403 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Connection: close Jul 11 11:27:01.239403 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Content-Length: 0 Jul 11 11:27:01.239403 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Content-Type: application/json Jul 11 11:27:01.239403 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Host: 10.222.0.26 Jul 11 11:27:01.239403 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Openstack-System-Scope: None Jul 11 11:27:01.239403 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: User-Agent: python-urllib3/1.26.9 Jul 11 11:27:01.239403 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Auth-Token: gAAAAABizAjGPXXvw_FwMVPhq6F8JiaT2yJs2baUpX5Ly3AmUDQH12XOYeQWHbMXox03eISWyHg-FUjZWGOWUiEPKeK8l3p5i0J_kNiBkXRYFdb63EiamUPmWI2c7j82u135JqddWjvFTnEikoTB6zEqRVvobHqX5WNILMTUm35H-NVLs-ZNZGg Jul 11 11:27:01.239403 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Domain-Id: None Jul 11 11:27:01.239403 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Domain-Name: None Jul 11 11:27:01.239403 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Identity-Status: Confirmed Jul 11 11:27:01.239403 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Is-Admin-Project: True Jul 11 11:27:01.239403 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Domain-Id: default Jul 11 11:27:01.239403 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Domain-Name: Default Jul 11 11:27:01.239403 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Id: 877612289735450ea6bd527ebe7b81f3 Jul 11 11:27:01.239403 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Name: tempest-DeleteServersTestJSON-500205929 Jul 11 11:27:01.239403 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Role: member,reader Jul 11 11:27:01.239403 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Roles: member,reader Jul 11 11:27:01.240808 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_877612289735450ea6bd527ebe7b81f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/877612289735450ea6bd527ebe7b81f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/877612289735450ea6bd527ebe7b81f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/877612289735450ea6bd527ebe7b81f3"}]}] Jul 11 11:27:01.240808 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Tenant: tempest-DeleteServersTestJSON-500205929 Jul 11 11:27:01.240808 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Tenant-Id: 877612289735450ea6bd527ebe7b81f3 Jul 11 11:27:01.240808 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Tenant-Name: tempest-DeleteServersTestJSON-500205929 Jul 11 11:27:01.240808 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User: tempest-DeleteServersTestJSON-500205929-project Jul 11 11:27:01.240808 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Domain-Id: default Jul 11 11:27:01.240808 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Domain-Name: Default Jul 11 11:27:01.240808 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Id: 5f9ae0e6a2534bb0b5d5e9327b01b238 Jul 11 11:27:01.240808 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Name: tempest-DeleteServersTestJSON-500205929-project Jul 11 11:27:01.240808 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: method: > Jul 11 11:27:01.240808 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: exception: Instance f9e44714-3285-489f-91df-091b85f4c56b could not be found. Jul 11 11:27:01.240808 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: action_args: {'id': 'f9e44714-3285-489f-91df-091b85f4c56b'} Jul 11 11:27:01.241620 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 11:27:01.241620 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:27:01.241620 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 11:27:01.241620 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 11:27:01.241620 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 11:27:01.241620 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 11:27:01.241620 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 11:27:01.241620 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 11:27:01.241620 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 11:27:01.241620 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 11:27:01.241620 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9e44714-3285-489f-91df-091b85f4c56b could not be found. Jul 11 11:27:01.241620 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:27:01.241620 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:27:01.241620 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:27:01.241620 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:27:01.241620 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:27:01.241620 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:27:01.241620 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 11:27:01.241620 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 11:27:01.241620 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 11:27:01.242915 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 11:27:01.242915 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 11 11:27:01.242915 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 11 11:27:01.242915 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 11 11:27:01.242915 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 11 11:27:01.242915 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 11:27:01.242915 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 11:27:01.242915 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 11:27:01.242915 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 11:27:01.242915 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9e44714-3285-489f-91df-091b85f4c56b could not be found. Jul 11 11:27:01.242915 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:27:01.242915 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:27:01.242915 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:27:01.242915 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:27:01.242915 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:27:01.242915 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:27:01.242915 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 11:27:01.242915 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 11:27:01.242915 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9e44714-3285-489f-91df-091b85f4c56b could not be found. Jul 11 11:27:01.242915 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:27:01.246574 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-2f437983-cba9-45b6-a570-1b4d3b07b517 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Returning 404 to user: Instance f9e44714-3285-489f-91df-091b85f4c56b could not be found. {{(pid=118322) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 11:27:01.246574 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-2f437983-cba9-45b6-a570-1b4d3b07b517 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f9e44714-3285-489f-91df-091b85f4c56b" status: 404 len: 111 microversion: 2.1 time: 0.030467 Jul 11 11:27:01.246574 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 93/189] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 11 11:27:01 2022] DELETE /compute/v2.1/servers/f9e44714-3285-489f-91df-091b85f4c56b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 11:27:01.252872 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-b8f70357-f865-4713-bd35-a7d1a812f3f2 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:01.253359 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-b8f70357-f865-4713-bd35-a7d1a812f3f2 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] [instance: f9e44714-3285-489f-91df-091b85f4c56b] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:01.259701 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b8f70357-f865-4713-bd35-a7d1a812f3f2 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:01.261128 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b8f70357-f865-4713-bd35-a7d1a812f3f2 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:01.262006 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b8f70357-f865-4713-bd35-a7d1a812f3f2 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:01.262493 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b8f70357-f865-4713-bd35-a7d1a812f3f2 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:01.277153 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.wsgi [None req-b8f70357-f865-4713-bd35-a7d1a812f3f2 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] HTTP exception thrown: Instance f9e44714-3285-489f-91df-091b85f4c56b could not be found. Jul 11 11:27:01.278705 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-b8f70357-f865-4713-bd35-a7d1a812f3f2 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Request method failure captured: Jul 11 11:27:01.278705 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: request: GET /compute/v2.1/servers/f9e44714-3285-489f-91df-091b85f4c56b HTTP/1.1 Jul 11 11:27:01.278705 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Accept: application/json Jul 11 11:27:01.278705 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Accept-Encoding: identity Jul 11 11:27:01.278705 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Connection: close Jul 11 11:27:01.278705 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Content-Length: 0 Jul 11 11:27:01.278705 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Content-Type: application/json Jul 11 11:27:01.278705 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Host: 10.222.0.26 Jul 11 11:27:01.278705 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Openstack-System-Scope: None Jul 11 11:27:01.278705 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: User-Agent: python-urllib3/1.26.9 Jul 11 11:27:01.278705 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Auth-Token: gAAAAABizAjGPXXvw_FwMVPhq6F8JiaT2yJs2baUpX5Ly3AmUDQH12XOYeQWHbMXox03eISWyHg-FUjZWGOWUiEPKeK8l3p5i0J_kNiBkXRYFdb63EiamUPmWI2c7j82u135JqddWjvFTnEikoTB6zEqRVvobHqX5WNILMTUm35H-NVLs-ZNZGg Jul 11 11:27:01.278705 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Domain-Id: None Jul 11 11:27:01.278705 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Domain-Name: None Jul 11 11:27:01.278705 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Identity-Status: Confirmed Jul 11 11:27:01.278705 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Is-Admin-Project: True Jul 11 11:27:01.278705 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Domain-Id: default Jul 11 11:27:01.278705 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Domain-Name: Default Jul 11 11:27:01.278705 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Id: 877612289735450ea6bd527ebe7b81f3 Jul 11 11:27:01.278705 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Name: tempest-DeleteServersTestJSON-500205929 Jul 11 11:27:01.278705 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Role: member,reader Jul 11 11:27:01.278705 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Roles: member,reader Jul 11 11:27:01.280128 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_877612289735450ea6bd527ebe7b81f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/877612289735450ea6bd527ebe7b81f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/877612289735450ea6bd527ebe7b81f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/877612289735450ea6bd527ebe7b81f3"}]}] Jul 11 11:27:01.280128 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Tenant: tempest-DeleteServersTestJSON-500205929 Jul 11 11:27:01.280128 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Tenant-Id: 877612289735450ea6bd527ebe7b81f3 Jul 11 11:27:01.280128 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Tenant-Name: tempest-DeleteServersTestJSON-500205929 Jul 11 11:27:01.280128 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User: tempest-DeleteServersTestJSON-500205929-project Jul 11 11:27:01.280128 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Domain-Id: default Jul 11 11:27:01.280128 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Domain-Name: Default Jul 11 11:27:01.280128 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Id: 5f9ae0e6a2534bb0b5d5e9327b01b238 Jul 11 11:27:01.280128 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Name: tempest-DeleteServersTestJSON-500205929-project Jul 11 11:27:01.280128 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: method: > Jul 11 11:27:01.280128 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: exception: Instance f9e44714-3285-489f-91df-091b85f4c56b could not be found. Jul 11 11:27:01.280128 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: action_args: {'id': 'f9e44714-3285-489f-91df-091b85f4c56b'} Jul 11 11:27:01.281435 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 11:27:01.281435 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:27:01.281435 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 11:27:01.281435 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 11:27:01.281435 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 11:27:01.281435 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 11:27:01.281435 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 11:27:01.281435 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 11:27:01.281435 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 11:27:01.281435 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 11:27:01.281435 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9e44714-3285-489f-91df-091b85f4c56b could not be found. Jul 11 11:27:01.281435 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:27:01.281435 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:27:01.281435 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:27:01.281435 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:27:01.281435 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:27:01.281435 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:27:01.281435 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 11:27:01.281435 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 11:27:01.281435 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 11:27:01.282561 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 11:27:01.282561 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 11:27:01.282561 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 11:27:01.282561 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 11:27:01.282561 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 11:27:01.282561 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 11:27:01.282561 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 11:27:01.282561 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9e44714-3285-489f-91df-091b85f4c56b could not be found. Jul 11 11:27:01.282561 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:27:01.282561 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:27:01.282561 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:27:01.282561 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:27:01.282561 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:27:01.282561 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:27:01.282561 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 11:27:01.282561 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 11:27:01.282561 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9e44714-3285-489f-91df-091b85f4c56b could not be found. Jul 11 11:27:01.282561 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:27:01.283545 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-b8f70357-f865-4713-bd35-a7d1a812f3f2 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] Returning 404 to user: Instance f9e44714-3285-489f-91df-091b85f4c56b could not be found. {{(pid=118321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 11:27:01.283545 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-b8f70357-f865-4713-bd35-a7d1a812f3f2 tempest-DeleteServersTestJSON-500205929 tempest-DeleteServersTestJSON-500205929-project] 10.222.0.26 "GET /compute/v2.1/servers/f9e44714-3285-489f-91df-091b85f4c56b" status: 404 len: 111 microversion: 2.1 time: 0.032113 Jul 11 11:27:01.284905 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 97/190] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:27:01 2022] GET /compute/v2.1/servers/f9e44714-3285-489f-91df-091b85f4c56b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 11:27:01.665296 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-21eeac12-093e-41e0-8a84-aa729d598a05 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:01.665914 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-21eeac12-093e-41e0-8a84-aa729d598a05 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 1df1a34e-6645-4776-ac7a-a03a47edeebe] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:01.672451 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-21eeac12-093e-41e0-8a84-aa729d598a05 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:01.672898 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-21eeac12-093e-41e0-8a84-aa729d598a05 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:01.673662 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-21eeac12-093e-41e0-8a84-aa729d598a05 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:01.674165 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-21eeac12-093e-41e0-8a84-aa729d598a05 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:01.952589 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-21eeac12-093e-41e0-8a84-aa729d598a05 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:01.960822 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-21eeac12-093e-41e0-8a84-aa729d598a05 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe" status: 200 len: 1521 microversion: 2.1 time: 0.299288 Jul 11 11:27:01.961470 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 94/191] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:27:01 2022] GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe => generated 1521 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:27:02.978347 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-5f266f89-88f7-4824-a98c-90252dcbe253 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:02.980029 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-5f266f89-88f7-4824-a98c-90252dcbe253 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 1df1a34e-6645-4776-ac7a-a03a47edeebe] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:02.985363 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5f266f89-88f7-4824-a98c-90252dcbe253 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:02.985808 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5f266f89-88f7-4824-a98c-90252dcbe253 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:02.986600 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5f266f89-88f7-4824-a98c-90252dcbe253 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:02.987020 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5f266f89-88f7-4824-a98c-90252dcbe253 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:03.135833 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-5f266f89-88f7-4824-a98c-90252dcbe253 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:03.143607 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-5f266f89-88f7-4824-a98c-90252dcbe253 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe" status: 200 len: 1521 microversion: 2.1 time: 0.169641 Jul 11 11:27:03.144177 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 98/192] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:27:02 2022] GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:27:03.455481 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-3aa5124a-2588-45de-b29b-78241e874cfb tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-388845322", "imageRef": "1bb93fc1-b713-4e67-8f76-bfec3a96168b", "flavorRef": "452", "networks": [{"uuid": "888a7d77-be03-4cb0-8efe-e5724a18f05d"}]}} {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:27:03.510592 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.network.neutron [None req-3aa5124a-2588-45de-b29b-78241e874cfb tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] validate_networks() for [('888a7d77-be03-4cb0-8efe-e5724a18f05d', None, None, None, None, None)] {{(pid=118322) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 11:27:03.883797 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.virt.hardware [None req-3aa5124a-2588-45de-b29b-78241e874cfb tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Flavor limits 0:0:0 {{(pid=118322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 11:27:03.884219 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.virt.hardware [None req-3aa5124a-2588-45de-b29b-78241e874cfb tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Image limits 0:0:0 {{(pid=118322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 11:27:03.884720 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.virt.hardware [None req-3aa5124a-2588-45de-b29b-78241e874cfb tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Flavor pref 0:0:0 {{(pid=118322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 11:27:03.885127 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.virt.hardware [None req-3aa5124a-2588-45de-b29b-78241e874cfb tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Image pref 0:0:0 {{(pid=118322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 11:27:03.885536 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.virt.hardware [None req-3aa5124a-2588-45de-b29b-78241e874cfb tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 11:27:03.896039 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3aa5124a-2588-45de-b29b-78241e874cfb tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:03.900249 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3aa5124a-2588-45de-b29b-78241e874cfb tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:03.900249 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3aa5124a-2588-45de-b29b-78241e874cfb tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:03.900249 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3aa5124a-2588-45de-b29b-78241e874cfb tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:03.916597 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.quota [None req-3aa5124a-2588-45de-b29b-78241e874cfb tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Getting quotas for project 679163b973694df7a7d0fb1184f31f7e. Resources: {'cores', 'ram', 'instances'} {{(pid=118322) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 11:27:03.920938 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.quota [None req-3aa5124a-2588-45de-b29b-78241e874cfb tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Getting quotas for user 0b8f21537fc14c6fabeec0252205e1dc and project 679163b973694df7a7d0fb1184f31f7e. Resources: {'cores', 'ram', 'instances'} {{(pid=118322) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 11:27:03.934844 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-3aa5124a-2588-45de-b29b-78241e874cfb tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Going to run 1 instances... {{(pid=118322) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 11:27:03.935440 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-3aa5124a-2588-45de-b29b-78241e874cfb tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb93fc1-b713-4e67-8f76-bfec3a96168b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118322) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 11:27:04.106092 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-3aa5124a-2588-45de-b29b-78241e874cfb tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.655309 Jul 11 11:27:04.106756 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 95/193] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jul 11 11:27:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 657 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 11 11:27:04.117152 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-90596bc6-f065-4e50-beaa-2690bacf95fc tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:04.117881 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-90596bc6-f065-4e50-beaa-2690bacf95fc tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:04.163157 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-68f32d31-2b8e-4e81-9cde-1e063eb4423f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:04.163157 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-68f32d31-2b8e-4e81-9cde-1e063eb4423f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 1df1a34e-6645-4776-ac7a-a03a47edeebe] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:04.179558 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-68f32d31-2b8e-4e81-9cde-1e063eb4423f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:04.184237 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-68f32d31-2b8e-4e81-9cde-1e063eb4423f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:04.189274 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-68f32d31-2b8e-4e81-9cde-1e063eb4423f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:04.189274 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-68f32d31-2b8e-4e81-9cde-1e063eb4423f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:04.221445 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-90596bc6-f065-4e50-beaa-2690bacf95fc tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:04.230680 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-90596bc6-f065-4e50-beaa-2690bacf95fc tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1218 microversion: 2.1 time: 0.117630 Jul 11 11:27:04.231280 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 99/194] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:27:04 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1218 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:27:04.378202 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-68f32d31-2b8e-4e81-9cde-1e063eb4423f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:04.387061 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-68f32d31-2b8e-4e81-9cde-1e063eb4423f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe" status: 200 len: 1521 microversion: 2.1 time: 0.230668 Jul 11 11:27:04.387951 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 96/195] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:27:04 2022] GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:27:05.247662 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-d4f7b5bc-5280-4fa6-a65f-41e9ccc54233 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:05.248320 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-d4f7b5bc-5280-4fa6-a65f-41e9ccc54233 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:05.307734 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-d4f7b5bc-5280-4fa6-a65f-41e9ccc54233 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:05.315226 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-d4f7b5bc-5280-4fa6-a65f-41e9ccc54233 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1218 microversion: 2.1 time: 0.071348 Jul 11 11:27:05.315916 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 100/196] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:27:05 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1218 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:27:05.403761 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-7ecb2473-aeb2-4e33-8a14-51f029b94a49 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:05.405129 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-7ecb2473-aeb2-4e33-8a14-51f029b94a49 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 1df1a34e-6645-4776-ac7a-a03a47edeebe] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:05.412910 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7ecb2473-aeb2-4e33-8a14-51f029b94a49 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:05.413473 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7ecb2473-aeb2-4e33-8a14-51f029b94a49 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:05.414450 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7ecb2473-aeb2-4e33-8a14-51f029b94a49 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:05.414948 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7ecb2473-aeb2-4e33-8a14-51f029b94a49 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:05.645642 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-7ecb2473-aeb2-4e33-8a14-51f029b94a49 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:05.653301 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-7ecb2473-aeb2-4e33-8a14-51f029b94a49 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe" status: 200 len: 1521 microversion: 2.1 time: 0.253431 Jul 11 11:27:05.653889 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 97/197] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:27:05 2022] GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:27:06.333325 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-f62e77c2-17cc-4635-9c0c-ca95e3aea98c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:06.333872 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-f62e77c2-17cc-4635-9c0c-ca95e3aea98c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:06.341763 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f62e77c2-17cc-4635-9c0c-ca95e3aea98c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:06.342224 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f62e77c2-17cc-4635-9c0c-ca95e3aea98c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:06.342988 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f62e77c2-17cc-4635-9c0c-ca95e3aea98c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:06.344006 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f62e77c2-17cc-4635-9c0c-ca95e3aea98c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:06.410561 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-f62e77c2-17cc-4635-9c0c-ca95e3aea98c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:06.412630 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:27:06.418470 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-f62e77c2-17cc-4635-9c0c-ca95e3aea98c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1214 microversion: 2.1 time: 0.089871 Jul 11 11:27:06.419077 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 101/198] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:27:06 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1214 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:27:06.670884 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-05db2b09-378f-4153-b247-cf740ebe41ad tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:06.671513 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-05db2b09-378f-4153-b247-cf740ebe41ad tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 1df1a34e-6645-4776-ac7a-a03a47edeebe] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:06.678625 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-05db2b09-378f-4153-b247-cf740ebe41ad tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:06.678941 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-05db2b09-378f-4153-b247-cf740ebe41ad tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:06.679732 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-05db2b09-378f-4153-b247-cf740ebe41ad tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:06.680162 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-05db2b09-378f-4153-b247-cf740ebe41ad tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:06.812137 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-05db2b09-378f-4153-b247-cf740ebe41ad tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:06.820014 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-05db2b09-378f-4153-b247-cf740ebe41ad tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe" status: 200 len: 1521 microversion: 2.1 time: 0.152915 Jul 11 11:27:06.820607 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 98/199] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:27:06 2022] GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:27:07.439776 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-79b910f6-8d47-4f7c-a6e9-dd9bfa7933f6 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:07.440462 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-79b910f6-8d47-4f7c-a6e9-dd9bfa7933f6 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:07.447227 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-79b910f6-8d47-4f7c-a6e9-dd9bfa7933f6 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:07.447694 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-79b910f6-8d47-4f7c-a6e9-dd9bfa7933f6 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:07.448489 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-79b910f6-8d47-4f7c-a6e9-dd9bfa7933f6 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:07.448916 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-79b910f6-8d47-4f7c-a6e9-dd9bfa7933f6 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:07.511429 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-79b910f6-8d47-4f7c-a6e9-dd9bfa7933f6 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:07.519516 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-79b910f6-8d47-4f7c-a6e9-dd9bfa7933f6 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1214 microversion: 2.1 time: 0.083575 Jul 11 11:27:07.520077 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 102/200] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:27:07 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:27:07.837550 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-0c4f9626-3f73-4d3c-952b-60038bafde66 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:07.838155 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-0c4f9626-3f73-4d3c-952b-60038bafde66 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 1df1a34e-6645-4776-ac7a-a03a47edeebe] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:07.844699 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0c4f9626-3f73-4d3c-952b-60038bafde66 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:07.845145 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0c4f9626-3f73-4d3c-952b-60038bafde66 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:07.845900 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0c4f9626-3f73-4d3c-952b-60038bafde66 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:07.846328 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0c4f9626-3f73-4d3c-952b-60038bafde66 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:07.981613 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-0c4f9626-3f73-4d3c-952b-60038bafde66 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:07.989061 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-0c4f9626-3f73-4d3c-952b-60038bafde66 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe" status: 200 len: 1521 microversion: 2.1 time: 0.155391 Jul 11 11:27:07.989689 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 99/201] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:27:07 2022] GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:27:08.537212 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-266a8abe-af30-4133-97c3-41aabbc029bb tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:08.537849 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-266a8abe-af30-4133-97c3-41aabbc029bb tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:08.544345 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-266a8abe-af30-4133-97c3-41aabbc029bb tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:08.544846 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-266a8abe-af30-4133-97c3-41aabbc029bb tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:08.545640 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-266a8abe-af30-4133-97c3-41aabbc029bb tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:08.546126 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-266a8abe-af30-4133-97c3-41aabbc029bb tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:08.610315 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-266a8abe-af30-4133-97c3-41aabbc029bb tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:08.618291 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-266a8abe-af30-4133-97c3-41aabbc029bb tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1214 microversion: 2.1 time: 0.085317 Jul 11 11:27:08.619044 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 103/202] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:27:08 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:27:09.010931 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-de4610f5-b438-4565-87be-edb109712f7a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:09.011652 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-de4610f5-b438-4565-87be-edb109712f7a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 1df1a34e-6645-4776-ac7a-a03a47edeebe] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:09.020803 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-de4610f5-b438-4565-87be-edb109712f7a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:09.021645 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-de4610f5-b438-4565-87be-edb109712f7a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:09.022044 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-de4610f5-b438-4565-87be-edb109712f7a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:09.022521 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-de4610f5-b438-4565-87be-edb109712f7a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:09.041094 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=100 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:27:09.153571 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-de4610f5-b438-4565-87be-edb109712f7a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:09.161703 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-de4610f5-b438-4565-87be-edb109712f7a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe" status: 200 len: 1521 microversion: 2.1 time: 0.156693 Jul 11 11:27:09.162346 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 100/203] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:27:09 2022] GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:27:09.635173 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-b6cf4009-c249-4425-930a-f4e2c88c37cf tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:09.635803 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-b6cf4009-c249-4425-930a-f4e2c88c37cf tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:09.642607 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b6cf4009-c249-4425-930a-f4e2c88c37cf tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:09.643055 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b6cf4009-c249-4425-930a-f4e2c88c37cf tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:09.643851 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b6cf4009-c249-4425-930a-f4e2c88c37cf tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:09.644283 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b6cf4009-c249-4425-930a-f4e2c88c37cf tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:09.715380 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-b6cf4009-c249-4425-930a-f4e2c88c37cf tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:09.722755 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-b6cf4009-c249-4425-930a-f4e2c88c37cf tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1278 microversion: 2.1 time: 0.091394 Jul 11 11:27:09.723553 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 104/204] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:27:09 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1278 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:27:10.179520 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-7f50af42-85ab-4b01-bcde-0a2fa03c13cc tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:10.181565 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-7f50af42-85ab-4b01-bcde-0a2fa03c13cc tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 1df1a34e-6645-4776-ac7a-a03a47edeebe] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:10.193016 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7f50af42-85ab-4b01-bcde-0a2fa03c13cc tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:10.193520 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7f50af42-85ab-4b01-bcde-0a2fa03c13cc tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:10.194304 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7f50af42-85ab-4b01-bcde-0a2fa03c13cc tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:10.194710 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7f50af42-85ab-4b01-bcde-0a2fa03c13cc tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:10.358563 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-7f50af42-85ab-4b01-bcde-0a2fa03c13cc tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:10.366548 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-7f50af42-85ab-4b01-bcde-0a2fa03c13cc tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe" status: 200 len: 1521 microversion: 2.1 time: 0.191819 Jul 11 11:27:10.367114 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 101/205] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:27:10 2022] GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:27:10.740155 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-a1da9ca7-107e-40e4-a5b1-4654ab699d80 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:10.741096 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-a1da9ca7-107e-40e4-a5b1-4654ab699d80 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:10.747380 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a1da9ca7-107e-40e4-a5b1-4654ab699d80 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:10.747898 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a1da9ca7-107e-40e4-a5b1-4654ab699d80 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:10.748812 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a1da9ca7-107e-40e4-a5b1-4654ab699d80 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:10.749336 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a1da9ca7-107e-40e4-a5b1-4654ab699d80 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:10.963207 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-a1da9ca7-107e-40e4-a5b1-4654ab699d80 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:10.978829 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-a1da9ca7-107e-40e4-a5b1-4654ab699d80 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1318 microversion: 2.1 time: 0.242581 Jul 11 11:27:10.979902 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 105/206] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:27:10 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1318 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:27:11.394081 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-52b55f96-c7d4-473d-8ec8-ae9b31139683 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:11.395579 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-52b55f96-c7d4-473d-8ec8-ae9b31139683 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 1df1a34e-6645-4776-ac7a-a03a47edeebe] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:11.398106 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=3 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:27:11.407401 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [req-038ebeb4-3322-4d1b-9aa0-36ba994c827b req-ba089129-a386-4651-b45a-f488e6919028 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21831efc-9278-477a-b760-33d7830c9423", "tag": "b228f83d-5440-4b26-bfcb-f1dd9dfc209f"}]} {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:27:11.411170 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-52b55f96-c7d4-473d-8ec8-ae9b31139683 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:11.412016 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-52b55f96-c7d4-473d-8ec8-ae9b31139683 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:11.412807 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-52b55f96-c7d4-473d-8ec8-ae9b31139683 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:11.413261 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-52b55f96-c7d4-473d-8ec8-ae9b31139683 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:11.415691 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [req-038ebeb4-3322-4d1b-9aa0-36ba994c827b req-ba089129-a386-4651-b45a-f488e6919028 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:11.416139 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [req-038ebeb4-3322-4d1b-9aa0-36ba994c827b req-ba089129-a386-4651-b45a-f488e6919028 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:11.428216 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.compute.server_external_events [req-038ebeb4-3322-4d1b-9aa0-36ba994c827b req-ba089129-a386-4651-b45a-f488e6919028 service nova] Creating event network-changed:b228f83d-5440-4b26-bfcb-f1dd9dfc209f for instance 21831efc-9278-477a-b760-33d7830c9423 on hv-cinder-84842 Jul 11 11:27:11.433802 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [req-038ebeb4-3322-4d1b-9aa0-36ba994c827b req-ba089129-a386-4651-b45a-f488e6919028 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029827 Jul 11 11:27:11.434631 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 106/207] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 11:27:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:27:11.615273 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-52b55f96-c7d4-473d-8ec8-ae9b31139683 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:11.622981 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-52b55f96-c7d4-473d-8ec8-ae9b31139683 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe" status: 200 len: 1521 microversion: 2.1 time: 0.242915 Jul 11 11:27:11.623609 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 102/208] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:27:11 2022] GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe => generated 1521 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:27:11.996238 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-11e5da16-d42c-4bd0-be03-8a0778287e49 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:11.997719 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-11e5da16-d42c-4bd0-be03-8a0778287e49 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:12.005047 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-11e5da16-d42c-4bd0-be03-8a0778287e49 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:12.005501 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-11e5da16-d42c-4bd0-be03-8a0778287e49 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:12.006401 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-11e5da16-d42c-4bd0-be03-8a0778287e49 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:12.006768 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-11e5da16-d42c-4bd0-be03-8a0778287e49 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:12.229819 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-11e5da16-d42c-4bd0-be03-8a0778287e49 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:12.247351 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-11e5da16-d42c-4bd0-be03-8a0778287e49 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1318 microversion: 2.1 time: 0.254870 Jul 11 11:27:12.253611 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 107/209] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:27:11 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1318 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:27:12.640399 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-4f3419c5-37e1-450a-aa2c-3ef13707a56a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:12.641134 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-4f3419c5-37e1-450a-aa2c-3ef13707a56a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 1df1a34e-6645-4776-ac7a-a03a47edeebe] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:12.649364 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4f3419c5-37e1-450a-aa2c-3ef13707a56a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:12.653364 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4f3419c5-37e1-450a-aa2c-3ef13707a56a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:12.653364 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4f3419c5-37e1-450a-aa2c-3ef13707a56a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:12.653364 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4f3419c5-37e1-450a-aa2c-3ef13707a56a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:12.800476 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-4f3419c5-37e1-450a-aa2c-3ef13707a56a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:12.809436 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-4f3419c5-37e1-450a-aa2c-3ef13707a56a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe" status: 200 len: 1521 microversion: 2.1 time: 0.173245 Jul 11 11:27:12.810015 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 103/210] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:27:12 2022] GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:27:13.270384 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-90809f1a-a19b-487c-8135-c3897fdbf888 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:13.271061 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-90809f1a-a19b-487c-8135-c3897fdbf888 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:13.273038 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:27:13.277586 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-90809f1a-a19b-487c-8135-c3897fdbf888 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:13.278032 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-90809f1a-a19b-487c-8135-c3897fdbf888 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:13.278791 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-90809f1a-a19b-487c-8135-c3897fdbf888 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:13.279221 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-90809f1a-a19b-487c-8135-c3897fdbf888 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:13.409031 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-90809f1a-a19b-487c-8135-c3897fdbf888 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:13.416671 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-90809f1a-a19b-487c-8135-c3897fdbf888 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1318 microversion: 2.1 time: 0.150667 Jul 11 11:27:13.417250 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 108/211] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:27:13 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:27:13.828316 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-8d588d77-ce68-40f3-8618-7aa4bdbe096a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:13.829030 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-8d588d77-ce68-40f3-8618-7aa4bdbe096a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 1df1a34e-6645-4776-ac7a-a03a47edeebe] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:13.835896 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8d588d77-ce68-40f3-8618-7aa4bdbe096a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:13.836570 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8d588d77-ce68-40f3-8618-7aa4bdbe096a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:13.837335 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8d588d77-ce68-40f3-8618-7aa4bdbe096a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:13.837769 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8d588d77-ce68-40f3-8618-7aa4bdbe096a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:13.906878 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell0:SELECT=2 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:27:13.927778 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell0:SELECT=6 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:27:13.990316 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-8d588d77-ce68-40f3-8618-7aa4bdbe096a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:14.007074 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-8d588d77-ce68-40f3-8618-7aa4bdbe096a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe" status: 200 len: 1521 microversion: 2.1 time: 0.182656 Jul 11 11:27:14.008074 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 104/212] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:27:13 2022] GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:27:14.433872 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-e7230ccf-877c-433b-b942-a704fe935d8c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:14.434482 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-e7230ccf-877c-433b-b942-a704fe935d8c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:14.441716 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e7230ccf-877c-433b-b942-a704fe935d8c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:14.442215 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e7230ccf-877c-433b-b942-a704fe935d8c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:14.443027 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e7230ccf-877c-433b-b942-a704fe935d8c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:14.443494 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e7230ccf-877c-433b-b942-a704fe935d8c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:14.572962 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-e7230ccf-877c-433b-b942-a704fe935d8c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:14.581186 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-e7230ccf-877c-433b-b942-a704fe935d8c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1318 microversion: 2.1 time: 0.151165 Jul 11 11:27:14.581791 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 109/213] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:27:14 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:27:15.024173 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-87cae805-0f23-4605-abbc-fca9077a33ed tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:15.024692 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-87cae805-0f23-4605-abbc-fca9077a33ed tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 1df1a34e-6645-4776-ac7a-a03a47edeebe] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:15.032229 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-87cae805-0f23-4605-abbc-fca9077a33ed tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:15.033241 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-87cae805-0f23-4605-abbc-fca9077a33ed tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:15.034010 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-87cae805-0f23-4605-abbc-fca9077a33ed tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:15.034468 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-87cae805-0f23-4605-abbc-fca9077a33ed tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:15.166841 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-87cae805-0f23-4605-abbc-fca9077a33ed tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:15.175232 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-87cae805-0f23-4605-abbc-fca9077a33ed tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe" status: 200 len: 1521 microversion: 2.1 time: 0.155021 Jul 11 11:27:15.175825 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 105/214] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:27:15 2022] GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:27:15.598364 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-2ab1e590-01a1-4720-bef9-604e9ff763be tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:15.599093 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-2ab1e590-01a1-4720-bef9-604e9ff763be tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:15.601062 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell0:SELECT=4 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:27:15.607755 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2ab1e590-01a1-4720-bef9-604e9ff763be tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:15.607755 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2ab1e590-01a1-4720-bef9-604e9ff763be tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:15.607755 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2ab1e590-01a1-4720-bef9-604e9ff763be tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:15.607755 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2ab1e590-01a1-4720-bef9-604e9ff763be tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:15.738507 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-2ab1e590-01a1-4720-bef9-604e9ff763be tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:15.745973 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-2ab1e590-01a1-4720-bef9-604e9ff763be tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1318 microversion: 2.1 time: 0.151998 Jul 11 11:27:15.746626 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 110/215] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:27:15 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:27:16.192723 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-26414130-372c-45ce-a0ff-59f8374062b0 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:16.193881 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-26414130-372c-45ce-a0ff-59f8374062b0 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 1df1a34e-6645-4776-ac7a-a03a47edeebe] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:16.200485 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-26414130-372c-45ce-a0ff-59f8374062b0 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:16.201039 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-26414130-372c-45ce-a0ff-59f8374062b0 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:16.201669 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-26414130-372c-45ce-a0ff-59f8374062b0 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:16.202098 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-26414130-372c-45ce-a0ff-59f8374062b0 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:16.343614 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-26414130-372c-45ce-a0ff-59f8374062b0 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:16.351010 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-26414130-372c-45ce-a0ff-59f8374062b0 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe" status: 200 len: 1521 microversion: 2.1 time: 0.162568 Jul 11 11:27:16.351631 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 106/216] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:27:16 2022] GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:27:16.762007 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-73ca01c4-2bf4-4ac4-b67e-b7338c7db374 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:16.762612 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-73ca01c4-2bf4-4ac4-b67e-b7338c7db374 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:16.768782 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-73ca01c4-2bf4-4ac4-b67e-b7338c7db374 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:16.769226 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-73ca01c4-2bf4-4ac4-b67e-b7338c7db374 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:16.769979 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-73ca01c4-2bf4-4ac4-b67e-b7338c7db374 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:16.770408 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-73ca01c4-2bf4-4ac4-b67e-b7338c7db374 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:16.897863 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-73ca01c4-2bf4-4ac4-b67e-b7338c7db374 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:16.905401 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-73ca01c4-2bf4-4ac4-b67e-b7338c7db374 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1318 microversion: 2.1 time: 0.147424 Jul 11 11:27:16.915349 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 111/217] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:27:16 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:27:17.368281 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-9649f77d-5b28-4215-abc7-b193be8b4d38 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:17.368940 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-9649f77d-5b28-4215-abc7-b193be8b4d38 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 1df1a34e-6645-4776-ac7a-a03a47edeebe] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:17.375241 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9649f77d-5b28-4215-abc7-b193be8b4d38 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:17.375721 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9649f77d-5b28-4215-abc7-b193be8b4d38 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:17.376473 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9649f77d-5b28-4215-abc7-b193be8b4d38 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:17.376905 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9649f77d-5b28-4215-abc7-b193be8b4d38 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:17.505665 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-9649f77d-5b28-4215-abc7-b193be8b4d38 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:17.513345 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-9649f77d-5b28-4215-abc7-b193be8b4d38 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe" status: 200 len: 1521 microversion: 2.1 time: 0.148921 Jul 11 11:27:17.513912 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 107/218] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:27:17 2022] GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:27:17.874005 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [req-1503dd98-7da2-4019-9ae4-6f0462417f47 req-b03a4e53-f19f-4499-ae38-29dfe4bcc64a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21831efc-9278-477a-b760-33d7830c9423", "name": "network-vif-plugged", "status": "completed", "tag": "b228f83d-5440-4b26-bfcb-f1dd9dfc209f"}]} {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:27:17.882701 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [req-1503dd98-7da2-4019-9ae4-6f0462417f47 req-b03a4e53-f19f-4499-ae38-29dfe4bcc64a service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:17.883141 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [req-1503dd98-7da2-4019-9ae4-6f0462417f47 req-b03a4e53-f19f-4499-ae38-29dfe4bcc64a service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:17.893895 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.compute.server_external_events [req-1503dd98-7da2-4019-9ae4-6f0462417f47 req-b03a4e53-f19f-4499-ae38-29dfe4bcc64a service nova] Creating event network-vif-plugged:b228f83d-5440-4b26-bfcb-f1dd9dfc209f for instance 21831efc-9278-477a-b760-33d7830c9423 on hv-cinder-84842 Jul 11 11:27:17.898945 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [req-1503dd98-7da2-4019-9ae4-6f0462417f47 req-b03a4e53-f19f-4499-ae38-29dfe4bcc64a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028697 Jul 11 11:27:17.899556 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 112/219] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 11:27:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:27:17.930115 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-870ceaa5-434e-429c-8e0b-70906aa5e889 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:17.930712 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-870ceaa5-434e-429c-8e0b-70906aa5e889 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:17.936657 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-870ceaa5-434e-429c-8e0b-70906aa5e889 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:17.937101 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-870ceaa5-434e-429c-8e0b-70906aa5e889 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:17.937846 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-870ceaa5-434e-429c-8e0b-70906aa5e889 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:17.938270 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-870ceaa5-434e-429c-8e0b-70906aa5e889 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:18.076649 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-870ceaa5-434e-429c-8e0b-70906aa5e889 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:18.085111 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-870ceaa5-434e-429c-8e0b-70906aa5e889 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1318 microversion: 2.1 time: 0.159010 Jul 11 11:27:18.085698 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 108/220] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:27:17 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:27:18.530401 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-e1da769b-8598-47c3-aa5d-9f21ab1e41d2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:18.531164 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-e1da769b-8598-47c3-aa5d-9f21ab1e41d2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 1df1a34e-6645-4776-ac7a-a03a47edeebe] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:18.538150 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e1da769b-8598-47c3-aa5d-9f21ab1e41d2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:18.538594 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e1da769b-8598-47c3-aa5d-9f21ab1e41d2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:18.539402 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e1da769b-8598-47c3-aa5d-9f21ab1e41d2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:18.539848 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e1da769b-8598-47c3-aa5d-9f21ab1e41d2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:18.685903 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-e1da769b-8598-47c3-aa5d-9f21ab1e41d2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:18.693307 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-e1da769b-8598-47c3-aa5d-9f21ab1e41d2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe" status: 200 len: 1521 microversion: 2.1 time: 0.167078 Jul 11 11:27:18.693866 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 113/221] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:27:18 2022] GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:27:19.106452 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-733990b1-3698-4376-8574-9ede6f2bb3f2 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:19.107054 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-733990b1-3698-4376-8574-9ede6f2bb3f2 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:19.113495 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-733990b1-3698-4376-8574-9ede6f2bb3f2 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:19.113934 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-733990b1-3698-4376-8574-9ede6f2bb3f2 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:19.114680 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-733990b1-3698-4376-8574-9ede6f2bb3f2 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:19.115421 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-733990b1-3698-4376-8574-9ede6f2bb3f2 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:19.254501 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-733990b1-3698-4376-8574-9ede6f2bb3f2 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:19.262015 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-733990b1-3698-4376-8574-9ede6f2bb3f2 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1318 microversion: 2.1 time: 0.159392 Jul 11 11:27:19.262620 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 109/222] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:27:19 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:27:19.709907 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-afe853af-2303-41f8-9da5-0460885b4c11 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:19.710606 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-afe853af-2303-41f8-9da5-0460885b4c11 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 1df1a34e-6645-4776-ac7a-a03a47edeebe] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:19.716647 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-afe853af-2303-41f8-9da5-0460885b4c11 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:19.717093 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-afe853af-2303-41f8-9da5-0460885b4c11 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:19.717967 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-afe853af-2303-41f8-9da5-0460885b4c11 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:19.718402 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-afe853af-2303-41f8-9da5-0460885b4c11 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:19.868873 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-afe853af-2303-41f8-9da5-0460885b4c11 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:19.877246 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-afe853af-2303-41f8-9da5-0460885b4c11 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe" status: 200 len: 1521 microversion: 2.1 time: 0.170246 Jul 11 11:27:19.877246 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 114/223] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:27:19 2022] GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:27:20.279549 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-052ebfeb-4228-436c-8030-1c605d4e9f4a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:20.280303 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-052ebfeb-4228-436c-8030-1c605d4e9f4a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:20.287162 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-052ebfeb-4228-436c-8030-1c605d4e9f4a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:20.287641 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-052ebfeb-4228-436c-8030-1c605d4e9f4a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:20.288761 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-052ebfeb-4228-436c-8030-1c605d4e9f4a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:20.290169 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-052ebfeb-4228-436c-8030-1c605d4e9f4a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:20.436990 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-052ebfeb-4228-436c-8030-1c605d4e9f4a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:20.444721 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-052ebfeb-4228-436c-8030-1c605d4e9f4a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1318 microversion: 2.1 time: 0.169329 Jul 11 11:27:20.445285 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 110/224] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:27:20 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:27:20.893714 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-2a8233e1-8cc6-4562-870c-1f620d72f420 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:20.894276 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-2a8233e1-8cc6-4562-870c-1f620d72f420 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 1df1a34e-6645-4776-ac7a-a03a47edeebe] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:20.900255 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2a8233e1-8cc6-4562-870c-1f620d72f420 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:20.900698 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2a8233e1-8cc6-4562-870c-1f620d72f420 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:20.901442 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2a8233e1-8cc6-4562-870c-1f620d72f420 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:20.901866 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2a8233e1-8cc6-4562-870c-1f620d72f420 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:21.031439 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-2a8233e1-8cc6-4562-870c-1f620d72f420 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:21.038779 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-2a8233e1-8cc6-4562-870c-1f620d72f420 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe" status: 200 len: 1521 microversion: 2.1 time: 0.149034 Jul 11 11:27:21.039363 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 115/225] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:27:20 2022] GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:27:21.460525 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-8b53b218-21f6-4043-9222-17c0e6bfe778 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:21.461132 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-8b53b218-21f6-4043-9222-17c0e6bfe778 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:21.467644 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8b53b218-21f6-4043-9222-17c0e6bfe778 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:21.468090 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8b53b218-21f6-4043-9222-17c0e6bfe778 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:21.468862 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8b53b218-21f6-4043-9222-17c0e6bfe778 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:21.469301 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8b53b218-21f6-4043-9222-17c0e6bfe778 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:21.597482 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-8b53b218-21f6-4043-9222-17c0e6bfe778 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:21.606906 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-8b53b218-21f6-4043-9222-17c0e6bfe778 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1318 microversion: 2.1 time: 0.150091 Jul 11 11:27:21.607428 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 111/226] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:27:21 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:27:22.055532 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-d5e36118-2bab-4c7f-9018-b55896453c3f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:22.056140 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-d5e36118-2bab-4c7f-9018-b55896453c3f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 1df1a34e-6645-4776-ac7a-a03a47edeebe] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:22.062126 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d5e36118-2bab-4c7f-9018-b55896453c3f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:22.062575 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d5e36118-2bab-4c7f-9018-b55896453c3f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:22.063351 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d5e36118-2bab-4c7f-9018-b55896453c3f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:22.063786 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d5e36118-2bab-4c7f-9018-b55896453c3f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:22.192531 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-d5e36118-2bab-4c7f-9018-b55896453c3f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:22.200017 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-d5e36118-2bab-4c7f-9018-b55896453c3f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe" status: 200 len: 1521 microversion: 2.1 time: 0.148606 Jul 11 11:27:22.200581 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 116/227] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:27:22 2022] GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:27:22.623710 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-70a0a79b-ca7f-489f-a4b6-373902b45c02 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:22.624406 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-70a0a79b-ca7f-489f-a4b6-373902b45c02 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:22.630827 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-70a0a79b-ca7f-489f-a4b6-373902b45c02 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:22.631295 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-70a0a79b-ca7f-489f-a4b6-373902b45c02 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:22.632042 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-70a0a79b-ca7f-489f-a4b6-373902b45c02 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:22.632466 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-70a0a79b-ca7f-489f-a4b6-373902b45c02 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:22.760783 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-70a0a79b-ca7f-489f-a4b6-373902b45c02 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:22.768146 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-70a0a79b-ca7f-489f-a4b6-373902b45c02 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1318 microversion: 2.1 time: 0.148286 Jul 11 11:27:22.769206 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 112/228] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:27:22 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:27:23.217133 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-86666a6d-1c0a-420e-b447-288c769c702e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:23.217736 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-86666a6d-1c0a-420e-b447-288c769c702e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 1df1a34e-6645-4776-ac7a-a03a47edeebe] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:23.223732 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-86666a6d-1c0a-420e-b447-288c769c702e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:23.224177 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-86666a6d-1c0a-420e-b447-288c769c702e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:23.224963 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-86666a6d-1c0a-420e-b447-288c769c702e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:23.225392 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-86666a6d-1c0a-420e-b447-288c769c702e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:23.359094 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-86666a6d-1c0a-420e-b447-288c769c702e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:23.367011 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-86666a6d-1c0a-420e-b447-288c769c702e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe" status: 200 len: 1521 microversion: 2.1 time: 0.153903 Jul 11 11:27:23.367633 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 117/229] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:27:23 2022] GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:27:23.785737 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-b0e657a5-4b5e-479b-a803-2bbf0d3439c7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:23.786399 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-b0e657a5-4b5e-479b-a803-2bbf0d3439c7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:23.793038 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b0e657a5-4b5e-479b-a803-2bbf0d3439c7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:23.793489 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b0e657a5-4b5e-479b-a803-2bbf0d3439c7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:23.794252 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b0e657a5-4b5e-479b-a803-2bbf0d3439c7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:23.794689 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b0e657a5-4b5e-479b-a803-2bbf0d3439c7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:23.927562 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-b0e657a5-4b5e-479b-a803-2bbf0d3439c7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:23.934939 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-b0e657a5-4b5e-479b-a803-2bbf0d3439c7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1318 microversion: 2.1 time: 0.153619 Jul 11 11:27:23.935534 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 113/230] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:27:23 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:27:24.384492 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-b6e21281-4c5a-400b-88bd-582992e9e7b5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:24.385974 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-b6e21281-4c5a-400b-88bd-582992e9e7b5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 1df1a34e-6645-4776-ac7a-a03a47edeebe] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:24.392871 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b6e21281-4c5a-400b-88bd-582992e9e7b5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:24.394109 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b6e21281-4c5a-400b-88bd-582992e9e7b5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:24.395087 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b6e21281-4c5a-400b-88bd-582992e9e7b5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:24.395969 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b6e21281-4c5a-400b-88bd-582992e9e7b5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:24.538016 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-b6e21281-4c5a-400b-88bd-582992e9e7b5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:24.545669 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-b6e21281-4c5a-400b-88bd-582992e9e7b5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe" status: 200 len: 1501 microversion: 2.1 time: 0.165207 Jul 11 11:27:24.553871 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 118/231] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:27:24 2022] GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe => generated 1501 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:27:24.562455 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-0787f113-7bfd-42dc-a14e-968c0a114456 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:24.563286 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-0787f113-7bfd-42dc-a14e-968c0a114456 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: b39fbe8d-e6a4-4482-981f-ac21c2b52176] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:24.570942 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0787f113-7bfd-42dc-a14e-968c0a114456 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:24.571520 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0787f113-7bfd-42dc-a14e-968c0a114456 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:24.572307 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0787f113-7bfd-42dc-a14e-968c0a114456 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:24.572741 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0787f113-7bfd-42dc-a14e-968c0a114456 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:24.707554 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-0787f113-7bfd-42dc-a14e-968c0a114456 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:24.714800 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-0787f113-7bfd-42dc-a14e-968c0a114456 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/b39fbe8d-e6a4-4482-981f-ac21c2b52176" status: 200 len: 1515 microversion: 2.1 time: 0.156602 Jul 11 11:27:24.715462 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 114/232] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:27:24 2022] GET /compute/v2.1/servers/b39fbe8d-e6a4-4482-981f-ac21c2b52176 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:27:24.951755 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-92f851d0-e3ae-4252-bb9c-5581d774dc74 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:24.952388 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-92f851d0-e3ae-4252-bb9c-5581d774dc74 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:24.959143 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-92f851d0-e3ae-4252-bb9c-5581d774dc74 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:24.959612 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-92f851d0-e3ae-4252-bb9c-5581d774dc74 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:24.960364 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-92f851d0-e3ae-4252-bb9c-5581d774dc74 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:24.960796 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-92f851d0-e3ae-4252-bb9c-5581d774dc74 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:25.091582 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-92f851d0-e3ae-4252-bb9c-5581d774dc74 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:25.093891 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=100 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:27:25.099630 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-92f851d0-e3ae-4252-bb9c-5581d774dc74 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1318 microversion: 2.1 time: 0.151633 Jul 11 11:27:25.100186 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 119/233] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:27:24 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:27:26.115918 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-8cbc85db-dfae-44d3-8760-dc94fa5a41fb tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:26.116544 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-8cbc85db-dfae-44d3-8760-dc94fa5a41fb tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:26.123079 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8cbc85db-dfae-44d3-8760-dc94fa5a41fb tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:26.123549 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8cbc85db-dfae-44d3-8760-dc94fa5a41fb tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:26.124296 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8cbc85db-dfae-44d3-8760-dc94fa5a41fb tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:26.124726 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8cbc85db-dfae-44d3-8760-dc94fa5a41fb tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:26.251898 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-8cbc85db-dfae-44d3-8760-dc94fa5a41fb tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:26.259470 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-8cbc85db-dfae-44d3-8760-dc94fa5a41fb tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1508 microversion: 2.1 time: 0.147312 Jul 11 11:27:26.260064 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 115/234] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:27:26 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1508 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:27:26.952459 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-0facc7c5-9dd6-41fb-8473-4653210c9176 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:27:26.953399 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-0facc7c5-9dd6-41fb-8473-4653210c9176 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: b39fbe8d-e6a4-4482-981f-ac21c2b52176] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:26.959656 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0facc7c5-9dd6-41fb-8473-4653210c9176 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:26.960045 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0facc7c5-9dd6-41fb-8473-4653210c9176 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:26.960800 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0facc7c5-9dd6-41fb-8473-4653210c9176 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:26.961588 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0facc7c5-9dd6-41fb-8473-4653210c9176 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:26.984526 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.objects.instance [None req-0facc7c5-9dd6-41fb-8473-4653210c9176 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lazy-loading 'flavor' on Instance uuid b39fbe8d-e6a4-4482-981f-ac21c2b52176 {{(pid=118321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 11:27:27.296335 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-0facc7c5-9dd6-41fb-8473-4653210c9176 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "POST /compute/v2.1/servers/b39fbe8d-e6a4-4482-981f-ac21c2b52176/action" status: 200 len: 32 microversion: 2.1 time: 0.347641 Jul 11 11:27:27.296765 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 120/235] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Jul 11 11:27:26 2022] POST /compute/v2.1/servers/b39fbe8d-e6a4-4482-981f-ac21c2b52176/action => generated 32 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 11 11:27:27.308572 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-06256f96-9e6f-4b7a-8639-206de3522373 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:27.309917 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-06256f96-9e6f-4b7a-8639-206de3522373 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: b39fbe8d-e6a4-4482-981f-ac21c2b52176] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:27.318380 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-06256f96-9e6f-4b7a-8639-206de3522373 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:27.324952 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-06256f96-9e6f-4b7a-8639-206de3522373 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:27.324952 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-06256f96-9e6f-4b7a-8639-206de3522373 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:27.324952 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-06256f96-9e6f-4b7a-8639-206de3522373 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:27.460625 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-06256f96-9e6f-4b7a-8639-206de3522373 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:27.468599 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-06256f96-9e6f-4b7a-8639-206de3522373 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/b39fbe8d-e6a4-4482-981f-ac21c2b52176" status: 200 len: 1521 microversion: 2.1 time: 0.165977 Jul 11 11:27:27.469192 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 116/236] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:27:27 2022] GET /compute/v2.1/servers/b39fbe8d-e6a4-4482-981f-ac21c2b52176 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:27:28.488581 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-b4d68758-ad08-4c7e-89a4-f7c129423043 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:28.489298 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-b4d68758-ad08-4c7e-89a4-f7c129423043 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: b39fbe8d-e6a4-4482-981f-ac21c2b52176] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:28.496188 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b4d68758-ad08-4c7e-89a4-f7c129423043 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:28.501132 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b4d68758-ad08-4c7e-89a4-f7c129423043 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:28.501132 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b4d68758-ad08-4c7e-89a4-f7c129423043 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:28.501132 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b4d68758-ad08-4c7e-89a4-f7c129423043 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:28.639075 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-b4d68758-ad08-4c7e-89a4-f7c129423043 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:28.646864 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-b4d68758-ad08-4c7e-89a4-f7c129423043 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/b39fbe8d-e6a4-4482-981f-ac21c2b52176" status: 200 len: 1521 microversion: 2.1 time: 0.163818 Jul 11 11:27:28.650950 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 121/237] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:27:28 2022] GET /compute/v2.1/servers/b39fbe8d-e6a4-4482-981f-ac21c2b52176 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:27:29.664714 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-8a5494d6-3f4e-4c31-b265-28c5b8df20e8 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:29.665323 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-8a5494d6-3f4e-4c31-b265-28c5b8df20e8 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: b39fbe8d-e6a4-4482-981f-ac21c2b52176] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:29.671838 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8a5494d6-3f4e-4c31-b265-28c5b8df20e8 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:29.672280 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8a5494d6-3f4e-4c31-b265-28c5b8df20e8 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:29.673026 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8a5494d6-3f4e-4c31-b265-28c5b8df20e8 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:29.673483 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8a5494d6-3f4e-4c31-b265-28c5b8df20e8 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:29.678225 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=100 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:27:29.809984 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-8a5494d6-3f4e-4c31-b265-28c5b8df20e8 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:29.817544 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-8a5494d6-3f4e-4c31-b265-28c5b8df20e8 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/b39fbe8d-e6a4-4482-981f-ac21c2b52176" status: 200 len: 1521 microversion: 2.1 time: 0.156715 Jul 11 11:27:29.828032 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 117/238] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:27:29 2022] GET /compute/v2.1/servers/b39fbe8d-e6a4-4482-981f-ac21c2b52176 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:27:30.833974 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-1b2d4da9-664d-4718-8643-edcfb13dff26 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:30.834685 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-1b2d4da9-664d-4718-8643-edcfb13dff26 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: b39fbe8d-e6a4-4482-981f-ac21c2b52176] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:30.843944 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1b2d4da9-664d-4718-8643-edcfb13dff26 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:30.844742 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1b2d4da9-664d-4718-8643-edcfb13dff26 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:30.845799 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1b2d4da9-664d-4718-8643-edcfb13dff26 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:30.846282 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1b2d4da9-664d-4718-8643-edcfb13dff26 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:30.981818 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-1b2d4da9-664d-4718-8643-edcfb13dff26 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:30.989743 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-1b2d4da9-664d-4718-8643-edcfb13dff26 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/b39fbe8d-e6a4-4482-981f-ac21c2b52176" status: 200 len: 1521 microversion: 2.1 time: 0.159997 Jul 11 11:27:30.990761 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 122/239] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:27:30 2022] GET /compute/v2.1/servers/b39fbe8d-e6a4-4482-981f-ac21c2b52176 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:27:32.006307 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-3a00f33a-2a6f-41e3-ad4a-9969f88c76ce tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:32.007668 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-3a00f33a-2a6f-41e3-ad4a-9969f88c76ce tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: b39fbe8d-e6a4-4482-981f-ac21c2b52176] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:32.018946 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3a00f33a-2a6f-41e3-ad4a-9969f88c76ce tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:32.019433 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3a00f33a-2a6f-41e3-ad4a-9969f88c76ce tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:32.020196 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3a00f33a-2a6f-41e3-ad4a-9969f88c76ce tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:32.020622 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3a00f33a-2a6f-41e3-ad4a-9969f88c76ce tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:32.151925 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-3a00f33a-2a6f-41e3-ad4a-9969f88c76ce tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:32.159408 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-3a00f33a-2a6f-41e3-ad4a-9969f88c76ce tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/b39fbe8d-e6a4-4482-981f-ac21c2b52176" status: 200 len: 1521 microversion: 2.1 time: 0.157465 Jul 11 11:27:32.159972 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 118/240] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:27:32 2022] GET /compute/v2.1/servers/b39fbe8d-e6a4-4482-981f-ac21c2b52176 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:27:33.178094 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-9ca9acf3-f9a9-4a26-ad74-45123b39aa5a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:33.178703 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-9ca9acf3-f9a9-4a26-ad74-45123b39aa5a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: b39fbe8d-e6a4-4482-981f-ac21c2b52176] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:33.185066 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9ca9acf3-f9a9-4a26-ad74-45123b39aa5a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:33.185521 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9ca9acf3-f9a9-4a26-ad74-45123b39aa5a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:33.186291 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9ca9acf3-f9a9-4a26-ad74-45123b39aa5a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:33.186727 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9ca9acf3-f9a9-4a26-ad74-45123b39aa5a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:33.358504 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-9ca9acf3-f9a9-4a26-ad74-45123b39aa5a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:33.366769 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-9ca9acf3-f9a9-4a26-ad74-45123b39aa5a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/b39fbe8d-e6a4-4482-981f-ac21c2b52176" status: 200 len: 1521 microversion: 2.1 time: 0.193490 Jul 11 11:27:33.370227 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 123/241] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:27:33 2022] GET /compute/v2.1/servers/b39fbe8d-e6a4-4482-981f-ac21c2b52176 => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:27:34.384018 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-aef1cf7f-7abe-4aec-a8fe-c567e97d54b3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:34.384652 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-aef1cf7f-7abe-4aec-a8fe-c567e97d54b3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: b39fbe8d-e6a4-4482-981f-ac21c2b52176] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:34.391798 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-aef1cf7f-7abe-4aec-a8fe-c567e97d54b3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:34.392336 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-aef1cf7f-7abe-4aec-a8fe-c567e97d54b3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:34.393888 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-aef1cf7f-7abe-4aec-a8fe-c567e97d54b3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:34.394326 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-aef1cf7f-7abe-4aec-a8fe-c567e97d54b3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:34.534989 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-aef1cf7f-7abe-4aec-a8fe-c567e97d54b3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:34.543051 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-aef1cf7f-7abe-4aec-a8fe-c567e97d54b3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/b39fbe8d-e6a4-4482-981f-ac21c2b52176" status: 200 len: 1521 microversion: 2.1 time: 0.162953 Jul 11 11:27:34.543724 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 119/242] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:27:34 2022] GET /compute/v2.1/servers/b39fbe8d-e6a4-4482-981f-ac21c2b52176 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:27:35.560720 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-d07946dd-1bed-4d32-9cad-a50273407ccf tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:35.561358 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-d07946dd-1bed-4d32-9cad-a50273407ccf tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: b39fbe8d-e6a4-4482-981f-ac21c2b52176] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:35.568158 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d07946dd-1bed-4d32-9cad-a50273407ccf tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:35.568868 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d07946dd-1bed-4d32-9cad-a50273407ccf tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:35.569789 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d07946dd-1bed-4d32-9cad-a50273407ccf tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:35.570236 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d07946dd-1bed-4d32-9cad-a50273407ccf tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:35.710649 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-d07946dd-1bed-4d32-9cad-a50273407ccf tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:35.721197 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-d07946dd-1bed-4d32-9cad-a50273407ccf tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/b39fbe8d-e6a4-4482-981f-ac21c2b52176" status: 200 len: 1521 microversion: 2.1 time: 0.162247 Jul 11 11:27:35.721197 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 124/243] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:27:35 2022] GET /compute/v2.1/servers/b39fbe8d-e6a4-4482-981f-ac21c2b52176 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:27:36.735639 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-077aa757-8bca-4b83-b1e8-1cf55c250c47 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:36.736386 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-077aa757-8bca-4b83-b1e8-1cf55c250c47 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: b39fbe8d-e6a4-4482-981f-ac21c2b52176] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:36.746559 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-077aa757-8bca-4b83-b1e8-1cf55c250c47 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:36.747004 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-077aa757-8bca-4b83-b1e8-1cf55c250c47 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:36.747804 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-077aa757-8bca-4b83-b1e8-1cf55c250c47 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:36.748238 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-077aa757-8bca-4b83-b1e8-1cf55c250c47 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:36.902903 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-077aa757-8bca-4b83-b1e8-1cf55c250c47 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:36.913277 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-077aa757-8bca-4b83-b1e8-1cf55c250c47 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/b39fbe8d-e6a4-4482-981f-ac21c2b52176" status: 200 len: 1521 microversion: 2.1 time: 0.181209 Jul 11 11:27:36.913904 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 120/244] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:27:36 2022] GET /compute/v2.1/servers/b39fbe8d-e6a4-4482-981f-ac21c2b52176 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:27:37.939152 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-6dcf672b-fdc5-4afa-9161-dd94978447a4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:37.940608 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-6dcf672b-fdc5-4afa-9161-dd94978447a4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: b39fbe8d-e6a4-4482-981f-ac21c2b52176] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:37.948067 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6dcf672b-fdc5-4afa-9161-dd94978447a4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:37.948568 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6dcf672b-fdc5-4afa-9161-dd94978447a4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:37.949475 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6dcf672b-fdc5-4afa-9161-dd94978447a4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:37.950165 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6dcf672b-fdc5-4afa-9161-dd94978447a4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:38.126026 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-6dcf672b-fdc5-4afa-9161-dd94978447a4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:38.133372 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-6dcf672b-fdc5-4afa-9161-dd94978447a4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/b39fbe8d-e6a4-4482-981f-ac21c2b52176" status: 200 len: 1521 microversion: 2.1 time: 0.198654 Jul 11 11:27:38.133947 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 125/245] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:27:37 2022] GET /compute/v2.1/servers/b39fbe8d-e6a4-4482-981f-ac21c2b52176 => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:27:39.152784 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-a380021a-f963-4527-956f-a689eb96eb43 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:39.153398 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-a380021a-f963-4527-956f-a689eb96eb43 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: b39fbe8d-e6a4-4482-981f-ac21c2b52176] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:39.163578 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a380021a-f963-4527-956f-a689eb96eb43 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:39.164075 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a380021a-f963-4527-956f-a689eb96eb43 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:39.168499 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a380021a-f963-4527-956f-a689eb96eb43 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:39.168499 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a380021a-f963-4527-956f-a689eb96eb43 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:39.311997 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-a380021a-f963-4527-956f-a689eb96eb43 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:39.319566 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-a380021a-f963-4527-956f-a689eb96eb43 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/b39fbe8d-e6a4-4482-981f-ac21c2b52176" status: 200 len: 1521 microversion: 2.1 time: 0.172675 Jul 11 11:27:39.320126 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 121/246] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:27:39 2022] GET /compute/v2.1/servers/b39fbe8d-e6a4-4482-981f-ac21c2b52176 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:27:40.336133 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-73da3250-40aa-4d9b-814f-c4988bc4b1cc tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:40.336850 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-73da3250-40aa-4d9b-814f-c4988bc4b1cc tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: b39fbe8d-e6a4-4482-981f-ac21c2b52176] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:40.342997 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-73da3250-40aa-4d9b-814f-c4988bc4b1cc tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:40.343556 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-73da3250-40aa-4d9b-814f-c4988bc4b1cc tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:40.344385 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-73da3250-40aa-4d9b-814f-c4988bc4b1cc tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:40.344919 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-73da3250-40aa-4d9b-814f-c4988bc4b1cc tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:40.492864 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-73da3250-40aa-4d9b-814f-c4988bc4b1cc tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:40.500270 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-73da3250-40aa-4d9b-814f-c4988bc4b1cc tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/b39fbe8d-e6a4-4482-981f-ac21c2b52176" status: 200 len: 1521 microversion: 2.1 time: 0.168110 Jul 11 11:27:40.500875 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 126/247] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:27:40 2022] GET /compute/v2.1/servers/b39fbe8d-e6a4-4482-981f-ac21c2b52176 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:27:41.167331 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-0f703060-39d7-4e27-a0eb-041b5d6672e6 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-553956665", "imageRef": "1bb93fc1-b713-4e67-8f76-bfec3a96168b", "flavorRef": "452", "networks": [{"uuid": "17637e39-a722-4f0d-8b40-9106b67b2b4b"}]}} {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:27:41.359356 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.network.neutron [None req-0f703060-39d7-4e27-a0eb-041b5d6672e6 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] validate_networks() for [('17637e39-a722-4f0d-8b40-9106b67b2b4b', None, None, None, None, None)] {{(pid=118322) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 11:27:41.517796 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-edeee636-df52-481f-87a6-6ce087d84635 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:41.519787 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-edeee636-df52-481f-87a6-6ce087d84635 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: b39fbe8d-e6a4-4482-981f-ac21c2b52176] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:41.527654 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-edeee636-df52-481f-87a6-6ce087d84635 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:41.528203 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-edeee636-df52-481f-87a6-6ce087d84635 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:41.529051 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-edeee636-df52-481f-87a6-6ce087d84635 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:41.529549 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-edeee636-df52-481f-87a6-6ce087d84635 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:41.674350 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-edeee636-df52-481f-87a6-6ce087d84635 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:41.684725 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-edeee636-df52-481f-87a6-6ce087d84635 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/b39fbe8d-e6a4-4482-981f-ac21c2b52176" status: 200 len: 1521 microversion: 2.1 time: 0.170671 Jul 11 11:27:41.685434 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 127/248] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:27:41 2022] GET /compute/v2.1/servers/b39fbe8d-e6a4-4482-981f-ac21c2b52176 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:27:41.934908 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.virt.hardware [None req-0f703060-39d7-4e27-a0eb-041b5d6672e6 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Flavor limits 0:0:0 {{(pid=118322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 11:27:41.935434 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.virt.hardware [None req-0f703060-39d7-4e27-a0eb-041b5d6672e6 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Image limits 0:0:0 {{(pid=118322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 11:27:41.936019 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.virt.hardware [None req-0f703060-39d7-4e27-a0eb-041b5d6672e6 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Flavor pref 0:0:0 {{(pid=118322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 11:27:41.936520 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.virt.hardware [None req-0f703060-39d7-4e27-a0eb-041b5d6672e6 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Image pref 0:0:0 {{(pid=118322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 11:27:41.937087 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.virt.hardware [None req-0f703060-39d7-4e27-a0eb-041b5d6672e6 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 11:27:41.948562 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0f703060-39d7-4e27-a0eb-041b5d6672e6 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:41.949008 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0f703060-39d7-4e27-a0eb-041b5d6672e6 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:41.951727 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0f703060-39d7-4e27-a0eb-041b5d6672e6 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:41.951727 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0f703060-39d7-4e27-a0eb-041b5d6672e6 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:41.967494 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.quota [None req-0f703060-39d7-4e27-a0eb-041b5d6672e6 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Getting quotas for project 890e7e79ff744b6b9589f166cd7d8979. Resources: {'cores', 'ram', 'instances'} {{(pid=118322) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 11:27:41.971320 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.quota [None req-0f703060-39d7-4e27-a0eb-041b5d6672e6 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Getting quotas for user 9dc29ac59eed483b8c6443c397505adc and project 890e7e79ff744b6b9589f166cd7d8979. Resources: {'cores', 'ram', 'instances'} {{(pid=118322) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 11:27:41.982569 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-0f703060-39d7-4e27-a0eb-041b5d6672e6 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Going to run 1 instances... {{(pid=118322) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 11:27:41.984760 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-0f703060-39d7-4e27-a0eb-041b5d6672e6 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] [instance: f6b6dcad-2258-4120-9256-bef3997f8486] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb93fc1-b713-4e67-8f76-bfec3a96168b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118322) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 11:27:42.235942 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-0f703060-39d7-4e27-a0eb-041b5d6672e6 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.072327 Jul 11 11:27:42.241620 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 122/249] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jul 11 11:27:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1078 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 11 11:27:42.248274 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-32908154-9ed1-47cd-b9f3-d6ae0faccea7 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:42.251352 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-32908154-9ed1-47cd-b9f3-d6ae0faccea7 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] [instance: f6b6dcad-2258-4120-9256-bef3997f8486] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:42.313800 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-32908154-9ed1-47cd-b9f3-d6ae0faccea7 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc29ac59eed483b8c6443c397505adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890e7e79ff744b6b9589f166cd7d8979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:42.322166 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-32908154-9ed1-47cd-b9f3-d6ae0faccea7 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] 10.222.0.26 "GET /compute/v2.1/servers/f6b6dcad-2258-4120-9256-bef3997f8486" status: 200 len: 1213 microversion: 2.1 time: 0.079376 Jul 11 11:27:42.322729 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 128/250] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:27:42 2022] GET /compute/v2.1/servers/f6b6dcad-2258-4120-9256-bef3997f8486 => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:27:42.701013 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-c7016fb9-d353-40ec-9cf4-187fadf950b7 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:42.701621 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-c7016fb9-d353-40ec-9cf4-187fadf950b7 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: b39fbe8d-e6a4-4482-981f-ac21c2b52176] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:42.707700 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c7016fb9-d353-40ec-9cf4-187fadf950b7 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:42.708231 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c7016fb9-d353-40ec-9cf4-187fadf950b7 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:42.709323 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c7016fb9-d353-40ec-9cf4-187fadf950b7 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:42.709800 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c7016fb9-d353-40ec-9cf4-187fadf950b7 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:42.844712 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-c7016fb9-d353-40ec-9cf4-187fadf950b7 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:42.853123 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-c7016fb9-d353-40ec-9cf4-187fadf950b7 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/b39fbe8d-e6a4-4482-981f-ac21c2b52176" status: 200 len: 1521 microversion: 2.1 time: 0.155928 Jul 11 11:27:42.856294 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 123/251] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:27:42 2022] GET /compute/v2.1/servers/b39fbe8d-e6a4-4482-981f-ac21c2b52176 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:27:43.341354 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-eb4e96c2-6ead-4545-ae98-5a40e10d2b18 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:43.345189 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-eb4e96c2-6ead-4545-ae98-5a40e10d2b18 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] [instance: f6b6dcad-2258-4120-9256-bef3997f8486] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:43.398146 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-eb4e96c2-6ead-4545-ae98-5a40e10d2b18 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc29ac59eed483b8c6443c397505adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890e7e79ff744b6b9589f166cd7d8979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:43.405826 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-eb4e96c2-6ead-4545-ae98-5a40e10d2b18 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] 10.222.0.26 "GET /compute/v2.1/servers/f6b6dcad-2258-4120-9256-bef3997f8486" status: 200 len: 1213 microversion: 2.1 time: 0.069626 Jul 11 11:27:43.406395 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 129/252] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:27:43 2022] GET /compute/v2.1/servers/f6b6dcad-2258-4120-9256-bef3997f8486 => generated 1213 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:27:43.871122 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-76ebec17-0b1a-4c74-a893-490deeda8c00 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:43.871667 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-76ebec17-0b1a-4c74-a893-490deeda8c00 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: b39fbe8d-e6a4-4482-981f-ac21c2b52176] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:43.873937 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:27:43.878607 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-76ebec17-0b1a-4c74-a893-490deeda8c00 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:43.879139 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-76ebec17-0b1a-4c74-a893-490deeda8c00 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:43.887722 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-76ebec17-0b1a-4c74-a893-490deeda8c00 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:43.887722 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-76ebec17-0b1a-4c74-a893-490deeda8c00 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:44.016780 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-76ebec17-0b1a-4c74-a893-490deeda8c00 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:44.025017 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-76ebec17-0b1a-4c74-a893-490deeda8c00 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/b39fbe8d-e6a4-4482-981f-ac21c2b52176" status: 200 len: 1521 microversion: 2.1 time: 0.157724 Jul 11 11:27:44.025683 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 124/253] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:27:43 2022] GET /compute/v2.1/servers/b39fbe8d-e6a4-4482-981f-ac21c2b52176 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:27:44.423639 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-a7eb721f-55ee-41a6-b015-f9acb9aa8a34 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:44.424290 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-a7eb721f-55ee-41a6-b015-f9acb9aa8a34 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] [instance: f6b6dcad-2258-4120-9256-bef3997f8486] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:44.430745 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a7eb721f-55ee-41a6-b015-f9acb9aa8a34 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:44.431191 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a7eb721f-55ee-41a6-b015-f9acb9aa8a34 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:44.431965 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a7eb721f-55ee-41a6-b015-f9acb9aa8a34 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:44.432438 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a7eb721f-55ee-41a6-b015-f9acb9aa8a34 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:44.497045 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-a7eb721f-55ee-41a6-b015-f9acb9aa8a34 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc29ac59eed483b8c6443c397505adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890e7e79ff744b6b9589f166cd7d8979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:44.504688 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-a7eb721f-55ee-41a6-b015-f9acb9aa8a34 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] 10.222.0.26 "GET /compute/v2.1/servers/f6b6dcad-2258-4120-9256-bef3997f8486" status: 200 len: 1265 microversion: 2.1 time: 0.085317 Jul 11 11:27:44.506896 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 130/254] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:27:44 2022] GET /compute/v2.1/servers/f6b6dcad-2258-4120-9256-bef3997f8486 => generated 1265 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:27:45.042944 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-077f0b5a-89ae-4ab6-b921-33de1cccb06a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:45.043583 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-077f0b5a-89ae-4ab6-b921-33de1cccb06a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: b39fbe8d-e6a4-4482-981f-ac21c2b52176] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:45.060276 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-077f0b5a-89ae-4ab6-b921-33de1cccb06a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:45.060730 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-077f0b5a-89ae-4ab6-b921-33de1cccb06a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:45.063659 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-077f0b5a-89ae-4ab6-b921-33de1cccb06a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:45.064109 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-077f0b5a-89ae-4ab6-b921-33de1cccb06a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:45.273747 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-077f0b5a-89ae-4ab6-b921-33de1cccb06a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:45.282321 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-077f0b5a-89ae-4ab6-b921-33de1cccb06a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/b39fbe8d-e6a4-4482-981f-ac21c2b52176" status: 200 len: 1521 microversion: 2.1 time: 0.243949 Jul 11 11:27:45.283295 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 125/255] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:27:45 2022] GET /compute/v2.1/servers/b39fbe8d-e6a4-4482-981f-ac21c2b52176 => generated 1521 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:27:45.523153 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-fa596b76-9590-4edc-8126-a164eecbce5b tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:45.523715 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-fa596b76-9590-4edc-8126-a164eecbce5b tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] [instance: f6b6dcad-2258-4120-9256-bef3997f8486] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:45.530029 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fa596b76-9590-4edc-8126-a164eecbce5b tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:45.530480 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fa596b76-9590-4edc-8126-a164eecbce5b tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:45.531243 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fa596b76-9590-4edc-8126-a164eecbce5b tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:45.531698 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fa596b76-9590-4edc-8126-a164eecbce5b tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:45.607216 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-fa596b76-9590-4edc-8126-a164eecbce5b tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc29ac59eed483b8c6443c397505adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890e7e79ff744b6b9589f166cd7d8979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:45.615771 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-fa596b76-9590-4edc-8126-a164eecbce5b tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] 10.222.0.26 "GET /compute/v2.1/servers/f6b6dcad-2258-4120-9256-bef3997f8486" status: 200 len: 1271 microversion: 2.1 time: 0.097756 Jul 11 11:27:45.627179 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 131/256] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:27:45 2022] GET /compute/v2.1/servers/f6b6dcad-2258-4120-9256-bef3997f8486 => generated 1271 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:27:46.304977 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-9103c67c-7e24-4cc7-ac4c-70e07b8af311 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:46.305615 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-9103c67c-7e24-4cc7-ac4c-70e07b8af311 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: b39fbe8d-e6a4-4482-981f-ac21c2b52176] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:46.311945 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9103c67c-7e24-4cc7-ac4c-70e07b8af311 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:46.312388 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9103c67c-7e24-4cc7-ac4c-70e07b8af311 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:46.313152 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9103c67c-7e24-4cc7-ac4c-70e07b8af311 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:46.313584 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9103c67c-7e24-4cc7-ac4c-70e07b8af311 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:46.459246 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-9103c67c-7e24-4cc7-ac4c-70e07b8af311 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:46.467041 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-9103c67c-7e24-4cc7-ac4c-70e07b8af311 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/b39fbe8d-e6a4-4482-981f-ac21c2b52176" status: 200 len: 1521 microversion: 2.1 time: 0.168806 Jul 11 11:27:46.467640 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 126/257] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:27:46 2022] GET /compute/v2.1/servers/b39fbe8d-e6a4-4482-981f-ac21c2b52176 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:27:46.547395 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-055b2d93-eacf-4d6a-91d3-e5875e64ca24 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:46.547926 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-055b2d93-eacf-4d6a-91d3-e5875e64ca24 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:46.549853 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_api:SELECT=52 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:27:46.554890 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-055b2d93-eacf-4d6a-91d3-e5875e64ca24 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:46.555364 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-055b2d93-eacf-4d6a-91d3-e5875e64ca24 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:46.556173 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-055b2d93-eacf-4d6a-91d3-e5875e64ca24 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:46.556601 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-055b2d93-eacf-4d6a-91d3-e5875e64ca24 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:46.583022 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-055b2d93-eacf-4d6a-91d3-e5875e64ca24 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703/ips" status: 200 len: 151 microversion: 2.20 time: 0.039562 Jul 11 11:27:46.584568 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 132/258] 10.222.0.26 () {60 vars in 1288 bytes} [Mon Jul 11 11:27:46 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703/ips => generated 151 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 11:27:46.634906 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-def2a450-c034-4be2-b16e-8250b8494edb tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:46.635861 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-def2a450-c034-4be2-b16e-8250b8494edb tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] [instance: f6b6dcad-2258-4120-9256-bef3997f8486] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:46.643056 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-def2a450-c034-4be2-b16e-8250b8494edb tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:46.643527 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-def2a450-c034-4be2-b16e-8250b8494edb tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:46.647684 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-def2a450-c034-4be2-b16e-8250b8494edb tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:46.648581 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-def2a450-c034-4be2-b16e-8250b8494edb tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:46.795837 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-def2a450-c034-4be2-b16e-8250b8494edb tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc29ac59eed483b8c6443c397505adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890e7e79ff744b6b9589f166cd7d8979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:46.806122 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-def2a450-c034-4be2-b16e-8250b8494edb tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] 10.222.0.26 "GET /compute/v2.1/servers/f6b6dcad-2258-4120-9256-bef3997f8486" status: 200 len: 1313 microversion: 2.1 time: 0.175938 Jul 11 11:27:46.806870 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 127/259] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:27:46 2022] GET /compute/v2.1/servers/f6b6dcad-2258-4120-9256-bef3997f8486 => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:27:46.832782 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [req-5208b8e0-da21-484a-9eae-e5bc61b2bfc2 req-f236b685-8ffc-4b88-9108-447d915782c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6b6dcad-2258-4120-9256-bef3997f8486", "tag": "91abd770-9e4b-442e-b326-9779cdfa6a37"}]} {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:27:46.840992 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [req-5208b8e0-da21-484a-9eae-e5bc61b2bfc2 req-f236b685-8ffc-4b88-9108-447d915782c3 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:46.841446 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [req-5208b8e0-da21-484a-9eae-e5bc61b2bfc2 req-f236b685-8ffc-4b88-9108-447d915782c3 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:46.852658 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.compute.server_external_events [req-5208b8e0-da21-484a-9eae-e5bc61b2bfc2 req-f236b685-8ffc-4b88-9108-447d915782c3 service nova] Creating event network-changed:91abd770-9e4b-442e-b326-9779cdfa6a37 for instance f6b6dcad-2258-4120-9256-bef3997f8486 on hv-cinder-84842 Jul 11 11:27:46.857659 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [req-5208b8e0-da21-484a-9eae-e5bc61b2bfc2 req-f236b685-8ffc-4b88-9108-447d915782c3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028428 Jul 11 11:27:46.858418 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 133/260] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 11:27:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:27:47.484698 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-efda0a38-0dff-4d5a-8bbc-218e44854ffd tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:47.486255 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-efda0a38-0dff-4d5a-8bbc-218e44854ffd tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: b39fbe8d-e6a4-4482-981f-ac21c2b52176] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:47.494270 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-efda0a38-0dff-4d5a-8bbc-218e44854ffd tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:47.495009 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-efda0a38-0dff-4d5a-8bbc-218e44854ffd tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:47.496039 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-efda0a38-0dff-4d5a-8bbc-218e44854ffd tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:47.496702 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-efda0a38-0dff-4d5a-8bbc-218e44854ffd tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:47.680785 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-efda0a38-0dff-4d5a-8bbc-218e44854ffd tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:47.688472 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-efda0a38-0dff-4d5a-8bbc-218e44854ffd tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/b39fbe8d-e6a4-4482-981f-ac21c2b52176" status: 200 len: 1521 microversion: 2.1 time: 0.207533 Jul 11 11:27:47.689130 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 128/261] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:27:47 2022] GET /compute/v2.1/servers/b39fbe8d-e6a4-4482-981f-ac21c2b52176 => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:27:47.823596 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-45b5cc28-4762-4dba-a065-83a477153ba8 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:47.824293 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-45b5cc28-4762-4dba-a065-83a477153ba8 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] [instance: f6b6dcad-2258-4120-9256-bef3997f8486] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:47.830649 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-45b5cc28-4762-4dba-a065-83a477153ba8 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:47.831096 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-45b5cc28-4762-4dba-a065-83a477153ba8 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:47.831879 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-45b5cc28-4762-4dba-a065-83a477153ba8 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:47.832306 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-45b5cc28-4762-4dba-a065-83a477153ba8 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:47.971466 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-45b5cc28-4762-4dba-a065-83a477153ba8 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc29ac59eed483b8c6443c397505adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890e7e79ff744b6b9589f166cd7d8979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:47.980415 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-45b5cc28-4762-4dba-a065-83a477153ba8 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] 10.222.0.26 "GET /compute/v2.1/servers/f6b6dcad-2258-4120-9256-bef3997f8486" status: 200 len: 1313 microversion: 2.1 time: 0.161123 Jul 11 11:27:47.990268 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 134/262] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:27:47 2022] GET /compute/v2.1/servers/f6b6dcad-2258-4120-9256-bef3997f8486 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:27:48.705555 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-399ced97-bf47-44eb-a2f3-440ac53e208c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:48.706277 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-399ced97-bf47-44eb-a2f3-440ac53e208c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: b39fbe8d-e6a4-4482-981f-ac21c2b52176] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:48.712925 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-399ced97-bf47-44eb-a2f3-440ac53e208c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:48.713548 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-399ced97-bf47-44eb-a2f3-440ac53e208c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:48.718284 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-399ced97-bf47-44eb-a2f3-440ac53e208c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:48.718284 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-399ced97-bf47-44eb-a2f3-440ac53e208c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:48.844450 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-399ced97-bf47-44eb-a2f3-440ac53e208c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:48.852771 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-399ced97-bf47-44eb-a2f3-440ac53e208c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/b39fbe8d-e6a4-4482-981f-ac21c2b52176" status: 200 len: 1521 microversion: 2.1 time: 0.151065 Jul 11 11:27:48.853372 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 129/263] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:27:48 2022] GET /compute/v2.1/servers/b39fbe8d-e6a4-4482-981f-ac21c2b52176 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:27:48.997693 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-a0d451f7-bce9-4c40-8e84-1e7c541064ca tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:48.998291 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-a0d451f7-bce9-4c40-8e84-1e7c541064ca tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] [instance: f6b6dcad-2258-4120-9256-bef3997f8486] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:49.004196 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a0d451f7-bce9-4c40-8e84-1e7c541064ca tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:49.004633 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a0d451f7-bce9-4c40-8e84-1e7c541064ca tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:49.005456 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a0d451f7-bce9-4c40-8e84-1e7c541064ca tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:49.005910 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a0d451f7-bce9-4c40-8e84-1e7c541064ca tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:49.130974 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-a0d451f7-bce9-4c40-8e84-1e7c541064ca tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc29ac59eed483b8c6443c397505adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890e7e79ff744b6b9589f166cd7d8979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:49.138338 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-a0d451f7-bce9-4c40-8e84-1e7c541064ca tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] 10.222.0.26 "GET /compute/v2.1/servers/f6b6dcad-2258-4120-9256-bef3997f8486" status: 200 len: 1313 microversion: 2.1 time: 0.144516 Jul 11 11:27:49.138928 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 135/264] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:27:48 2022] GET /compute/v2.1/servers/f6b6dcad-2258-4120-9256-bef3997f8486 => generated 1313 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:27:49.523703 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-0233533f-6db9-4062-ab13-68c2bfcaa922 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:49.524655 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-0233533f-6db9-4062-ab13-68c2bfcaa922 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:49.531354 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0233533f-6db9-4062-ab13-68c2bfcaa922 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:49.531800 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0233533f-6db9-4062-ab13-68c2bfcaa922 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:49.532560 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0233533f-6db9-4062-ab13-68c2bfcaa922 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:49.532984 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0233533f-6db9-4062-ab13-68c2bfcaa922 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:49.556887 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-0233533f-6db9-4062-ab13-68c2bfcaa922 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/ips" status: 200 len: 151 microversion: 2.1 time: 0.037950 Jul 11 11:27:49.557449 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 130/265] 10.222.0.26 () {58 vars in 1247 bytes} [Mon Jul 11 11:27:49 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:27:49.876802 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-202061a4-6c2d-4d67-9b89-d1fc4b870889 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:49.876802 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-202061a4-6c2d-4d67-9b89-d1fc4b870889 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: b39fbe8d-e6a4-4482-981f-ac21c2b52176] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:49.879069 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-202061a4-6c2d-4d67-9b89-d1fc4b870889 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:49.883863 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-202061a4-6c2d-4d67-9b89-d1fc4b870889 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:49.885203 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-202061a4-6c2d-4d67-9b89-d1fc4b870889 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:49.885649 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-202061a4-6c2d-4d67-9b89-d1fc4b870889 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:50.026543 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-202061a4-6c2d-4d67-9b89-d1fc4b870889 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:50.033930 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-202061a4-6c2d-4d67-9b89-d1fc4b870889 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/b39fbe8d-e6a4-4482-981f-ac21c2b52176" status: 200 len: 1521 microversion: 2.1 time: 0.167780 Jul 11 11:27:50.034485 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 136/266] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:27:49 2022] GET /compute/v2.1/servers/b39fbe8d-e6a4-4482-981f-ac21c2b52176 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:27:50.154599 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-b675bb35-b7ba-40d6-b60a-8b2938a90474 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:50.155209 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-b675bb35-b7ba-40d6-b60a-8b2938a90474 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] [instance: f6b6dcad-2258-4120-9256-bef3997f8486] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:50.164112 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b675bb35-b7ba-40d6-b60a-8b2938a90474 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:50.164112 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b675bb35-b7ba-40d6-b60a-8b2938a90474 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:50.164112 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b675bb35-b7ba-40d6-b60a-8b2938a90474 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:50.164538 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b675bb35-b7ba-40d6-b60a-8b2938a90474 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:50.196468 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-63b78ec1-b0cf-4fb6-8d69-129cd3651ea2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:27:50.196961 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-63b78ec1-b0cf-4fb6-8d69-129cd3651ea2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:50.208941 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-63b78ec1-b0cf-4fb6-8d69-129cd3651ea2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:50.213545 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-63b78ec1-b0cf-4fb6-8d69-129cd3651ea2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:50.214349 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-63b78ec1-b0cf-4fb6-8d69-129cd3651ea2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:50.214780 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-63b78ec1-b0cf-4fb6-8d69-129cd3651ea2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:50.234336 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:27:50.245236 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.objects.instance [None req-63b78ec1-b0cf-4fb6-8d69-129cd3651ea2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lazy-loading 'flavor' on Instance uuid 4b0ec960-6583-4639-9658-a850655eb703 {{(pid=118321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 11:27:50.307663 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-b675bb35-b7ba-40d6-b60a-8b2938a90474 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc29ac59eed483b8c6443c397505adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890e7e79ff744b6b9589f166cd7d8979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:50.315177 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-b675bb35-b7ba-40d6-b60a-8b2938a90474 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] 10.222.0.26 "GET /compute/v2.1/servers/f6b6dcad-2258-4120-9256-bef3997f8486" status: 200 len: 1313 microversion: 2.1 time: 0.164457 Jul 11 11:27:50.315819 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 131/267] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:27:50 2022] GET /compute/v2.1/servers/f6b6dcad-2258-4120-9256-bef3997f8486 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:27:50.981542 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-63b78ec1-b0cf-4fb6-8d69-129cd3651ea2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "POST /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703/action" status: 202 len: 0 microversion: 2.20 time: 0.789028 Jul 11 11:27:50.982199 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 137/268] 10.222.0.26 () {62 vars in 1318 bytes} [Mon Jul 11 11:27:50 2022] POST /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703/action => generated 0 bytes in 790 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 11 11:27:50.991580 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-b05c2818-3c40-4c47-aaf6-0bba7164408e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:50.993190 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-b05c2818-3c40-4c47-aaf6-0bba7164408e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:50.998675 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b05c2818-3c40-4c47-aaf6-0bba7164408e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:50.999013 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b05c2818-3c40-4c47-aaf6-0bba7164408e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:50.999803 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b05c2818-3c40-4c47-aaf6-0bba7164408e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:51.000242 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b05c2818-3c40-4c47-aaf6-0bba7164408e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:51.052107 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-5725712c-9faa-49d5-8f74-af28c56e3225 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:51.053798 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-5725712c-9faa-49d5-8f74-af28c56e3225 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: b39fbe8d-e6a4-4482-981f-ac21c2b52176] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:51.060585 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5725712c-9faa-49d5-8f74-af28c56e3225 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:51.061059 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5725712c-9faa-49d5-8f74-af28c56e3225 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:51.061930 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5725712c-9faa-49d5-8f74-af28c56e3225 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:51.062416 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5725712c-9faa-49d5-8f74-af28c56e3225 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:51.159166 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-b05c2818-3c40-4c47-aaf6-0bba7164408e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:51.164907 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-b05c2818-3c40-4c47-aaf6-0bba7164408e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:51.166397 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-b05c2818-3c40-4c47-aaf6-0bba7164408e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:51.167577 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-b05c2818-3c40-4c47-aaf6-0bba7164408e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1723 microversion: 2.20 time: 0.180806 Jul 11 11:27:51.168642 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 132/269] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:27:50 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:27:51.216542 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-5725712c-9faa-49d5-8f74-af28c56e3225 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:51.224972 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-5725712c-9faa-49d5-8f74-af28c56e3225 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/b39fbe8d-e6a4-4482-981f-ac21c2b52176" status: 200 len: 1521 microversion: 2.1 time: 0.176926 Jul 11 11:27:51.225576 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 138/270] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:27:51 2022] GET /compute/v2.1/servers/b39fbe8d-e6a4-4482-981f-ac21c2b52176 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:27:51.331850 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-03f4f329-c99d-47b2-9c69-b021064aefaf tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:51.332377 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-03f4f329-c99d-47b2-9c69-b021064aefaf tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] [instance: f6b6dcad-2258-4120-9256-bef3997f8486] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:51.338207 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-03f4f329-c99d-47b2-9c69-b021064aefaf tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:51.338651 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-03f4f329-c99d-47b2-9c69-b021064aefaf tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:51.339429 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-03f4f329-c99d-47b2-9c69-b021064aefaf tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:51.339860 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-03f4f329-c99d-47b2-9c69-b021064aefaf tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:51.482177 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-03f4f329-c99d-47b2-9c69-b021064aefaf tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc29ac59eed483b8c6443c397505adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890e7e79ff744b6b9589f166cd7d8979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:51.488409 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-03f4f329-c99d-47b2-9c69-b021064aefaf tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] 10.222.0.26 "GET /compute/v2.1/servers/f6b6dcad-2258-4120-9256-bef3997f8486" status: 200 len: 1313 microversion: 2.1 time: 0.160488 Jul 11 11:27:51.488963 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 133/271] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:27:51 2022] GET /compute/v2.1/servers/f6b6dcad-2258-4120-9256-bef3997f8486 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:27:51.808879 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-08ad46fd-cd43-4278-ab7d-a233ad849dd7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "17b56d0a-9749-4a6b-a75e-451a2bae3737"}} {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:27:51.810026 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-08ad46fd-cd43-4278-ab7d-a233ad849dd7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:51.816988 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-08ad46fd-cd43-4278-ab7d-a233ad849dd7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:51.817707 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-08ad46fd-cd43-4278-ab7d-a233ad849dd7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:51.818495 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-08ad46fd-cd43-4278-ab7d-a233ad849dd7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:51.819036 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-08ad46fd-cd43-4278-ab7d-a233ad849dd7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:52.186522 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-f5b61c1b-d54d-4578-af62-9f9765ecf562 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:52.187125 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-f5b61c1b-d54d-4578-af62-9f9765ecf562 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:52.189971 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell0:SELECT=2 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:27:52.190594 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell0:SELECT=6 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:27:52.195076 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f5b61c1b-d54d-4578-af62-9f9765ecf562 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:52.195541 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f5b61c1b-d54d-4578-af62-9f9765ecf562 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:52.196294 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f5b61c1b-d54d-4578-af62-9f9765ecf562 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:52.196779 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f5b61c1b-d54d-4578-af62-9f9765ecf562 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:52.331652 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-f5b61c1b-d54d-4578-af62-9f9765ecf562 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:52.335003 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=100 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:27:52.339753 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-f5b61c1b-d54d-4578-af62-9f9765ecf562 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:52.341352 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-f5b61c1b-d54d-4578-af62-9f9765ecf562 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:52.342491 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-f5b61c1b-d54d-4578-af62-9f9765ecf562 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1723 microversion: 2.20 time: 0.159883 Jul 11 11:27:52.343042 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 134/272] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:27:52 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:27:52.347531 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-2be28573-a813-467b-9342-93f312134da0 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:52.348172 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-2be28573-a813-467b-9342-93f312134da0 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: b39fbe8d-e6a4-4482-981f-ac21c2b52176] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:52.353743 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2be28573-a813-467b-9342-93f312134da0 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:52.354190 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2be28573-a813-467b-9342-93f312134da0 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:52.354948 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2be28573-a813-467b-9342-93f312134da0 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:52.355409 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2be28573-a813-467b-9342-93f312134da0 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:52.488676 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-2be28573-a813-467b-9342-93f312134da0 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:52.496428 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-2be28573-a813-467b-9342-93f312134da0 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/b39fbe8d-e6a4-4482-981f-ac21c2b52176" status: 200 len: 1521 microversion: 2.1 time: 0.152422 Jul 11 11:27:52.496990 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 135/273] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:27:52 2022] GET /compute/v2.1/servers/b39fbe8d-e6a4-4482-981f-ac21c2b52176 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:27:52.506379 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-20623bc0-2481-4352-9b2f-82d3f7adbe57 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:52.507285 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-20623bc0-2481-4352-9b2f-82d3f7adbe57 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] [instance: f6b6dcad-2258-4120-9256-bef3997f8486] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:52.513145 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-20623bc0-2481-4352-9b2f-82d3f7adbe57 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:52.513579 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-20623bc0-2481-4352-9b2f-82d3f7adbe57 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:52.522126 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-20623bc0-2481-4352-9b2f-82d3f7adbe57 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:52.522126 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-20623bc0-2481-4352-9b2f-82d3f7adbe57 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:52.652108 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-20623bc0-2481-4352-9b2f-82d3f7adbe57 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc29ac59eed483b8c6443c397505adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890e7e79ff744b6b9589f166cd7d8979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:52.660073 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-20623bc0-2481-4352-9b2f-82d3f7adbe57 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] 10.222.0.26 "GET /compute/v2.1/servers/f6b6dcad-2258-4120-9256-bef3997f8486" status: 200 len: 1313 microversion: 2.1 time: 0.158188 Jul 11 11:27:52.660661 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 136/274] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:27:52 2022] GET /compute/v2.1/servers/f6b6dcad-2258-4120-9256-bef3997f8486 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:27:52.839596 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-08ad46fd-cd43-4278-ab7d-a233ad849dd7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "POST /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.034709 Jul 11 11:27:52.840330 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 139/275] 10.222.0.26 () {60 vars in 1322 bytes} [Mon Jul 11 11:27:51 2022] POST /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 194 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:27:53.041432 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [req-f5e35a58-a805-47f7-a36d-8bb030e222e7 req-87e2ee28-2cf6-4349-b15d-5d603a03d913 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6b6dcad-2258-4120-9256-bef3997f8486", "name": "network-vif-plugged", "status": "completed", "tag": "91abd770-9e4b-442e-b326-9779cdfa6a37"}]} {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:27:53.055928 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [req-f5e35a58-a805-47f7-a36d-8bb030e222e7 req-87e2ee28-2cf6-4349-b15d-5d603a03d913 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:53.055928 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [req-f5e35a58-a805-47f7-a36d-8bb030e222e7 req-87e2ee28-2cf6-4349-b15d-5d603a03d913 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:53.064040 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.compute.server_external_events [req-f5e35a58-a805-47f7-a36d-8bb030e222e7 req-87e2ee28-2cf6-4349-b15d-5d603a03d913 service nova] Creating event network-vif-plugged:91abd770-9e4b-442e-b326-9779cdfa6a37 for instance f6b6dcad-2258-4120-9256-bef3997f8486 on hv-cinder-84842 Jul 11 11:27:53.069259 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [req-f5e35a58-a805-47f7-a36d-8bb030e222e7 req-87e2ee28-2cf6-4349-b15d-5d603a03d913 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036752 Jul 11 11:27:53.069851 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 137/276] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 11:27:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:27:53.365486 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-e590387b-2f20-4a76-982d-ae725aeca9a3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:53.366489 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-e590387b-2f20-4a76-982d-ae725aeca9a3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:53.373953 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e590387b-2f20-4a76-982d-ae725aeca9a3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:53.374482 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e590387b-2f20-4a76-982d-ae725aeca9a3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:53.375242 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e590387b-2f20-4a76-982d-ae725aeca9a3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:53.375694 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e590387b-2f20-4a76-982d-ae725aeca9a3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:53.403407 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell0:SELECT=4 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:27:53.518664 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-e4673ecf-3ddc-4e14-ac0e-9908eaa7b62d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:53.519617 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-e4673ecf-3ddc-4e14-ac0e-9908eaa7b62d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: b39fbe8d-e6a4-4482-981f-ac21c2b52176] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:53.526346 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e4673ecf-3ddc-4e14-ac0e-9908eaa7b62d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:53.526882 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e4673ecf-3ddc-4e14-ac0e-9908eaa7b62d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:53.527700 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e4673ecf-3ddc-4e14-ac0e-9908eaa7b62d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:53.528130 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e4673ecf-3ddc-4e14-ac0e-9908eaa7b62d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:53.576496 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-e590387b-2f20-4a76-982d-ae725aeca9a3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:53.584230 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-e590387b-2f20-4a76-982d-ae725aeca9a3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:53.585741 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-e590387b-2f20-4a76-982d-ae725aeca9a3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:53.586876 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-e590387b-2f20-4a76-982d-ae725aeca9a3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1723 microversion: 2.20 time: 0.227006 Jul 11 11:27:53.587448 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 140/277] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:27:53 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1723 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:27:53.667322 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-e4673ecf-3ddc-4e14-ac0e-9908eaa7b62d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:53.676504 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-e4673ecf-3ddc-4e14-ac0e-9908eaa7b62d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/b39fbe8d-e6a4-4482-981f-ac21c2b52176" status: 200 len: 1521 microversion: 2.1 time: 0.162621 Jul 11 11:27:53.677083 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 138/278] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:27:53 2022] GET /compute/v2.1/servers/b39fbe8d-e6a4-4482-981f-ac21c2b52176 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:27:53.685489 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-15f4664b-b6b1-4211-847c-eabd17e9c285 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:53.685489 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-15f4664b-b6b1-4211-847c-eabd17e9c285 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] [instance: f6b6dcad-2258-4120-9256-bef3997f8486] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:53.687130 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-15f4664b-b6b1-4211-847c-eabd17e9c285 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:53.687740 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-15f4664b-b6b1-4211-847c-eabd17e9c285 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:53.688638 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-15f4664b-b6b1-4211-847c-eabd17e9c285 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:53.689146 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-15f4664b-b6b1-4211-847c-eabd17e9c285 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:53.820976 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-15f4664b-b6b1-4211-847c-eabd17e9c285 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc29ac59eed483b8c6443c397505adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890e7e79ff744b6b9589f166cd7d8979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:53.828757 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-15f4664b-b6b1-4211-847c-eabd17e9c285 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] 10.222.0.26 "GET /compute/v2.1/servers/f6b6dcad-2258-4120-9256-bef3997f8486" status: 200 len: 1313 microversion: 2.1 time: 0.154925 Jul 11 11:27:53.829414 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 141/279] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:27:53 2022] GET /compute/v2.1/servers/f6b6dcad-2258-4120-9256-bef3997f8486 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:27:53.930766 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-cd6b71f9-33cf-43d8-9d27-bed1d6997125 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d0d2f510-a164-4910-a380-1291cccc44ad", "device": "/dev/sdb"}} {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:27:53.932443 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-cd6b71f9-33cf-43d8-9d27-bed1d6997125 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:53.939178 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cd6b71f9-33cf-43d8-9d27-bed1d6997125 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:53.939647 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cd6b71f9-33cf-43d8-9d27-bed1d6997125 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:53.940595 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cd6b71f9-33cf-43d8-9d27-bed1d6997125 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:53.941034 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cd6b71f9-33cf-43d8-9d27-bed1d6997125 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:54.605831 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-050c5ce7-ce8d-4d7c-8a38-e8850d41716a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:54.606498 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-050c5ce7-ce8d-4d7c-8a38-e8850d41716a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:54.612829 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-050c5ce7-ce8d-4d7c-8a38-e8850d41716a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:54.613274 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-050c5ce7-ce8d-4d7c-8a38-e8850d41716a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:54.614036 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-050c5ce7-ce8d-4d7c-8a38-e8850d41716a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:54.614466 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-050c5ce7-ce8d-4d7c-8a38-e8850d41716a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:54.799621 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-050c5ce7-ce8d-4d7c-8a38-e8850d41716a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:54.808241 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-050c5ce7-ce8d-4d7c-8a38-e8850d41716a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:54.813056 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-050c5ce7-ce8d-4d7c-8a38-e8850d41716a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:54.814266 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-050c5ce7-ce8d-4d7c-8a38-e8850d41716a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1723 microversion: 2.20 time: 0.212414 Jul 11 11:27:54.814862 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 142/280] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:27:54 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1723 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 11:27:54.819505 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-3aadea8f-bdc4-47f4-b552-9b74f3836cce tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:54.825300 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-3aadea8f-bdc4-47f4-b552-9b74f3836cce tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: b39fbe8d-e6a4-4482-981f-ac21c2b52176] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:54.827069 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3aadea8f-bdc4-47f4-b552-9b74f3836cce tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:54.827891 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3aadea8f-bdc4-47f4-b552-9b74f3836cce tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:54.829158 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3aadea8f-bdc4-47f4-b552-9b74f3836cce tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:54.829696 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3aadea8f-bdc4-47f4-b552-9b74f3836cce tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:54.961786 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-3aadea8f-bdc4-47f4-b552-9b74f3836cce tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:54.970138 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-3aadea8f-bdc4-47f4-b552-9b74f3836cce tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/b39fbe8d-e6a4-4482-981f-ac21c2b52176" status: 200 len: 1521 microversion: 2.1 time: 0.154221 Jul 11 11:27:54.970744 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 143/281] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:27:54 2022] GET /compute/v2.1/servers/b39fbe8d-e6a4-4482-981f-ac21c2b52176 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:27:54.984072 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-0375820e-cc2b-4dfb-9c31-31b97dd749b5 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:54.984673 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-0375820e-cc2b-4dfb-9c31-31b97dd749b5 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] [instance: f6b6dcad-2258-4120-9256-bef3997f8486] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:54.991017 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0375820e-cc2b-4dfb-9c31-31b97dd749b5 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:54.991824 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0375820e-cc2b-4dfb-9c31-31b97dd749b5 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:54.992588 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0375820e-cc2b-4dfb-9c31-31b97dd749b5 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:54.993018 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0375820e-cc2b-4dfb-9c31-31b97dd749b5 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:55.187286 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-0375820e-cc2b-4dfb-9c31-31b97dd749b5 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc29ac59eed483b8c6443c397505adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890e7e79ff744b6b9589f166cd7d8979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:55.196164 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-0375820e-cc2b-4dfb-9c31-31b97dd749b5 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] 10.222.0.26 "GET /compute/v2.1/servers/f6b6dcad-2258-4120-9256-bef3997f8486" status: 200 len: 1313 microversion: 2.1 time: 0.215742 Jul 11 11:27:55.197210 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 144/282] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:27:54 2022] GET /compute/v2.1/servers/f6b6dcad-2258-4120-9256-bef3997f8486 => generated 1313 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:27:55.531580 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-cd6b71f9-33cf-43d8-9d27-bed1d6997125 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "POST /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.604911 Jul 11 11:27:55.532940 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 139/283] 10.222.0.26 () {60 vars in 1322 bytes} [Mon Jul 11 11:27:53 2022] POST /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423/os-volume_attachments => generated 194 bytes in 1607 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:27:55.832029 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-96601120-e6f1-4ad8-bb90-adf5120576fb tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:55.832691 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-96601120-e6f1-4ad8-bb90-adf5120576fb tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:55.839857 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-96601120-e6f1-4ad8-bb90-adf5120576fb tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:55.840301 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-96601120-e6f1-4ad8-bb90-adf5120576fb tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:55.841086 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-96601120-e6f1-4ad8-bb90-adf5120576fb tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:55.841515 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-96601120-e6f1-4ad8-bb90-adf5120576fb tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:55.992775 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-103106f6-a2b8-4272-b86b-516628f70d9b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:55.994329 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-103106f6-a2b8-4272-b86b-516628f70d9b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: b39fbe8d-e6a4-4482-981f-ac21c2b52176] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:56.002849 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-103106f6-a2b8-4272-b86b-516628f70d9b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:56.003856 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-103106f6-a2b8-4272-b86b-516628f70d9b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:56.015334 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-103106f6-a2b8-4272-b86b-516628f70d9b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:56.016340 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-103106f6-a2b8-4272-b86b-516628f70d9b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:56.152470 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-96601120-e6f1-4ad8-bb90-adf5120576fb tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:56.160500 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-96601120-e6f1-4ad8-bb90-adf5120576fb tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:56.162618 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-96601120-e6f1-4ad8-bb90-adf5120576fb tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:56.163806 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-96601120-e6f1-4ad8-bb90-adf5120576fb tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1723 microversion: 2.20 time: 0.335729 Jul 11 11:27:56.164366 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 145/284] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:27:55 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1723 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:27:56.168857 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-497276e6-a3d2-4395-ba72-465374cc977b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:56.169346 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-497276e6-a3d2-4395-ba72-465374cc977b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:56.175169 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-497276e6-a3d2-4395-ba72-465374cc977b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:56.175720 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-497276e6-a3d2-4395-ba72-465374cc977b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:56.176486 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-497276e6-a3d2-4395-ba72-465374cc977b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:56.176814 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-103106f6-a2b8-4272-b86b-516628f70d9b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:56.176944 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-497276e6-a3d2-4395-ba72-465374cc977b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:56.184967 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-103106f6-a2b8-4272-b86b-516628f70d9b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/b39fbe8d-e6a4-4482-981f-ac21c2b52176" status: 200 len: 1521 microversion: 2.1 time: 0.200877 Jul 11 11:27:56.191297 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 140/285] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:27:55 2022] GET /compute/v2.1/servers/b39fbe8d-e6a4-4482-981f-ac21c2b52176 => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:27:56.201476 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-497276e6-a3d2-4395-ba72-465374cc977b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/ips" status: 200 len: 146 microversion: 2.1 time: 0.036053 Jul 11 11:27:56.202045 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 146/286] 10.222.0.26 () {58 vars in 1247 bytes} [Mon Jul 11 11:27:56 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/ips => generated 146 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:27:56.213805 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-e80092a6-43e0-43e8-b749-82ff03a5a37f tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:56.214414 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-e80092a6-43e0-43e8-b749-82ff03a5a37f tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] [instance: f6b6dcad-2258-4120-9256-bef3997f8486] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:56.220503 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e80092a6-43e0-43e8-b749-82ff03a5a37f tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:56.220950 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e80092a6-43e0-43e8-b749-82ff03a5a37f tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:56.221709 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e80092a6-43e0-43e8-b749-82ff03a5a37f tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:56.222138 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e80092a6-43e0-43e8-b749-82ff03a5a37f tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:56.362763 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-e80092a6-43e0-43e8-b749-82ff03a5a37f tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc29ac59eed483b8c6443c397505adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890e7e79ff744b6b9589f166cd7d8979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:56.370027 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-e80092a6-43e0-43e8-b749-82ff03a5a37f tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] 10.222.0.26 "GET /compute/v2.1/servers/f6b6dcad-2258-4120-9256-bef3997f8486" status: 200 len: 1313 microversion: 2.1 time: 0.160250 Jul 11 11:27:56.370609 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 141/287] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:27:56 2022] GET /compute/v2.1/servers/f6b6dcad-2258-4120-9256-bef3997f8486 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:27:57.186910 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-2354bee4-128d-48bf-b64f-08b8516829a0 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:57.187555 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-2354bee4-128d-48bf-b64f-08b8516829a0 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:57.194358 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2354bee4-128d-48bf-b64f-08b8516829a0 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:57.195079 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2354bee4-128d-48bf-b64f-08b8516829a0 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:57.196115 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2354bee4-128d-48bf-b64f-08b8516829a0 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:57.196736 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2354bee4-128d-48bf-b64f-08b8516829a0 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:57.203292 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-229c561b-b0a3-4451-81a6-70d8ab0bb3de tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:57.204911 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-229c561b-b0a3-4451-81a6-70d8ab0bb3de tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: b39fbe8d-e6a4-4482-981f-ac21c2b52176] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:57.212958 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-229c561b-b0a3-4451-81a6-70d8ab0bb3de tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:57.214018 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-229c561b-b0a3-4451-81a6-70d8ab0bb3de tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:57.215348 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-229c561b-b0a3-4451-81a6-70d8ab0bb3de tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:57.216099 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-229c561b-b0a3-4451-81a6-70d8ab0bb3de tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:57.375984 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-229c561b-b0a3-4451-81a6-70d8ab0bb3de tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:57.386257 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-229c561b-b0a3-4451-81a6-70d8ab0bb3de tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/b39fbe8d-e6a4-4482-981f-ac21c2b52176" status: 200 len: 1521 microversion: 2.1 time: 0.188098 Jul 11 11:27:57.395940 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 142/288] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:27:57 2022] GET /compute/v2.1/servers/b39fbe8d-e6a4-4482-981f-ac21c2b52176 => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:27:57.395940 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-7851fe09-9a2a-41f0-8f1a-1e5185f3b451 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:57.395940 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-7851fe09-9a2a-41f0-8f1a-1e5185f3b451 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] [instance: f6b6dcad-2258-4120-9256-bef3997f8486] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:57.401899 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7851fe09-9a2a-41f0-8f1a-1e5185f3b451 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:57.402465 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7851fe09-9a2a-41f0-8f1a-1e5185f3b451 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:57.403345 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7851fe09-9a2a-41f0-8f1a-1e5185f3b451 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:57.403851 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7851fe09-9a2a-41f0-8f1a-1e5185f3b451 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:57.530424 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-2354bee4-128d-48bf-b64f-08b8516829a0 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:57.542904 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-2354bee4-128d-48bf-b64f-08b8516829a0 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:57.544489 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-2354bee4-128d-48bf-b64f-08b8516829a0 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:57.545857 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-2354bee4-128d-48bf-b64f-08b8516829a0 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1723 microversion: 2.20 time: 0.366944 Jul 11 11:27:57.546615 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 147/289] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:27:57 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1723 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:27:57.577725 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-7851fe09-9a2a-41f0-8f1a-1e5185f3b451 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc29ac59eed483b8c6443c397505adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890e7e79ff744b6b9589f166cd7d8979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:57.582775 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-7851fe09-9a2a-41f0-8f1a-1e5185f3b451 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] 10.222.0.26 "GET /compute/v2.1/servers/f6b6dcad-2258-4120-9256-bef3997f8486" status: 200 len: 1497 microversion: 2.1 time: 0.194754 Jul 11 11:27:57.583398 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 143/290] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:27:57 2022] GET /compute/v2.1/servers/f6b6dcad-2258-4120-9256-bef3997f8486 => generated 1497 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:27:58.402647 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-01581d9f-f4c4-4dc0-99e6-7a8e0b50b63f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:58.403281 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-01581d9f-f4c4-4dc0-99e6-7a8e0b50b63f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: b39fbe8d-e6a4-4482-981f-ac21c2b52176] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:58.409981 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-01581d9f-f4c4-4dc0-99e6-7a8e0b50b63f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:58.410427 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-01581d9f-f4c4-4dc0-99e6-7a8e0b50b63f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:58.411271 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-01581d9f-f4c4-4dc0-99e6-7a8e0b50b63f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:58.411809 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-01581d9f-f4c4-4dc0-99e6-7a8e0b50b63f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:58.544681 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-01581d9f-f4c4-4dc0-99e6-7a8e0b50b63f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:58.552018 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-01581d9f-f4c4-4dc0-99e6-7a8e0b50b63f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/b39fbe8d-e6a4-4482-981f-ac21c2b52176" status: 200 len: 1521 microversion: 2.1 time: 0.153263 Jul 11 11:27:58.553110 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 148/291] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:27:58 2022] GET /compute/v2.1/servers/b39fbe8d-e6a4-4482-981f-ac21c2b52176 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:27:58.563895 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-a08f1cb3-7ca4-406e-991f-200926f80f41 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:58.564538 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-a08f1cb3-7ca4-406e-991f-200926f80f41 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:58.571472 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a08f1cb3-7ca4-406e-991f-200926f80f41 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:58.571913 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a08f1cb3-7ca4-406e-991f-200926f80f41 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:58.572658 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a08f1cb3-7ca4-406e-991f-200926f80f41 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:58.573082 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a08f1cb3-7ca4-406e-991f-200926f80f41 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:58.716755 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-a08f1cb3-7ca4-406e-991f-200926f80f41 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:58.726224 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-a08f1cb3-7ca4-406e-991f-200926f80f41 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:58.727870 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-a08f1cb3-7ca4-406e-991f-200926f80f41 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:58.729260 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-a08f1cb3-7ca4-406e-991f-200926f80f41 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1723 microversion: 2.20 time: 0.169185 Jul 11 11:27:58.730168 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 144/292] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:27:58 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:27:58.740957 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-f2b825e3-0846-4a13-9e65-d2c7d973bd85 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:58.740957 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-f2b825e3-0846-4a13-9e65-d2c7d973bd85 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] [instance: f6b6dcad-2258-4120-9256-bef3997f8486] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:58.742340 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f2b825e3-0846-4a13-9e65-d2c7d973bd85 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:58.742785 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f2b825e3-0846-4a13-9e65-d2c7d973bd85 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:58.743714 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f2b825e3-0846-4a13-9e65-d2c7d973bd85 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:58.744147 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f2b825e3-0846-4a13-9e65-d2c7d973bd85 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:58.784222 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-f2b825e3-0846-4a13-9e65-d2c7d973bd85 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] [instance: f6b6dcad-2258-4120-9256-bef3997f8486] Going to try to terminate instance {{(pid=118321) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 11:27:58.921015 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=5,nova_cell1:INSERT=2 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:27:59.098010 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-f2b825e3-0846-4a13-9e65-d2c7d973bd85 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f6b6dcad-2258-4120-9256-bef3997f8486" status: 204 len: 0 microversion: 2.1 time: 0.366587 Jul 11 11:27:59.098594 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 149/293] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 11 11:27:58 2022] DELETE /compute/v2.1/servers/f6b6dcad-2258-4120-9256-bef3997f8486 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 11 11:27:59.107456 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-74257032-8b22-46d3-a2ff-d9ca59894dd0 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:59.108064 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-74257032-8b22-46d3-a2ff-d9ca59894dd0 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] [instance: f6b6dcad-2258-4120-9256-bef3997f8486] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:59.114242 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-74257032-8b22-46d3-a2ff-d9ca59894dd0 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:59.114689 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-74257032-8b22-46d3-a2ff-d9ca59894dd0 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:59.115481 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-74257032-8b22-46d3-a2ff-d9ca59894dd0 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:59.115912 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-74257032-8b22-46d3-a2ff-d9ca59894dd0 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:59.242167 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-74257032-8b22-46d3-a2ff-d9ca59894dd0 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc29ac59eed483b8c6443c397505adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890e7e79ff744b6b9589f166cd7d8979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:59.249910 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-74257032-8b22-46d3-a2ff-d9ca59894dd0 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] 10.222.0.26 "GET /compute/v2.1/servers/f6b6dcad-2258-4120-9256-bef3997f8486" status: 200 len: 1503 microversion: 2.1 time: 0.146394 Jul 11 11:27:59.250478 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 145/294] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:27:59 2022] GET /compute/v2.1/servers/f6b6dcad-2258-4120-9256-bef3997f8486 => generated 1503 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:27:59.572069 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-bca1c197-b1e7-4421-9799-ab1a4f67692c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:59.573380 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-bca1c197-b1e7-4421-9799-ab1a4f67692c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: b39fbe8d-e6a4-4482-981f-ac21c2b52176] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:59.580494 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bca1c197-b1e7-4421-9799-ab1a4f67692c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:59.580936 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bca1c197-b1e7-4421-9799-ab1a4f67692c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:59.581701 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bca1c197-b1e7-4421-9799-ab1a4f67692c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:59.582135 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bca1c197-b1e7-4421-9799-ab1a4f67692c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:59.611022 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-5917a4cb-1458-439f-badb-2a05f07c322e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6fa2e2da-5e0c-407c-9e56-3f40f519805e"}} {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:27:59.612203 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-5917a4cb-1458-439f-badb-2a05f07c322e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:59.619359 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5917a4cb-1458-439f-badb-2a05f07c322e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:59.619802 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5917a4cb-1458-439f-badb-2a05f07c322e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:59.620558 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5917a4cb-1458-439f-badb-2a05f07c322e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:59.620983 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5917a4cb-1458-439f-badb-2a05f07c322e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:59.710938 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-bca1c197-b1e7-4421-9799-ab1a4f67692c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:59.718239 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-bca1c197-b1e7-4421-9799-ab1a4f67692c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/b39fbe8d-e6a4-4482-981f-ac21c2b52176" status: 200 len: 1501 microversion: 2.1 time: 0.150306 Jul 11 11:27:59.718806 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 150/295] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:27:59 2022] GET /compute/v2.1/servers/b39fbe8d-e6a4-4482-981f-ac21c2b52176 => generated 1501 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:27:59.737296 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-a1c416ea-68d5-4086-a84a-3a2069b55a45 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3aed322b-8500-4517-b627-fc855680f434"}} {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:27:59.738437 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-a1c416ea-68d5-4086-a84a-3a2069b55a45 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: b39fbe8d-e6a4-4482-981f-ac21c2b52176] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:59.745718 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a1c416ea-68d5-4086-a84a-3a2069b55a45 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:59.746164 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a1c416ea-68d5-4086-a84a-3a2069b55a45 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:59.746955 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a1c416ea-68d5-4086-a84a-3a2069b55a45 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:59.747559 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a1c416ea-68d5-4086-a84a-3a2069b55a45 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:59.773472 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.wsgi [None req-a1c416ea-68d5-4086-a84a-3a2069b55a45 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] HTTP exception thrown: Cannot 'attach_volume' instance b39fbe8d-e6a4-4482-981f-ac21c2b52176 while it is in vm_state rescued Jul 11 11:27:59.775409 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-a1c416ea-68d5-4086-a84a-3a2069b55a45 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Request method failure captured: Jul 11 11:27:59.775409 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: request: POST /compute/v2.1/servers/b39fbe8d-e6a4-4482-981f-ac21c2b52176/os-volume_attachments HTTP/1.1 Jul 11 11:27:59.775409 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Accept: application/json Jul 11 11:27:59.775409 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Accept-Encoding: identity Jul 11 11:27:59.775409 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Connection: close Jul 11 11:27:59.775409 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Content-Length: 74 Jul 11 11:27:59.775409 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Content-Type: application/json Jul 11 11:27:59.775409 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Host: 10.222.0.26 Jul 11 11:27:59.775409 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Openstack-System-Scope: None Jul 11 11:27:59.775409 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: User-Agent: python-urllib3/1.26.9 Jul 11 11:27:59.775409 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Auth-Token: gAAAAABizAjAB3ee8Wpq3XhXwIMo2dwj2c7BxlbTsH6D1jW0nrqmMRQaO1vU3fERsJZs92pezfPAJ7yky9TGgSL8Gjc0VXr5ooj5myVwUGnwGNo7XkymuXwDtzAqNhHC0FClHxOsBHOXLYTrPKsTv6dRXKtOUTvNzViNUOSi1yXruxQCnGLZpsY Jul 11 11:27:59.775409 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Domain-Id: None Jul 11 11:27:59.775409 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Domain-Name: None Jul 11 11:27:59.775409 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Identity-Status: Confirmed Jul 11 11:27:59.775409 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Is-Admin-Project: True Jul 11 11:27:59.775409 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Domain-Id: default Jul 11 11:27:59.775409 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Domain-Name: Default Jul 11 11:27:59.775409 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Id: c8639f8c836d4ad79d147b855d9017f8 Jul 11 11:27:59.775409 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-187934667 Jul 11 11:27:59.775409 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Role: member,reader Jul 11 11:27:59.775409 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Roles: member,reader Jul 11 11:27:59.776903 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c8639f8c836d4ad79d147b855d9017f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c8639f8c836d4ad79d147b855d9017f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c8639f8c836d4ad79d147b855d9017f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c8639f8c836d4ad79d147b855d9017f8"}]}] Jul 11 11:27:59.776903 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Tenant: tempest-ServerRescueNegativeTestJSON-187934667 Jul 11 11:27:59.776903 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Tenant-Id: c8639f8c836d4ad79d147b855d9017f8 Jul 11 11:27:59.776903 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-187934667 Jul 11 11:27:59.776903 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User: tempest-ServerRescueNegativeTestJSON-187934667-project Jul 11 11:27:59.776903 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Domain-Id: default Jul 11 11:27:59.776903 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Domain-Name: Default Jul 11 11:27:59.776903 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Id: e47c365946cf4264a2d2205ace04379d Jul 11 11:27:59.776903 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Name: tempest-ServerRescueNegativeTestJSON-187934667-project Jul 11 11:27:59.776903 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Jul 11 11:27:59.776903 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: {"volumeAttachment": {"volumeId": "3aed322b-8500-4517-b627-fc855680f434"}} Jul 11 11:27:59.776903 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: method: > Jul 11 11:27:59.777765 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: exception: Cannot 'attach_volume' instance b39fbe8d-e6a4-4482-981f-ac21c2b52176 while it is in vm_state rescued Jul 11 11:27:59.777765 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: action_args: {'server_id': 'b39fbe8d-e6a4-4482-981f-ac21c2b52176', 'body': {'volumeAttachment': {'volumeId': '3aed322b-8500-4517-b627-fc855680f434'}}} Jul 11 11:27:59.777765 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 11:27:59.777765 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:27:59.777765 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 11 11:27:59.777765 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 11 11:27:59.777765 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 11 11:27:59.777765 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 11 11:27:59.777765 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 11 11:27:59.777765 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 11 11:27:59.777765 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b39fbe8d-e6a4-4482-981f-ac21c2b52176 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 11 11:27:59.777765 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:27:59.777765 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:27:59.777765 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:27:59.777765 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:27:59.777765 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:27:59.777765 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:27:59.777765 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 11:27:59.777765 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 11:27:59.779138 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 11:27:59.779138 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 11:27:59.779138 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 11 11:27:59.779138 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 11 11:27:59.779138 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 11 11:27:59.779138 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 11 11:27:59.779138 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 11 11:27:59.779138 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 11 11:27:59.779138 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 11 11:27:59.779138 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 11 11:27:59.779138 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 11 11:27:59.779138 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 11 11:27:59.779138 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance b39fbe8d-e6a4-4482-981f-ac21c2b52176 while it is in vm_state rescued Jul 11 11:27:59.779138 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:27:59.779138 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:27:59.779138 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:27:59.779138 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:27:59.779138 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:27:59.779138 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:27:59.780490 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 11:27:59.780490 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 11:27:59.780490 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance b39fbe8d-e6a4-4482-981f-ac21c2b52176 while it is in vm_state rescued Jul 11 11:27:59.780490 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:27:59.780490 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-a1c416ea-68d5-4086-a84a-3a2069b55a45 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Returning 409 to user: Cannot 'attach_volume' instance b39fbe8d-e6a4-4482-981f-ac21c2b52176 while it is in vm_state rescued {{(pid=118321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 11:27:59.780490 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-a1c416ea-68d5-4086-a84a-3a2069b55a45 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "POST /compute/v2.1/servers/b39fbe8d-e6a4-4482-981f-ac21c2b52176/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.043481 Jul 11 11:27:59.780490 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 151/296] 10.222.0.26 () {60 vars in 1322 bytes} [Mon Jul 11 11:27:59 2022] POST /compute/v2.1/servers/b39fbe8d-e6a4-4482-981f-ac21c2b52176/os-volume_attachments => generated 152 bytes in 45 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 11 11:27:59.781583 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-287408e0-ae37-49af-b967-8584e4adedfe tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:27:59.782173 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-287408e0-ae37-49af-b967-8584e4adedfe tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:59.788595 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-287408e0-ae37-49af-b967-8584e4adedfe tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:59.789028 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-287408e0-ae37-49af-b967-8584e4adedfe tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:59.789777 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-287408e0-ae37-49af-b967-8584e4adedfe tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:59.790205 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-287408e0-ae37-49af-b967-8584e4adedfe tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:59.923479 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-287408e0-ae37-49af-b967-8584e4adedfe tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:59.931782 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-287408e0-ae37-49af-b967-8584e4adedfe tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:59.933271 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-287408e0-ae37-49af-b967-8584e4adedfe tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:27:59.934400 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-287408e0-ae37-49af-b967-8584e4adedfe tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1723 microversion: 2.20 time: 0.156188 Jul 11 11:27:59.934951 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 152/297] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:27:59 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:27:59.939320 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-9f2259f6-091d-4ca6-933b-6e4459a0060d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:27:59.939843 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-9f2259f6-091d-4ca6-933b-6e4459a0060d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: b39fbe8d-e6a4-4482-981f-ac21c2b52176] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:27:59.945574 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9f2259f6-091d-4ca6-933b-6e4459a0060d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:59.946013 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9f2259f6-091d-4ca6-933b-6e4459a0060d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:27:59.946767 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9f2259f6-091d-4ca6-933b-6e4459a0060d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:27:59.947193 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9f2259f6-091d-4ca6-933b-6e4459a0060d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:00.162886 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-9f2259f6-091d-4ca6-933b-6e4459a0060d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "POST /compute/v2.1/servers/b39fbe8d-e6a4-4482-981f-ac21c2b52176/action" status: 202 len: 0 microversion: 2.1 time: 0.226709 Jul 11 11:28:00.163718 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 153/298] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Jul 11 11:27:59 2022] POST /compute/v2.1/servers/b39fbe8d-e6a4-4482-981f-ac21c2b52176/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 11:28:00.171750 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-1c58db97-66e4-41fb-bbaa-6bd1644b3251 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:00.172466 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-1c58db97-66e4-41fb-bbaa-6bd1644b3251 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: b39fbe8d-e6a4-4482-981f-ac21c2b52176] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:00.179038 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1c58db97-66e4-41fb-bbaa-6bd1644b3251 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:00.181763 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1c58db97-66e4-41fb-bbaa-6bd1644b3251 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:00.181763 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1c58db97-66e4-41fb-bbaa-6bd1644b3251 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:00.181763 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1c58db97-66e4-41fb-bbaa-6bd1644b3251 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:00.312140 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-1c58db97-66e4-41fb-bbaa-6bd1644b3251 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:00.320591 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-1c58db97-66e4-41fb-bbaa-6bd1644b3251 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/b39fbe8d-e6a4-4482-981f-ac21c2b52176" status: 200 len: 1509 microversion: 2.1 time: 0.152773 Jul 11 11:28:00.325461 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 154/299] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:00 2022] GET /compute/v2.1/servers/b39fbe8d-e6a4-4482-981f-ac21c2b52176 => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:28:00.325933 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-1578c16a-ee25-443e-976d-44f19ebceab3 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:00.326537 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-1578c16a-ee25-443e-976d-44f19ebceab3 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] [instance: f6b6dcad-2258-4120-9256-bef3997f8486] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:00.332629 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1578c16a-ee25-443e-976d-44f19ebceab3 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:00.333080 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1578c16a-ee25-443e-976d-44f19ebceab3 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:00.333866 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1578c16a-ee25-443e-976d-44f19ebceab3 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:00.334278 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1578c16a-ee25-443e-976d-44f19ebceab3 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:00.462749 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-1578c16a-ee25-443e-976d-44f19ebceab3 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc29ac59eed483b8c6443c397505adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890e7e79ff744b6b9589f166cd7d8979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:00.470186 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-1578c16a-ee25-443e-976d-44f19ebceab3 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] 10.222.0.26 "GET /compute/v2.1/servers/f6b6dcad-2258-4120-9256-bef3997f8486" status: 200 len: 1503 microversion: 2.1 time: 0.147907 Jul 11 11:28:00.474589 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 155/300] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:00 2022] GET /compute/v2.1/servers/f6b6dcad-2258-4120-9256-bef3997f8486 => generated 1503 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:00.952455 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-07a3824c-70f5-43a1-81ca-83d6dd7fad79 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:00.953059 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-07a3824c-70f5-43a1-81ca-83d6dd7fad79 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:00.959472 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-07a3824c-70f5-43a1-81ca-83d6dd7fad79 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:00.959919 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-07a3824c-70f5-43a1-81ca-83d6dd7fad79 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:00.960673 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-07a3824c-70f5-43a1-81ca-83d6dd7fad79 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:00.961106 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-07a3824c-70f5-43a1-81ca-83d6dd7fad79 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:01.094903 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-07a3824c-70f5-43a1-81ca-83d6dd7fad79 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:01.105404 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-07a3824c-70f5-43a1-81ca-83d6dd7fad79 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:01.105404 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-07a3824c-70f5-43a1-81ca-83d6dd7fad79 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:01.106020 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-07a3824c-70f5-43a1-81ca-83d6dd7fad79 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1723 microversion: 2.20 time: 0.157443 Jul 11 11:28:01.106568 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 156/301] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:28:00 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 11:28:01.337929 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-4ed2f414-b119-46aa-8233-3e0c48fcd446 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:01.338534 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-4ed2f414-b119-46aa-8233-3e0c48fcd446 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: b39fbe8d-e6a4-4482-981f-ac21c2b52176] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:01.344567 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4ed2f414-b119-46aa-8233-3e0c48fcd446 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:01.345016 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4ed2f414-b119-46aa-8233-3e0c48fcd446 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:01.345783 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4ed2f414-b119-46aa-8233-3e0c48fcd446 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:01.346216 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4ed2f414-b119-46aa-8233-3e0c48fcd446 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:01.481471 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-4ed2f414-b119-46aa-8233-3e0c48fcd446 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:01.490127 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-4ed2f414-b119-46aa-8233-3e0c48fcd446 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/b39fbe8d-e6a4-4482-981f-ac21c2b52176" status: 200 len: 1509 microversion: 2.1 time: 0.156471 Jul 11 11:28:01.490696 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 157/302] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:01 2022] GET /compute/v2.1/servers/b39fbe8d-e6a4-4482-981f-ac21c2b52176 => generated 1509 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:01.498975 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-27ac3ea0-44b7-497e-87db-6bb4e80f32f2 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:01.498975 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-27ac3ea0-44b7-497e-87db-6bb4e80f32f2 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] [instance: f6b6dcad-2258-4120-9256-bef3997f8486] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:01.502953 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-27ac3ea0-44b7-497e-87db-6bb4e80f32f2 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:01.503460 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-27ac3ea0-44b7-497e-87db-6bb4e80f32f2 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:01.504232 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-27ac3ea0-44b7-497e-87db-6bb4e80f32f2 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:01.504675 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-27ac3ea0-44b7-497e-87db-6bb4e80f32f2 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:01.639360 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-27ac3ea0-44b7-497e-87db-6bb4e80f32f2 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc29ac59eed483b8c6443c397505adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890e7e79ff744b6b9589f166cd7d8979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:01.647323 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-27ac3ea0-44b7-497e-87db-6bb4e80f32f2 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] 10.222.0.26 "GET /compute/v2.1/servers/f6b6dcad-2258-4120-9256-bef3997f8486" status: 200 len: 1503 microversion: 2.1 time: 0.154895 Jul 11 11:28:01.647886 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 158/303] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:01 2022] GET /compute/v2.1/servers/f6b6dcad-2258-4120-9256-bef3997f8486 => generated 1503 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:02.001008 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-5917a4cb-1458-439f-badb-2a05f07c322e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "POST /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.393888 Jul 11 11:28:02.006370 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 146/304] 10.222.0.26 () {60 vars in 1322 bytes} [Mon Jul 11 11:27:59 2022] POST /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 194 bytes in 2396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:28:02.124643 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-d6f93a80-4795-480a-854e-1b0381c1e07e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:02.127719 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-d6f93a80-4795-480a-854e-1b0381c1e07e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:02.134434 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d6f93a80-4795-480a-854e-1b0381c1e07e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:02.135129 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d6f93a80-4795-480a-854e-1b0381c1e07e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:02.136655 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d6f93a80-4795-480a-854e-1b0381c1e07e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:02.137075 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d6f93a80-4795-480a-854e-1b0381c1e07e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:02.341655 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [req-06036712-e10a-400a-9377-9e93e744a864 req-dbb252ba-4e3e-4ef1-9d44-4bfaaa8178d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6b6dcad-2258-4120-9256-bef3997f8486", "name": "network-vif-deleted", "tag": "91abd770-9e4b-442e-b326-9779cdfa6a37"}]} {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:28:02.351908 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [req-06036712-e10a-400a-9377-9e93e744a864 req-dbb252ba-4e3e-4ef1-9d44-4bfaaa8178d4 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:02.352311 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [req-06036712-e10a-400a-9377-9e93e744a864 req-dbb252ba-4e3e-4ef1-9d44-4bfaaa8178d4 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:02.354668 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-d6f93a80-4795-480a-854e-1b0381c1e07e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:02.364468 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.compute.server_external_events [req-06036712-e10a-400a-9377-9e93e744a864 req-dbb252ba-4e3e-4ef1-9d44-4bfaaa8178d4 service nova] Creating event network-vif-deleted:91abd770-9e4b-442e-b326-9779cdfa6a37 for instance f6b6dcad-2258-4120-9256-bef3997f8486 on hv-cinder-84842 Jul 11 11:28:02.370127 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-d6f93a80-4795-480a-854e-1b0381c1e07e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:02.370516 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [req-06036712-e10a-400a-9377-9e93e744a864 req-dbb252ba-4e3e-4ef1-9d44-4bfaaa8178d4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032955 Jul 11 11:28:02.371114 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 147/305] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 11:28:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:28:02.375602 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-d6f93a80-4795-480a-854e-1b0381c1e07e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:02.376807 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-d6f93a80-4795-480a-854e-1b0381c1e07e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1723 microversion: 2.20 time: 0.255999 Jul 11 11:28:02.377692 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 159/306] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:28:02 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1723 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:28:02.509482 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-85e3f3c5-d476-4cce-a1cd-26d202917432 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:02.510205 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-85e3f3c5-d476-4cce-a1cd-26d202917432 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: b39fbe8d-e6a4-4482-981f-ac21c2b52176] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:02.516445 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-85e3f3c5-d476-4cce-a1cd-26d202917432 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:02.516899 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-85e3f3c5-d476-4cce-a1cd-26d202917432 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:02.517668 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-85e3f3c5-d476-4cce-a1cd-26d202917432 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:02.518106 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-85e3f3c5-d476-4cce-a1cd-26d202917432 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:02.651644 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-85e3f3c5-d476-4cce-a1cd-26d202917432 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:02.668578 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-16e8c791-9405-4540-91c5-aef1f80da452 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:02.668578 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-16e8c791-9405-4540-91c5-aef1f80da452 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] [instance: f6b6dcad-2258-4120-9256-bef3997f8486] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:02.669144 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-85e3f3c5-d476-4cce-a1cd-26d202917432 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/b39fbe8d-e6a4-4482-981f-ac21c2b52176" status: 200 len: 1509 microversion: 2.1 time: 0.162508 Jul 11 11:28:02.669144 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 148/307] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:02 2022] GET /compute/v2.1/servers/b39fbe8d-e6a4-4482-981f-ac21c2b52176 => generated 1509 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:28:02.673461 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-16e8c791-9405-4540-91c5-aef1f80da452 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:02.673960 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-16e8c791-9405-4540-91c5-aef1f80da452 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:02.674692 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-16e8c791-9405-4540-91c5-aef1f80da452 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:02.675133 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-16e8c791-9405-4540-91c5-aef1f80da452 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:02.707963 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-16e8c791-9405-4540-91c5-aef1f80da452 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:02.708460 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-16e8c791-9405-4540-91c5-aef1f80da452 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:02.708988 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.objects.instance [None req-16e8c791-9405-4540-91c5-aef1f80da452 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lazy-loading 'fault' on Instance uuid f6b6dcad-2258-4120-9256-bef3997f8486 {{(pid=118321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 11:28:02.750058 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-16e8c791-9405-4540-91c5-aef1f80da452 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc29ac59eed483b8c6443c397505adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890e7e79ff744b6b9589f166cd7d8979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:02.757810 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-16e8c791-9405-4540-91c5-aef1f80da452 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] 10.222.0.26 "GET /compute/v2.1/servers/f6b6dcad-2258-4120-9256-bef3997f8486" status: 200 len: 1303 microversion: 2.1 time: 0.098328 Jul 11 11:28:02.758358 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 160/308] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:02 2022] GET /compute/v2.1/servers/f6b6dcad-2258-4120-9256-bef3997f8486 => generated 1303 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:03.395513 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-655cf8b5-62a9-4d02-9eac-90fb1f674b7d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:03.396112 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-655cf8b5-62a9-4d02-9eac-90fb1f674b7d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:03.404666 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-655cf8b5-62a9-4d02-9eac-90fb1f674b7d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:03.405109 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-655cf8b5-62a9-4d02-9eac-90fb1f674b7d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:03.405859 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-655cf8b5-62a9-4d02-9eac-90fb1f674b7d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:03.406291 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-655cf8b5-62a9-4d02-9eac-90fb1f674b7d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:03.547073 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-655cf8b5-62a9-4d02-9eac-90fb1f674b7d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:03.556065 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-655cf8b5-62a9-4d02-9eac-90fb1f674b7d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:03.557653 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-655cf8b5-62a9-4d02-9eac-90fb1f674b7d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:03.559023 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-655cf8b5-62a9-4d02-9eac-90fb1f674b7d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1723 microversion: 2.20 time: 0.167592 Jul 11 11:28:03.559747 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 149/309] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:28:03 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:28:03.593982 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-82f021bb-814e-4b3e-8b09-b9980728a26b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Action: 'create', calling method: .version_select at 0x7fb01058db80>, body: {"keypair": {"name": "tempest-keypair-1069181504", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLOxSXPBJhr77nCBe8ecIECC/4IcukZruIertyFo0iJ3y+o6Vxq2nbdZ1ks1pNx5PeMHn67DxZ9XmVbFVQerJy64FaJeTuVRsQllcTQBNozJRD/9wx0zT20kzlIO+tDsmw=="}} {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:28:03.613115 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.quota [None req-82f021bb-814e-4b3e-8b09-b9980728a26b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Getting quotas for project 1328a510264f4374baabad7b5243d8c2. Resources: {'key_pairs'} {{(pid=118321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 11:28:03.619788 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.quota [None req-82f021bb-814e-4b3e-8b09-b9980728a26b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Getting quotas for user cbcc15c786fb43669ac34a4897735c1d and project 1328a510264f4374baabad7b5243d8c2. Resources: {'key_pairs'} {{(pid=118321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 11:28:03.684475 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-9bf09791-5f1b-411c-86a4-57672c023f36 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:03.685110 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-9bf09791-5f1b-411c-86a4-57672c023f36 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: b39fbe8d-e6a4-4482-981f-ac21c2b52176] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:03.691111 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9bf09791-5f1b-411c-86a4-57672c023f36 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:03.691611 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9bf09791-5f1b-411c-86a4-57672c023f36 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:03.692361 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9bf09791-5f1b-411c-86a4-57672c023f36 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:03.692787 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9bf09791-5f1b-411c-86a4-57672c023f36 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:03.697413 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:28:03.744381 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-82f021bb-814e-4b3e-8b09-b9980728a26b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.154287 Jul 11 11:28:03.744994 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 161/310] 10.222.0.26 () {60 vars in 1158 bytes} [Mon Jul 11 11:28:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:28:03.774709 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-1adcd4f3-6f26-4734-9575-3e595f5039c3 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:03.775356 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-1adcd4f3-6f26-4734-9575-3e595f5039c3 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] [instance: f6b6dcad-2258-4120-9256-bef3997f8486] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:03.781530 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1adcd4f3-6f26-4734-9575-3e595f5039c3 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:03.781983 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1adcd4f3-6f26-4734-9575-3e595f5039c3 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:03.782760 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1adcd4f3-6f26-4734-9575-3e595f5039c3 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:03.783199 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1adcd4f3-6f26-4734-9575-3e595f5039c3 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:03.814364 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1adcd4f3-6f26-4734-9575-3e595f5039c3 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:03.814742 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1adcd4f3-6f26-4734-9575-3e595f5039c3 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:03.815133 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.objects.instance [None req-1adcd4f3-6f26-4734-9575-3e595f5039c3 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lazy-loading 'fault' on Instance uuid f6b6dcad-2258-4120-9256-bef3997f8486 {{(pid=118321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 11:28:03.825222 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-9bf09791-5f1b-411c-86a4-57672c023f36 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:03.832764 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-9bf09791-5f1b-411c-86a4-57672c023f36 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/b39fbe8d-e6a4-4482-981f-ac21c2b52176" status: 200 len: 1509 microversion: 2.1 time: 0.152072 Jul 11 11:28:03.833338 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 150/311] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:03 2022] GET /compute/v2.1/servers/b39fbe8d-e6a4-4482-981f-ac21c2b52176 => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:28:03.858107 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-1adcd4f3-6f26-4734-9575-3e595f5039c3 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc29ac59eed483b8c6443c397505adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890e7e79ff744b6b9589f166cd7d8979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:03.865592 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-1adcd4f3-6f26-4734-9575-3e595f5039c3 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] 10.222.0.26 "GET /compute/v2.1/servers/f6b6dcad-2258-4120-9256-bef3997f8486" status: 200 len: 1303 microversion: 2.1 time: 0.095307 Jul 11 11:28:03.866704 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 162/312] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:03 2022] GET /compute/v2.1/servers/f6b6dcad-2258-4120-9256-bef3997f8486 => generated 1303 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:28:04.579031 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-0ce960e7-6c46-4df2-8ee4-c65cd03ef76b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:04.579858 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-0ce960e7-6c46-4df2-8ee4-c65cd03ef76b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:04.586324 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0ce960e7-6c46-4df2-8ee4-c65cd03ef76b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:04.586779 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0ce960e7-6c46-4df2-8ee4-c65cd03ef76b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:04.587587 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0ce960e7-6c46-4df2-8ee4-c65cd03ef76b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:04.588023 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0ce960e7-6c46-4df2-8ee4-c65cd03ef76b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:04.727010 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-0ce960e7-6c46-4df2-8ee4-c65cd03ef76b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:04.735012 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-0ce960e7-6c46-4df2-8ee4-c65cd03ef76b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:04.748415 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-0ce960e7-6c46-4df2-8ee4-c65cd03ef76b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:04.748415 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-0ce960e7-6c46-4df2-8ee4-c65cd03ef76b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1723 microversion: 2.20 time: 0.163595 Jul 11 11:28:04.748415 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 151/313] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:28:04 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:28:04.850345 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-b327bfdf-7a41-4007-8908-d670ccb7c0ce tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:04.851545 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-b327bfdf-7a41-4007-8908-d670ccb7c0ce tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: b39fbe8d-e6a4-4482-981f-ac21c2b52176] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:04.857878 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b327bfdf-7a41-4007-8908-d670ccb7c0ce tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:04.858329 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b327bfdf-7a41-4007-8908-d670ccb7c0ce tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:04.859106 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b327bfdf-7a41-4007-8908-d670ccb7c0ce tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:04.859554 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b327bfdf-7a41-4007-8908-d670ccb7c0ce tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:04.883279 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-93e453f3-db7e-4ef8-86ba-56ccc4f9c0b7 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:04.883998 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-93e453f3-db7e-4ef8-86ba-56ccc4f9c0b7 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] [instance: f6b6dcad-2258-4120-9256-bef3997f8486] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:04.890130 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-93e453f3-db7e-4ef8-86ba-56ccc4f9c0b7 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:04.890581 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-93e453f3-db7e-4ef8-86ba-56ccc4f9c0b7 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:04.891544 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-93e453f3-db7e-4ef8-86ba-56ccc4f9c0b7 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:04.891862 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-93e453f3-db7e-4ef8-86ba-56ccc4f9c0b7 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:04.922974 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-93e453f3-db7e-4ef8-86ba-56ccc4f9c0b7 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:04.923712 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-93e453f3-db7e-4ef8-86ba-56ccc4f9c0b7 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:04.924179 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.objects.instance [None req-93e453f3-db7e-4ef8-86ba-56ccc4f9c0b7 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lazy-loading 'fault' on Instance uuid f6b6dcad-2258-4120-9256-bef3997f8486 {{(pid=118322) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 11:28:04.969022 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-93e453f3-db7e-4ef8-86ba-56ccc4f9c0b7 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc29ac59eed483b8c6443c397505adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890e7e79ff744b6b9589f166cd7d8979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:04.978787 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-93e453f3-db7e-4ef8-86ba-56ccc4f9c0b7 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] 10.222.0.26 "GET /compute/v2.1/servers/f6b6dcad-2258-4120-9256-bef3997f8486" status: 200 len: 1303 microversion: 2.1 time: 0.099267 Jul 11 11:28:04.980106 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 152/314] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:04 2022] GET /compute/v2.1/servers/f6b6dcad-2258-4120-9256-bef3997f8486 => generated 1303 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:28:05.002582 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-b327bfdf-7a41-4007-8908-d670ccb7c0ce tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:05.010210 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-b327bfdf-7a41-4007-8908-d670ccb7c0ce tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/b39fbe8d-e6a4-4482-981f-ac21c2b52176" status: 200 len: 1515 microversion: 2.1 time: 0.164264 Jul 11 11:28:05.011571 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 163/315] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:04 2022] GET /compute/v2.1/servers/b39fbe8d-e6a4-4482-981f-ac21c2b52176 => generated 1515 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:05.758050 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-9a4ea97d-53ae-43dc-a4e6-976ddc0859d5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:05.758658 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-9a4ea97d-53ae-43dc-a4e6-976ddc0859d5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:05.765832 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9a4ea97d-53ae-43dc-a4e6-976ddc0859d5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:05.766303 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9a4ea97d-53ae-43dc-a4e6-976ddc0859d5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:05.767147 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9a4ea97d-53ae-43dc-a4e6-976ddc0859d5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:05.767643 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9a4ea97d-53ae-43dc-a4e6-976ddc0859d5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:05.985005 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-9a4ea97d-53ae-43dc-a4e6-976ddc0859d5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:05.994175 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-9a4ea97d-53ae-43dc-a4e6-976ddc0859d5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:05.995709 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-9a4ea97d-53ae-43dc-a4e6-976ddc0859d5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:05.996970 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-9a4ea97d-53ae-43dc-a4e6-976ddc0859d5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1723 microversion: 2.20 time: 0.244156 Jul 11 11:28:05.997322 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-fec45a20-088a-47d6-85b5-4ef92efb7371 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:05.997787 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-fec45a20-088a-47d6-85b5-4ef92efb7371 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] [instance: f6b6dcad-2258-4120-9256-bef3997f8486] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:06.004957 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fec45a20-088a-47d6-85b5-4ef92efb7371 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:06.005408 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fec45a20-088a-47d6-85b5-4ef92efb7371 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:06.009154 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fec45a20-088a-47d6-85b5-4ef92efb7371 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:06.009154 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fec45a20-088a-47d6-85b5-4ef92efb7371 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:06.009349 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 153/316] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:28:05 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1723 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:28:06.021242 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.wsgi [None req-fec45a20-088a-47d6-85b5-4ef92efb7371 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] HTTP exception thrown: Instance f6b6dcad-2258-4120-9256-bef3997f8486 could not be found. Jul 11 11:28:06.023064 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-fec45a20-088a-47d6-85b5-4ef92efb7371 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Request method failure captured: Jul 11 11:28:06.023064 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: request: GET /compute/v2.1/servers/f6b6dcad-2258-4120-9256-bef3997f8486 HTTP/1.1 Jul 11 11:28:06.023064 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Accept: application/json Jul 11 11:28:06.023064 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Accept-Encoding: identity Jul 11 11:28:06.023064 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Connection: close Jul 11 11:28:06.023064 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Content-Length: 0 Jul 11 11:28:06.023064 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Content-Type: application/json Jul 11 11:28:06.023064 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Host: 10.222.0.26 Jul 11 11:28:06.023064 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Openstack-System-Scope: None Jul 11 11:28:06.023064 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: User-Agent: python-urllib3/1.26.9 Jul 11 11:28:06.023064 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Auth-Token: gAAAAABizAkre02fn49DdNJcuS-XenEKUsDKGIqeMJJFW9tiLy-zlrGvGjoQFZ2qnlQCplE1IhxHtV96fwSt1jVaUb1aEGJUpg_x9sw6xfQvjfRbrDus0aqHfiZ3yS4QqilNHCVKK30qnl93VyKwrAxnMcN2yTJfaSLhMOJKmGwDMixVCjmgqnM Jul 11 11:28:06.023064 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Domain-Id: None Jul 11 11:28:06.023064 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Domain-Name: None Jul 11 11:28:06.023064 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Identity-Status: Confirmed Jul 11 11:28:06.023064 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Is-Admin-Project: True Jul 11 11:28:06.023064 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Domain-Id: default Jul 11 11:28:06.023064 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Domain-Name: Default Jul 11 11:28:06.023064 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Id: 890e7e79ff744b6b9589f166cd7d8979 Jul 11 11:28:06.023064 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Name: tempest-VolumesActionsTest-2072641558 Jul 11 11:28:06.023064 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Role: member,reader Jul 11 11:28:06.023064 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Roles: member,reader Jul 11 11:28:06.024554 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_890e7e79ff744b6b9589f166cd7d8979"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/890e7e79ff744b6b9589f166cd7d8979"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/890e7e79ff744b6b9589f166cd7d8979"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/890e7e79ff744b6b9589f166cd7d8979"}]}] Jul 11 11:28:06.024554 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Tenant: tempest-VolumesActionsTest-2072641558 Jul 11 11:28:06.024554 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Tenant-Id: 890e7e79ff744b6b9589f166cd7d8979 Jul 11 11:28:06.024554 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Tenant-Name: tempest-VolumesActionsTest-2072641558 Jul 11 11:28:06.024554 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User: tempest-VolumesActionsTest-2072641558-project Jul 11 11:28:06.024554 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Domain-Id: default Jul 11 11:28:06.024554 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Domain-Name: Default Jul 11 11:28:06.024554 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Id: 9dc29ac59eed483b8c6443c397505adc Jul 11 11:28:06.024554 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Name: tempest-VolumesActionsTest-2072641558-project Jul 11 11:28:06.024554 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: method: > Jul 11 11:28:06.024554 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: exception: Instance f6b6dcad-2258-4120-9256-bef3997f8486 could not be found. Jul 11 11:28:06.024554 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: action_args: {'id': 'f6b6dcad-2258-4120-9256-bef3997f8486'} Jul 11 11:28:06.025454 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 11:28:06.025454 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:28:06.025454 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 11:28:06.025454 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 11:28:06.025454 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 11:28:06.025454 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 11:28:06.025454 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 11:28:06.025454 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 11:28:06.025454 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 11:28:06.025454 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 11:28:06.025454 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6b6dcad-2258-4120-9256-bef3997f8486 could not be found. Jul 11 11:28:06.025454 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:28:06.025454 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:28:06.025454 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:28:06.025454 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:28:06.025454 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:28:06.025454 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:28:06.025454 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 11:28:06.025454 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 11:28:06.025454 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 11:28:06.026806 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 11:28:06.026806 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 11:28:06.026806 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 11:28:06.026806 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 11:28:06.026806 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 11:28:06.026806 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 11:28:06.026806 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 11:28:06.026806 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6b6dcad-2258-4120-9256-bef3997f8486 could not be found. Jul 11 11:28:06.026806 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:28:06.026806 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:28:06.026806 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:28:06.026806 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:28:06.026806 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:28:06.026806 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:28:06.026806 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 11:28:06.026806 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 11:28:06.026806 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6b6dcad-2258-4120-9256-bef3997f8486 could not be found. Jul 11 11:28:06.026806 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:28:06.028637 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-fec45a20-088a-47d6-85b5-4ef92efb7371 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Returning 404 to user: Instance f6b6dcad-2258-4120-9256-bef3997f8486 could not be found. {{(pid=118321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 11:28:06.028637 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-fec45a20-088a-47d6-85b5-4ef92efb7371 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] 10.222.0.26 "GET /compute/v2.1/servers/f6b6dcad-2258-4120-9256-bef3997f8486" status: 404 len: 111 microversion: 2.1 time: 0.031646 Jul 11 11:28:06.030952 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 164/317] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:05 2022] GET /compute/v2.1/servers/f6b6dcad-2258-4120-9256-bef3997f8486 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 11:28:06.164895 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-36a70688-32c5-4139-a784-b801ff8ba0bc tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1941909890", "imageRef": "1bb93fc1-b713-4e67-8f76-bfec3a96168b", "flavorRef": "452", "networks": [{"uuid": "17637e39-a722-4f0d-8b40-9106b67b2b4b"}]}} {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:28:06.219363 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.network.neutron [None req-36a70688-32c5-4139-a784-b801ff8ba0bc tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] validate_networks() for [('17637e39-a722-4f0d-8b40-9106b67b2b4b', None, None, None, None, None)] {{(pid=118322) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 11:28:06.613046 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-e9be67eb-bd87-4067-8841-b5881743b936 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1604042677", "imageRef": "1bb93fc1-b713-4e67-8f76-bfec3a96168b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "415c4ce2-00a4-4e63-ad18-4153e0b2d10b"}], "security_groups": [{"name": "tempest-securitygroup--1733976224"}], "key_name": "tempest-keypair-1069181504", "user_data": "}} {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:28:06.685468 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.virt.hardware [None req-36a70688-32c5-4139-a784-b801ff8ba0bc tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Flavor limits 0:0:0 {{(pid=118322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 11:28:06.685998 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.virt.hardware [None req-36a70688-32c5-4139-a784-b801ff8ba0bc tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Image limits 0:0:0 {{(pid=118322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 11:28:06.686498 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.virt.hardware [None req-36a70688-32c5-4139-a784-b801ff8ba0bc tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Flavor pref 0:0:0 {{(pid=118322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 11:28:06.686977 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.virt.hardware [None req-36a70688-32c5-4139-a784-b801ff8ba0bc tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Image pref 0:0:0 {{(pid=118322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 11:28:06.687507 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.virt.hardware [None req-36a70688-32c5-4139-a784-b801ff8ba0bc tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 11:28:06.698067 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-36a70688-32c5-4139-a784-b801ff8ba0bc tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:06.698749 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-36a70688-32c5-4139-a784-b801ff8ba0bc tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:06.699731 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-36a70688-32c5-4139-a784-b801ff8ba0bc tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:06.700168 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-36a70688-32c5-4139-a784-b801ff8ba0bc tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:06.727789 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.quota [None req-36a70688-32c5-4139-a784-b801ff8ba0bc tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Getting quotas for project 890e7e79ff744b6b9589f166cd7d8979. Resources: {'cores', 'ram', 'instances'} {{(pid=118322) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 11:28:06.733166 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.quota [None req-36a70688-32c5-4139-a784-b801ff8ba0bc tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Getting quotas for user 9dc29ac59eed483b8c6443c397505adc and project 890e7e79ff744b6b9589f166cd7d8979. Resources: {'cores', 'ram', 'instances'} {{(pid=118322) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 11:28:06.734176 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.network.neutron [None req-e9be67eb-bd87-4067-8841-b5881743b936 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] validate_networks() for [('415c4ce2-00a4-4e63-ad18-4153e0b2d10b', None, None, None, None, None)] {{(pid=118321) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 11:28:06.746733 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-36a70688-32c5-4139-a784-b801ff8ba0bc tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Going to run 1 instances... {{(pid=118322) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 11:28:06.749233 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-36a70688-32c5-4139-a784-b801ff8ba0bc tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] [instance: b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb93fc1-b713-4e67-8f76-bfec3a96168b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118322) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 11:28:06.893035 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-36a70688-32c5-4139-a784-b801ff8ba0bc tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.732451 Jul 11 11:28:06.899710 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 154/318] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jul 11 11:28:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 734 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 11 11:28:06.904754 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-816d5d51-7ddf-46b4-8ad0-e6811215f3d6 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:06.905372 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-816d5d51-7ddf-46b4-8ad0-e6811215f3d6 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] [instance: b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:06.977144 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-816d5d51-7ddf-46b4-8ad0-e6811215f3d6 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc29ac59eed483b8c6443c397505adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890e7e79ff744b6b9589f166cd7d8979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:06.984489 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-816d5d51-7ddf-46b4-8ad0-e6811215f3d6 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] 10.222.0.26 "GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0" status: 200 len: 1214 microversion: 2.1 time: 0.083599 Jul 11 11:28:06.985065 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 155/319] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:06 2022] GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:28:07.005271 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-c6420aba-9193-40e9-ac32-45a040e350a6 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Action: 'create', calling method: .version_select at 0x7fb01187d820>, body: {"keypair": {"name": "tempest-keypair-2013041530", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHuvX4H7n33H77XBiFxjLTH0fqt2qVxYWRlaqGDpmv7hZsDo3JPdTHJ7au3ZNV8IHLWACLCmKH68Yoap1SVVWE6SxBqpBSuYpKfgT9N4zgiKncthkNnhd18BtLtvzE/Osg=="}} {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:28:07.028253 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.quota [None req-c6420aba-9193-40e9-ac32-45a040e350a6 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Getting quotas for project c8639f8c836d4ad79d147b855d9017f8. Resources: {'key_pairs'} {{(pid=118322) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 11:28:07.028253 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.quota [None req-c6420aba-9193-40e9-ac32-45a040e350a6 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Getting quotas for user e47c365946cf4264a2d2205ace04379d and project c8639f8c836d4ad79d147b855d9017f8. Resources: {'key_pairs'} {{(pid=118322) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 11:28:07.174194 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-c6420aba-9193-40e9-ac32-45a040e350a6 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.173055 Jul 11 11:28:07.176133 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 156/320] 10.222.0.26 () {60 vars in 1158 bytes} [Mon Jul 11 11:28:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:28:07.180219 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-5600afb5-a318-40f6-a7ba-96997c2fe6d5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:07.180833 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-5600afb5-a318-40f6-a7ba-96997c2fe6d5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:07.191637 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5600afb5-a318-40f6-a7ba-96997c2fe6d5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:07.192318 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5600afb5-a318-40f6-a7ba-96997c2fe6d5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:07.193187 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5600afb5-a318-40f6-a7ba-96997c2fe6d5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:07.193628 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5600afb5-a318-40f6-a7ba-96997c2fe6d5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:07.228179 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.virt.hardware [None req-e9be67eb-bd87-4067-8841-b5881743b936 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Flavor limits 0:0:0 {{(pid=118321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 11:28:07.228683 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.virt.hardware [None req-e9be67eb-bd87-4067-8841-b5881743b936 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Image limits 0:0:0 {{(pid=118321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 11:28:07.229053 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.virt.hardware [None req-e9be67eb-bd87-4067-8841-b5881743b936 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Flavor pref 0:0:0 {{(pid=118321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 11:28:07.229455 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.virt.hardware [None req-e9be67eb-bd87-4067-8841-b5881743b936 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Image pref 0:0:0 {{(pid=118321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 11:28:07.229861 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.virt.hardware [None req-e9be67eb-bd87-4067-8841-b5881743b936 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 11:28:07.238729 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e9be67eb-bd87-4067-8841-b5881743b936 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:07.239171 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e9be67eb-bd87-4067-8841-b5881743b936 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:07.240113 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e9be67eb-bd87-4067-8841-b5881743b936 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:07.240570 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e9be67eb-bd87-4067-8841-b5881743b936 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:07.262288 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.quota [None req-e9be67eb-bd87-4067-8841-b5881743b936 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Getting quotas for project 1328a510264f4374baabad7b5243d8c2. Resources: {'cores', 'ram', 'instances'} {{(pid=118321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 11:28:07.263159 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.quota [None req-e9be67eb-bd87-4067-8841-b5881743b936 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Getting quotas for user cbcc15c786fb43669ac34a4897735c1d and project 1328a510264f4374baabad7b5243d8c2. Resources: {'cores', 'ram', 'instances'} {{(pid=118321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 11:28:07.275694 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-e9be67eb-bd87-4067-8841-b5881743b936 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Going to run 1 instances... {{(pid=118321) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 11:28:07.278065 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-e9be67eb-bd87-4067-8841-b5881743b936 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb93fc1-b713-4e67-8f76-bfec3a96168b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118321) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 11:28:07.290746 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:28:07.334309 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-5600afb5-a318-40f6-a7ba-96997c2fe6d5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:07.343432 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-5600afb5-a318-40f6-a7ba-96997c2fe6d5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:07.345346 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-5600afb5-a318-40f6-a7ba-96997c2fe6d5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:07.346882 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-5600afb5-a318-40f6-a7ba-96997c2fe6d5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1744 microversion: 2.20 time: 0.170771 Jul 11 11:28:07.347566 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 157/321] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:28:07 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1744 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:28:07.404766 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-e9be67eb-bd87-4067-8841-b5881743b936 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.796115 Jul 11 11:28:07.405635 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 165/322] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jul 11 11:28:06 2022] POST /compute/v2.1/servers => generated 402 bytes in 798 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 11 11:28:07.417250 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-0db644c8-677f-4a29-a5fe-0228af742458 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:07.417968 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-0db644c8-677f-4a29-a5fe-0228af742458 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:07.483492 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-0db644c8-677f-4a29-a5fe-0228af742458 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:07.490887 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-0db644c8-677f-4a29-a5fe-0228af742458 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e" status: 200 len: 1242 microversion: 2.1 time: 0.078132 Jul 11 11:28:07.492420 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 158/323] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:07 2022] GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e => generated 1242 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:08.002144 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-85b04d40-58d5-4bbf-92b5-1087ed81a421 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:08.002758 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-85b04d40-58d5-4bbf-92b5-1087ed81a421 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] [instance: b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:08.019228 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-85b04d40-58d5-4bbf-92b5-1087ed81a421 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:08.019228 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-85b04d40-58d5-4bbf-92b5-1087ed81a421 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:08.019228 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-85b04d40-58d5-4bbf-92b5-1087ed81a421 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:08.019228 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-85b04d40-58d5-4bbf-92b5-1087ed81a421 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:08.103442 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-85b04d40-58d5-4bbf-92b5-1087ed81a421 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc29ac59eed483b8c6443c397505adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890e7e79ff744b6b9589f166cd7d8979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:08.111383 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-85b04d40-58d5-4bbf-92b5-1087ed81a421 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] 10.222.0.26 "GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0" status: 200 len: 1218 microversion: 2.1 time: 0.113120 Jul 11 11:28:08.112039 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 166/324] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:07 2022] GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0 => generated 1218 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:08.366744 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-e6dab56d-b9a1-41da-b7b1-37f435a6e5d9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:08.367367 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-e6dab56d-b9a1-41da-b7b1-37f435a6e5d9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:08.369922 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:28:08.375729 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e6dab56d-b9a1-41da-b7b1-37f435a6e5d9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:08.376177 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e6dab56d-b9a1-41da-b7b1-37f435a6e5d9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:08.376940 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e6dab56d-b9a1-41da-b7b1-37f435a6e5d9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:08.377373 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e6dab56d-b9a1-41da-b7b1-37f435a6e5d9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:08.509843 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-175231f1-0c1b-423d-9729-0c2f0ff6000e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:08.510509 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-175231f1-0c1b-423d-9729-0c2f0ff6000e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:08.517141 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-175231f1-0c1b-423d-9729-0c2f0ff6000e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:08.517791 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-175231f1-0c1b-423d-9729-0c2f0ff6000e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:08.518750 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-175231f1-0c1b-423d-9729-0c2f0ff6000e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:08.519190 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-175231f1-0c1b-423d-9729-0c2f0ff6000e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:08.521994 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:28:08.528417 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-e6dab56d-b9a1-41da-b7b1-37f435a6e5d9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:08.536413 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-e6dab56d-b9a1-41da-b7b1-37f435a6e5d9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:08.537920 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-e6dab56d-b9a1-41da-b7b1-37f435a6e5d9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:08.539222 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-e6dab56d-b9a1-41da-b7b1-37f435a6e5d9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1744 microversion: 2.20 time: 0.177112 Jul 11 11:28:08.539801 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 159/325] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:28:08 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1744 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:28:08.598597 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-175231f1-0c1b-423d-9729-0c2f0ff6000e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:08.607362 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-175231f1-0c1b-423d-9729-0c2f0ff6000e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e" status: 200 len: 1246 microversion: 2.1 time: 0.101901 Jul 11 11:28:08.608155 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 167/326] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:08 2022] GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e => generated 1246 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:28:09.127817 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-f1601090-8267-4d9a-975a-e4209330c448 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:09.128429 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-f1601090-8267-4d9a-975a-e4209330c448 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] [instance: b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:09.135219 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f1601090-8267-4d9a-975a-e4209330c448 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:09.135694 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f1601090-8267-4d9a-975a-e4209330c448 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:09.136461 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f1601090-8267-4d9a-975a-e4209330c448 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:09.136890 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f1601090-8267-4d9a-975a-e4209330c448 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:09.207923 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-f1601090-8267-4d9a-975a-e4209330c448 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc29ac59eed483b8c6443c397505adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890e7e79ff744b6b9589f166cd7d8979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:09.215964 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-f1601090-8267-4d9a-975a-e4209330c448 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] 10.222.0.26 "GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0" status: 200 len: 1218 microversion: 2.1 time: 0.092451 Jul 11 11:28:09.216746 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 160/327] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:09 2022] GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0 => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:09.558523 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-0a1e4d2d-16d9-40a0-b1da-db0967644183 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:09.559844 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-0a1e4d2d-16d9-40a0-b1da-db0967644183 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:09.568056 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0a1e4d2d-16d9-40a0-b1da-db0967644183 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:09.568493 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0a1e4d2d-16d9-40a0-b1da-db0967644183 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:09.569270 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0a1e4d2d-16d9-40a0-b1da-db0967644183 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:09.570200 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0a1e4d2d-16d9-40a0-b1da-db0967644183 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:09.625874 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-11212f8b-d330-4ba6-8989-a1e931060dc3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:09.626493 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-11212f8b-d330-4ba6-8989-a1e931060dc3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:09.633591 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-11212f8b-d330-4ba6-8989-a1e931060dc3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:09.634036 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-11212f8b-d330-4ba6-8989-a1e931060dc3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:09.634802 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-11212f8b-d330-4ba6-8989-a1e931060dc3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:09.635236 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-11212f8b-d330-4ba6-8989-a1e931060dc3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:09.708371 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-11212f8b-d330-4ba6-8989-a1e931060dc3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:09.718054 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-0a1e4d2d-16d9-40a0-b1da-db0967644183 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:09.729110 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-11212f8b-d330-4ba6-8989-a1e931060dc3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e" status: 200 len: 1246 microversion: 2.1 time: 0.096339 Jul 11 11:28:09.729110 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 161/328] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:09 2022] GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e => generated 1246 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:28:09.729520 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-0a1e4d2d-16d9-40a0-b1da-db0967644183 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:09.730302 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-0a1e4d2d-16d9-40a0-b1da-db0967644183 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:09.731511 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-0a1e4d2d-16d9-40a0-b1da-db0967644183 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1744 microversion: 2.20 time: 0.178021 Jul 11 11:28:09.732067 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 168/329] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:28:09 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1744 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 11:28:09.801912 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-571dcb03-3165-43c5-bbd2-e13c60a9c95d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1127208164", "imageRef": "1bb93fc1-b713-4e67-8f76-bfec3a96168b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ff421ce3-5a34-44ce-8897-a19d2373f4d2"}], "security_groups": [{"name": "tempest-securitygroup--1808070454"}], "key_name": "tempest-keypair-2013041530", "user_data": "}} {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:28:09.911290 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.network.neutron [None req-571dcb03-3165-43c5-bbd2-e13c60a9c95d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] validate_networks() for [('ff421ce3-5a34-44ce-8897-a19d2373f4d2', None, None, None, None, None)] {{(pid=118322) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 11:28:10.233318 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-b795b79a-c7ba-4f22-b3fb-8c3110a2c170 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:10.234129 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-b795b79a-c7ba-4f22-b3fb-8c3110a2c170 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] [instance: b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:10.240883 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b795b79a-c7ba-4f22-b3fb-8c3110a2c170 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:10.242002 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b795b79a-c7ba-4f22-b3fb-8c3110a2c170 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:10.242910 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b795b79a-c7ba-4f22-b3fb-8c3110a2c170 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:10.243452 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b795b79a-c7ba-4f22-b3fb-8c3110a2c170 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:10.309117 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-b795b79a-c7ba-4f22-b3fb-8c3110a2c170 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc29ac59eed483b8c6443c397505adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890e7e79ff744b6b9589f166cd7d8979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:10.316901 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-b795b79a-c7ba-4f22-b3fb-8c3110a2c170 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] 10.222.0.26 "GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0" status: 200 len: 1218 microversion: 2.1 time: 0.088053 Jul 11 11:28:10.317713 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 169/330] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:10 2022] GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:28:10.568394 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.virt.hardware [None req-571dcb03-3165-43c5-bbd2-e13c60a9c95d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Flavor limits 0:0:0 {{(pid=118322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 11:28:10.568823 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.virt.hardware [None req-571dcb03-3165-43c5-bbd2-e13c60a9c95d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Image limits 0:0:0 {{(pid=118322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 11:28:10.569845 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.virt.hardware [None req-571dcb03-3165-43c5-bbd2-e13c60a9c95d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Flavor pref 0:0:0 {{(pid=118322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 11:28:10.570256 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.virt.hardware [None req-571dcb03-3165-43c5-bbd2-e13c60a9c95d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Image pref 0:0:0 {{(pid=118322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 11:28:10.570700 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.virt.hardware [None req-571dcb03-3165-43c5-bbd2-e13c60a9c95d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 11:28:10.579547 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-571dcb03-3165-43c5-bbd2-e13c60a9c95d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:10.580007 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-571dcb03-3165-43c5-bbd2-e13c60a9c95d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:10.591604 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-571dcb03-3165-43c5-bbd2-e13c60a9c95d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:10.591604 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-571dcb03-3165-43c5-bbd2-e13c60a9c95d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:10.598901 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.quota [None req-571dcb03-3165-43c5-bbd2-e13c60a9c95d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Getting quotas for project c8639f8c836d4ad79d147b855d9017f8. Resources: {'cores', 'ram', 'instances'} {{(pid=118322) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 11:28:10.603620 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.quota [None req-571dcb03-3165-43c5-bbd2-e13c60a9c95d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Getting quotas for user e47c365946cf4264a2d2205ace04379d and project c8639f8c836d4ad79d147b855d9017f8. Resources: {'cores', 'ram', 'instances'} {{(pid=118322) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 11:28:10.615654 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-571dcb03-3165-43c5-bbd2-e13c60a9c95d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Going to run 1 instances... {{(pid=118322) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 11:28:10.618529 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-571dcb03-3165-43c5-bbd2-e13c60a9c95d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb93fc1-b713-4e67-8f76-bfec3a96168b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118322) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 11:28:10.744250 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-7d040140-5adb-448a-a402-ecf37d744126 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:10.745078 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-7d040140-5adb-448a-a402-ecf37d744126 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:10.751804 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7d040140-5adb-448a-a402-ecf37d744126 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:10.752193 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7d040140-5adb-448a-a402-ecf37d744126 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:10.753006 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7d040140-5adb-448a-a402-ecf37d744126 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:10.753448 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7d040140-5adb-448a-a402-ecf37d744126 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:10.775144 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-571dcb03-3165-43c5-bbd2-e13c60a9c95d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.978435 Jul 11 11:28:10.782291 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 162/331] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jul 11 11:28:09 2022] POST /compute/v2.1/servers => generated 409 bytes in 987 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 11 11:28:10.802171 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-1b05bc0d-dc37-4da9-b2c0-448e941f8106 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:10.803067 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-1b05bc0d-dc37-4da9-b2c0-448e941f8106 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:10.812775 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1b05bc0d-dc37-4da9-b2c0-448e941f8106 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:10.813842 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1b05bc0d-dc37-4da9-b2c0-448e941f8106 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:10.814476 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1b05bc0d-dc37-4da9-b2c0-448e941f8106 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:10.814913 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1b05bc0d-dc37-4da9-b2c0-448e941f8106 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:10.854930 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-7d040140-5adb-448a-a402-ecf37d744126 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:10.864727 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-7d040140-5adb-448a-a402-ecf37d744126 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e" status: 200 len: 1238 microversion: 2.1 time: 0.124725 Jul 11 11:28:10.867977 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 170/332] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:10 2022] GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e => generated 1238 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:28:10.874432 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-cc021037-6761-470a-8e3a-f31b31656149 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:10.875197 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-cc021037-6761-470a-8e3a-f31b31656149 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:10.946832 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-cc021037-6761-470a-8e3a-f31b31656149 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:10.955726 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-cc021037-6761-470a-8e3a-f31b31656149 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1246 microversion: 2.1 time: 0.086315 Jul 11 11:28:10.956392 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 171/333] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:10 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1246 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:10.993976 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-1b05bc0d-dc37-4da9-b2c0-448e941f8106 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:11.003375 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-1b05bc0d-dc37-4da9-b2c0-448e941f8106 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:11.004982 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-1b05bc0d-dc37-4da9-b2c0-448e941f8106 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:11.006203 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-1b05bc0d-dc37-4da9-b2c0-448e941f8106 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1744 microversion: 2.20 time: 0.221015 Jul 11 11:28:11.006878 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 163/334] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:28:10 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1744 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:28:11.334424 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-7da2c466-7955-4124-91c5-72c13d2d0991 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:11.335717 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-7da2c466-7955-4124-91c5-72c13d2d0991 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] [instance: b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:11.341758 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7da2c466-7955-4124-91c5-72c13d2d0991 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:11.342200 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7da2c466-7955-4124-91c5-72c13d2d0991 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:11.342953 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7da2c466-7955-4124-91c5-72c13d2d0991 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:11.343419 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7da2c466-7955-4124-91c5-72c13d2d0991 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:11.407818 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-7da2c466-7955-4124-91c5-72c13d2d0991 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc29ac59eed483b8c6443c397505adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890e7e79ff744b6b9589f166cd7d8979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:11.415954 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-7da2c466-7955-4124-91c5-72c13d2d0991 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] 10.222.0.26 "GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0" status: 200 len: 1266 microversion: 2.1 time: 0.085419 Jul 11 11:28:11.420253 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 172/335] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:11 2022] GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0 => generated 1266 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:11.888293 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-0b4e3f6f-adf0-4691-81e7-500d2a5286c6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:11.889263 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-0b4e3f6f-adf0-4691-81e7-500d2a5286c6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:11.900076 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0b4e3f6f-adf0-4691-81e7-500d2a5286c6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:11.905692 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0b4e3f6f-adf0-4691-81e7-500d2a5286c6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:11.905692 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0b4e3f6f-adf0-4691-81e7-500d2a5286c6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:11.905692 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0b4e3f6f-adf0-4691-81e7-500d2a5286c6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:11.972454 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-c0a6cbb4-a3de-4845-944a-ac7bf7eb0902 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:11.973698 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-c0a6cbb4-a3de-4845-944a-ac7bf7eb0902 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:11.980201 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-0b4e3f6f-adf0-4691-81e7-500d2a5286c6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:11.981429 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c0a6cbb4-a3de-4845-944a-ac7bf7eb0902 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:11.981966 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c0a6cbb4-a3de-4845-944a-ac7bf7eb0902 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:11.983405 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c0a6cbb4-a3de-4845-944a-ac7bf7eb0902 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:11.983844 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c0a6cbb4-a3de-4845-944a-ac7bf7eb0902 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:11.988910 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-0b4e3f6f-adf0-4691-81e7-500d2a5286c6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e" status: 200 len: 1302 microversion: 2.1 time: 0.104485 Jul 11 11:28:11.989493 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 164/336] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:11 2022] GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e => generated 1302 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:12.025779 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-a0cea3dd-6c0a-4d2f-957c-d6f59b6d32e1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:12.026381 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-a0cea3dd-6c0a-4d2f-957c-d6f59b6d32e1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:12.032387 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a0cea3dd-6c0a-4d2f-957c-d6f59b6d32e1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:12.032832 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a0cea3dd-6c0a-4d2f-957c-d6f59b6d32e1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:12.033588 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a0cea3dd-6c0a-4d2f-957c-d6f59b6d32e1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:12.034013 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a0cea3dd-6c0a-4d2f-957c-d6f59b6d32e1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:12.047555 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-c0a6cbb4-a3de-4845-944a-ac7bf7eb0902 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:12.056181 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-c0a6cbb4-a3de-4845-944a-ac7bf7eb0902 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1250 microversion: 2.1 time: 0.087697 Jul 11 11:28:12.056758 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 173/337] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:11 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1250 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:12.164107 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-a0cea3dd-6c0a-4d2f-957c-d6f59b6d32e1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:12.171872 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-a0cea3dd-6c0a-4d2f-957c-d6f59b6d32e1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:12.174300 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-a0cea3dd-6c0a-4d2f-957c-d6f59b6d32e1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:12.174481 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-a0cea3dd-6c0a-4d2f-957c-d6f59b6d32e1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1739 microversion: 2.20 time: 0.153214 Jul 11 11:28:12.175024 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 165/338] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:28:12 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1739 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 11:28:12.433524 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-f4484e98-20cd-4dc1-a21f-8e99d722ebed tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:12.434127 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-f4484e98-20cd-4dc1-a21f-8e99d722ebed tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] [instance: b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:12.440163 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f4484e98-20cd-4dc1-a21f-8e99d722ebed tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:12.440601 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f4484e98-20cd-4dc1-a21f-8e99d722ebed tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:12.441348 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f4484e98-20cd-4dc1-a21f-8e99d722ebed tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:12.441773 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f4484e98-20cd-4dc1-a21f-8e99d722ebed tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:12.505200 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-f4484e98-20cd-4dc1-a21f-8e99d722ebed tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc29ac59eed483b8c6443c397505adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890e7e79ff744b6b9589f166cd7d8979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:12.514737 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-f4484e98-20cd-4dc1-a21f-8e99d722ebed tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] 10.222.0.26 "GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0" status: 200 len: 1274 microversion: 2.1 time: 0.085087 Jul 11 11:28:12.515327 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 174/339] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:12 2022] GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0 => generated 1274 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:13.006108 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-9ac0c4b5-bcc6-42b6-9da6-0221aca837ae tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:13.006722 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-9ac0c4b5-bcc6-42b6-9da6-0221aca837ae tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:13.014194 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9ac0c4b5-bcc6-42b6-9da6-0221aca837ae tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:13.014644 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9ac0c4b5-bcc6-42b6-9da6-0221aca837ae tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:13.015453 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9ac0c4b5-bcc6-42b6-9da6-0221aca837ae tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:13.015947 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9ac0c4b5-bcc6-42b6-9da6-0221aca837ae tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:13.073584 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-d18ff955-9bc5-4004-aad3-76c083716a54 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:13.074376 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-d18ff955-9bc5-4004-aad3-76c083716a54 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:13.081356 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d18ff955-9bc5-4004-aad3-76c083716a54 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:13.081813 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d18ff955-9bc5-4004-aad3-76c083716a54 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:13.082694 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d18ff955-9bc5-4004-aad3-76c083716a54 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:13.083200 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d18ff955-9bc5-4004-aad3-76c083716a54 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:13.083551 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-9ac0c4b5-bcc6-42b6-9da6-0221aca837ae tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:13.091261 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-9ac0c4b5-bcc6-42b6-9da6-0221aca837ae tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e" status: 200 len: 1312 microversion: 2.1 time: 0.088997 Jul 11 11:28:13.091960 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 166/340] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:13 2022] GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e => generated 1312 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:13.146285 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-d18ff955-9bc5-4004-aad3-76c083716a54 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:13.156055 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-d18ff955-9bc5-4004-aad3-76c083716a54 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1250 microversion: 2.1 time: 0.086918 Jul 11 11:28:13.156849 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 175/341] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:13 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1250 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:28:13.193459 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-3b6f7dcd-b42f-4e4d-8400-027297a09a5b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:13.194089 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-3b6f7dcd-b42f-4e4d-8400-027297a09a5b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:13.200736 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3b6f7dcd-b42f-4e4d-8400-027297a09a5b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:13.201218 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3b6f7dcd-b42f-4e4d-8400-027297a09a5b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:13.201978 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3b6f7dcd-b42f-4e4d-8400-027297a09a5b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:13.202409 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3b6f7dcd-b42f-4e4d-8400-027297a09a5b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:13.336991 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-3b6f7dcd-b42f-4e4d-8400-027297a09a5b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:13.344821 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-3b6f7dcd-b42f-4e4d-8400-027297a09a5b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:13.346350 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-3b6f7dcd-b42f-4e4d-8400-027297a09a5b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:13.347498 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-3b6f7dcd-b42f-4e4d-8400-027297a09a5b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1739 microversion: 2.20 time: 0.157994 Jul 11 11:28:13.348053 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 167/342] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:28:13 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1739 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:28:13.533971 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-7465c2fa-96e0-4de5-9fcf-e0418b21c998 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:13.534511 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-7465c2fa-96e0-4de5-9fcf-e0418b21c998 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] [instance: b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:13.541063 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7465c2fa-96e0-4de5-9fcf-e0418b21c998 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:13.541511 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7465c2fa-96e0-4de5-9fcf-e0418b21c998 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:13.542387 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7465c2fa-96e0-4de5-9fcf-e0418b21c998 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:13.542825 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7465c2fa-96e0-4de5-9fcf-e0418b21c998 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:13.606250 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-7465c2fa-96e0-4de5-9fcf-e0418b21c998 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc29ac59eed483b8c6443c397505adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890e7e79ff744b6b9589f166cd7d8979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:13.614290 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-7465c2fa-96e0-4de5-9fcf-e0418b21c998 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] 10.222.0.26 "GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0" status: 200 len: 1274 microversion: 2.1 time: 0.084594 Jul 11 11:28:13.614952 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 176/343] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:13 2022] GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0 => generated 1274 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:14.109168 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-19db38c6-f548-4030-a767-84fa0eb7c270 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:14.109774 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-19db38c6-f548-4030-a767-84fa0eb7c270 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:14.116257 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-19db38c6-f548-4030-a767-84fa0eb7c270 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:14.116704 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-19db38c6-f548-4030-a767-84fa0eb7c270 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:14.117463 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-19db38c6-f548-4030-a767-84fa0eb7c270 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:14.117898 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-19db38c6-f548-4030-a767-84fa0eb7c270 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:14.176121 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-570a315f-9919-4aa4-88cd-74b7779e4400 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:14.176821 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-570a315f-9919-4aa4-88cd-74b7779e4400 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:14.182195 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-19db38c6-f548-4030-a767-84fa0eb7c270 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:14.185549 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-570a315f-9919-4aa4-88cd-74b7779e4400 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:14.185858 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-570a315f-9919-4aa4-88cd-74b7779e4400 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:14.186787 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-570a315f-9919-4aa4-88cd-74b7779e4400 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:14.187233 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-570a315f-9919-4aa4-88cd-74b7779e4400 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:14.189881 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-19db38c6-f548-4030-a767-84fa0eb7c270 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e" status: 200 len: 1312 microversion: 2.1 time: 0.084593 Jul 11 11:28:14.190459 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 168/344] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:14 2022] GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e => generated 1312 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:14.250709 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-570a315f-9919-4aa4-88cd-74b7779e4400 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:14.259043 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-570a315f-9919-4aa4-88cd-74b7779e4400 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1250 microversion: 2.1 time: 0.087209 Jul 11 11:28:14.259757 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 177/345] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:14 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1250 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:14.365722 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-fb44c107-59bb-4bee-9714-c0402a2acc3a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:14.366827 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-fb44c107-59bb-4bee-9714-c0402a2acc3a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:14.372799 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fb44c107-59bb-4bee-9714-c0402a2acc3a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:14.373241 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fb44c107-59bb-4bee-9714-c0402a2acc3a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:14.373992 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fb44c107-59bb-4bee-9714-c0402a2acc3a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:14.374419 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fb44c107-59bb-4bee-9714-c0402a2acc3a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:14.505069 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-fb44c107-59bb-4bee-9714-c0402a2acc3a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:14.512852 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-fb44c107-59bb-4bee-9714-c0402a2acc3a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:14.514347 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-fb44c107-59bb-4bee-9714-c0402a2acc3a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:14.515715 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-fb44c107-59bb-4bee-9714-c0402a2acc3a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1739 microversion: 2.20 time: 0.153717 Jul 11 11:28:14.516377 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 169/346] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:28:14 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1739 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:28:14.632207 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-26113e63-8ca6-4266-bd9a-2974d76963c6 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:14.632866 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-26113e63-8ca6-4266-bd9a-2974d76963c6 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] [instance: b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:14.639565 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-26113e63-8ca6-4266-bd9a-2974d76963c6 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:14.640013 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-26113e63-8ca6-4266-bd9a-2974d76963c6 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:14.640781 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-26113e63-8ca6-4266-bd9a-2974d76963c6 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:14.641207 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-26113e63-8ca6-4266-bd9a-2974d76963c6 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:14.709690 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-26113e63-8ca6-4266-bd9a-2974d76963c6 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc29ac59eed483b8c6443c397505adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890e7e79ff744b6b9589f166cd7d8979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:14.718174 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-26113e63-8ca6-4266-bd9a-2974d76963c6 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] 10.222.0.26 "GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0" status: 200 len: 1274 microversion: 2.1 time: 0.090040 Jul 11 11:28:14.718750 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 178/347] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:14 2022] GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0 => generated 1274 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:14.798269 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [req-ca2f4ae3-7c82-41e2-9e3d-cf05663a3d2f req-8b8bedf1-17a1-4e4a-b74d-40192689b90e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b0ec960-6583-4639-9658-a850655eb703", "name": "network-vif-plugged", "status": "completed", "tag": "fb396fac-9f6d-4448-a468-adea47f3003f"}]} {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:28:14.806647 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [req-ca2f4ae3-7c82-41e2-9e3d-cf05663a3d2f req-8b8bedf1-17a1-4e4a-b74d-40192689b90e service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:14.807096 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [req-ca2f4ae3-7c82-41e2-9e3d-cf05663a3d2f req-8b8bedf1-17a1-4e4a-b74d-40192689b90e service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:14.817960 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.compute.server_external_events [req-ca2f4ae3-7c82-41e2-9e3d-cf05663a3d2f req-8b8bedf1-17a1-4e4a-b74d-40192689b90e service nova] Creating event network-vif-plugged:fb396fac-9f6d-4448-a468-adea47f3003f for instance 4b0ec960-6583-4639-9658-a850655eb703 on hv-cinder-84842 Jul 11 11:28:14.824079 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [req-ca2f4ae3-7c82-41e2-9e3d-cf05663a3d2f req-8b8bedf1-17a1-4e4a-b74d-40192689b90e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029405 Jul 11 11:28:14.825557 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 170/348] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 11:28:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:28:15.206781 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-5afe596f-1079-41bb-9c01-5a7cda2a9d5a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:15.207406 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-5afe596f-1079-41bb-9c01-5a7cda2a9d5a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:15.214349 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5afe596f-1079-41bb-9c01-5a7cda2a9d5a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:15.214796 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5afe596f-1079-41bb-9c01-5a7cda2a9d5a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:15.215772 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5afe596f-1079-41bb-9c01-5a7cda2a9d5a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:15.216221 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5afe596f-1079-41bb-9c01-5a7cda2a9d5a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:15.277801 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-28b5e9b7-ccff-43a0-ab89-31629b182147 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:15.278489 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-28b5e9b7-ccff-43a0-ab89-31629b182147 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:15.282244 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-5afe596f-1079-41bb-9c01-5a7cda2a9d5a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:15.284820 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-28b5e9b7-ccff-43a0-ab89-31629b182147 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:15.285269 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-28b5e9b7-ccff-43a0-ab89-31629b182147 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:15.286339 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-28b5e9b7-ccff-43a0-ab89-31629b182147 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:15.286768 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-28b5e9b7-ccff-43a0-ab89-31629b182147 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:15.289694 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-5afe596f-1079-41bb-9c01-5a7cda2a9d5a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e" status: 200 len: 1312 microversion: 2.1 time: 0.086910 Jul 11 11:28:15.290268 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 179/349] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:15 2022] GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e => generated 1312 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:15.305338 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=100 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:28:15.350087 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-28b5e9b7-ccff-43a0-ab89-31629b182147 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:15.357430 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-28b5e9b7-ccff-43a0-ab89-31629b182147 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1250 microversion: 2.1 time: 0.084887 Jul 11 11:28:15.358010 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 171/350] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:15 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1250 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:28:15.534425 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-0bc9b778-5849-4285-a000-4726685a2fd6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:15.534943 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-0bc9b778-5849-4285-a000-4726685a2fd6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:15.541897 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0bc9b778-5849-4285-a000-4726685a2fd6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:15.542393 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0bc9b778-5849-4285-a000-4726685a2fd6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:15.543283 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0bc9b778-5849-4285-a000-4726685a2fd6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:15.543790 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0bc9b778-5849-4285-a000-4726685a2fd6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:15.682114 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-0bc9b778-5849-4285-a000-4726685a2fd6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:15.690184 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-0bc9b778-5849-4285-a000-4726685a2fd6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:15.691716 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-0bc9b778-5849-4285-a000-4726685a2fd6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:15.692866 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-0bc9b778-5849-4285-a000-4726685a2fd6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1739 microversion: 2.20 time: 0.162407 Jul 11 11:28:15.693425 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 180/351] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:28:15 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1739 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:28:15.735542 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-58597488-622b-41cb-8e6c-25c089da4538 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:15.736158 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-58597488-622b-41cb-8e6c-25c089da4538 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] [instance: b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:15.742428 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-58597488-622b-41cb-8e6c-25c089da4538 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:15.742877 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-58597488-622b-41cb-8e6c-25c089da4538 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:15.743670 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-58597488-622b-41cb-8e6c-25c089da4538 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:15.744110 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-58597488-622b-41cb-8e6c-25c089da4538 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:15.808206 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-58597488-622b-41cb-8e6c-25c089da4538 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc29ac59eed483b8c6443c397505adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890e7e79ff744b6b9589f166cd7d8979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:15.815566 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-58597488-622b-41cb-8e6c-25c089da4538 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] 10.222.0.26 "GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0" status: 200 len: 1274 microversion: 2.1 time: 0.083748 Jul 11 11:28:15.816136 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 172/352] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:15 2022] GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0 => generated 1274 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:16.307091 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-c9671872-6e46-4f5e-9239-64d4270ba40f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:16.307722 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-c9671872-6e46-4f5e-9239-64d4270ba40f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:16.314276 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c9671872-6e46-4f5e-9239-64d4270ba40f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:16.314723 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c9671872-6e46-4f5e-9239-64d4270ba40f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:16.315515 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c9671872-6e46-4f5e-9239-64d4270ba40f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:16.315948 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c9671872-6e46-4f5e-9239-64d4270ba40f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:16.374338 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-9ca4d22a-fa4b-454f-9d4a-de5174259b56 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:16.374930 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-9ca4d22a-fa4b-454f-9d4a-de5174259b56 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:16.376202 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-c9671872-6e46-4f5e-9239-64d4270ba40f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:16.381558 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9ca4d22a-fa4b-454f-9d4a-de5174259b56 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:16.382502 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9ca4d22a-fa4b-454f-9d4a-de5174259b56 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:16.383277 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9ca4d22a-fa4b-454f-9d4a-de5174259b56 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:16.383721 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9ca4d22a-fa4b-454f-9d4a-de5174259b56 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:16.384314 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-c9671872-6e46-4f5e-9239-64d4270ba40f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e" status: 200 len: 1312 microversion: 2.1 time: 0.081360 Jul 11 11:28:16.384883 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 181/353] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:16 2022] GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e => generated 1312 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:16.442922 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-9ca4d22a-fa4b-454f-9d4a-de5174259b56 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:16.451183 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-9ca4d22a-fa4b-454f-9d4a-de5174259b56 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1250 microversion: 2.1 time: 0.080595 Jul 11 11:28:16.451915 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 173/354] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:16 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1250 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:28:16.712005 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-1710c2dc-90ea-4dba-a67d-875824017bb9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:16.712614 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-1710c2dc-90ea-4dba-a67d-875824017bb9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:16.718578 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1710c2dc-90ea-4dba-a67d-875824017bb9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:16.719026 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1710c2dc-90ea-4dba-a67d-875824017bb9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:16.720089 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1710c2dc-90ea-4dba-a67d-875824017bb9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:16.720531 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1710c2dc-90ea-4dba-a67d-875824017bb9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:16.832798 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-3f331c21-ba4a-436a-aab9-3bb31abd3691 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:16.833409 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-3f331c21-ba4a-436a-aab9-3bb31abd3691 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] [instance: b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:16.840505 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3f331c21-ba4a-436a-aab9-3bb31abd3691 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:16.840970 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3f331c21-ba4a-436a-aab9-3bb31abd3691 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:16.841737 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3f331c21-ba4a-436a-aab9-3bb31abd3691 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:16.849843 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3f331c21-ba4a-436a-aab9-3bb31abd3691 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:16.865006 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-1710c2dc-90ea-4dba-a67d-875824017bb9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:16.874772 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-1710c2dc-90ea-4dba-a67d-875824017bb9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:16.876306 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-1710c2dc-90ea-4dba-a67d-875824017bb9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:16.877465 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-1710c2dc-90ea-4dba-a67d-875824017bb9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1739 microversion: 2.20 time: 0.169955 Jul 11 11:28:16.879299 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 182/355] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:28:16 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1739 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:28:16.920330 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-3f331c21-ba4a-436a-aab9-3bb31abd3691 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc29ac59eed483b8c6443c397505adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890e7e79ff744b6b9589f166cd7d8979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:16.928401 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-3f331c21-ba4a-436a-aab9-3bb31abd3691 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] 10.222.0.26 "GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0" status: 200 len: 1274 microversion: 2.1 time: 0.099757 Jul 11 11:28:16.929829 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 174/356] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:16 2022] GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0 => generated 1274 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:17.401476 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-a4e24ace-2ea2-4e59-bd73-5eff1289e192 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:17.401990 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-a4e24ace-2ea2-4e59-bd73-5eff1289e192 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:17.403895 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell0:SELECT=2 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:28:17.409125 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a4e24ace-2ea2-4e59-bd73-5eff1289e192 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:17.409568 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a4e24ace-2ea2-4e59-bd73-5eff1289e192 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:17.410324 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a4e24ace-2ea2-4e59-bd73-5eff1289e192 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:17.410755 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a4e24ace-2ea2-4e59-bd73-5eff1289e192 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:17.468585 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-3e991b6b-8e8e-47cb-bf9b-ca1d2bb63fc6 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:17.469265 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-3e991b6b-8e8e-47cb-bf9b-ca1d2bb63fc6 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:17.470039 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-a4e24ace-2ea2-4e59-bd73-5eff1289e192 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:17.476577 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3e991b6b-8e8e-47cb-bf9b-ca1d2bb63fc6 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:17.477103 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3e991b6b-8e8e-47cb-bf9b-ca1d2bb63fc6 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:17.477952 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3e991b6b-8e8e-47cb-bf9b-ca1d2bb63fc6 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:17.478050 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-a4e24ace-2ea2-4e59-bd73-5eff1289e192 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e" status: 200 len: 1312 microversion: 2.1 time: 0.080925 Jul 11 11:28:17.478477 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3e991b6b-8e8e-47cb-bf9b-ca1d2bb63fc6 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:17.478577 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 183/357] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:17 2022] GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e => generated 1312 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:17.542109 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-3e991b6b-8e8e-47cb-bf9b-ca1d2bb63fc6 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:17.550608 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-3e991b6b-8e8e-47cb-bf9b-ca1d2bb63fc6 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1250 microversion: 2.1 time: 0.085932 Jul 11 11:28:17.551225 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 175/358] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:17 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1250 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:28:17.897909 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-87dd60ca-ba8b-408e-9514-6435052357c7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:17.898543 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-87dd60ca-ba8b-408e-9514-6435052357c7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:17.904671 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-87dd60ca-ba8b-408e-9514-6435052357c7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:17.905121 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-87dd60ca-ba8b-408e-9514-6435052357c7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:17.905885 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-87dd60ca-ba8b-408e-9514-6435052357c7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:17.906323 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-87dd60ca-ba8b-408e-9514-6435052357c7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:17.946609 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-50fb2c19-4022-4491-adcd-3ce51983ccfc tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:17.947538 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-50fb2c19-4022-4491-adcd-3ce51983ccfc tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] [instance: b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:17.955004 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-50fb2c19-4022-4491-adcd-3ce51983ccfc tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:17.955458 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-50fb2c19-4022-4491-adcd-3ce51983ccfc tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:17.956958 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-50fb2c19-4022-4491-adcd-3ce51983ccfc tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:17.957551 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-50fb2c19-4022-4491-adcd-3ce51983ccfc tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:18.024888 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-50fb2c19-4022-4491-adcd-3ce51983ccfc tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc29ac59eed483b8c6443c397505adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890e7e79ff744b6b9589f166cd7d8979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:18.033210 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-50fb2c19-4022-4491-adcd-3ce51983ccfc tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] 10.222.0.26 "GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0" status: 200 len: 1274 microversion: 2.1 time: 0.091125 Jul 11 11:28:18.033792 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 176/359] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:17 2022] GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0 => generated 1274 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:18.044658 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-87dd60ca-ba8b-408e-9514-6435052357c7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:18.046871 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=100 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:28:18.053300 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-87dd60ca-ba8b-408e-9514-6435052357c7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:18.055504 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-87dd60ca-ba8b-408e-9514-6435052357c7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:18.056668 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-87dd60ca-ba8b-408e-9514-6435052357c7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1739 microversion: 2.20 time: 0.162709 Jul 11 11:28:18.057225 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 184/360] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:28:17 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1739 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:28:18.495171 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-c7440cad-2445-470c-a781-f757df8139bf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:18.495721 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-c7440cad-2445-470c-a781-f757df8139bf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:18.502575 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c7440cad-2445-470c-a781-f757df8139bf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:18.503016 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c7440cad-2445-470c-a781-f757df8139bf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:18.503876 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c7440cad-2445-470c-a781-f757df8139bf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:18.504300 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c7440cad-2445-470c-a781-f757df8139bf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:18.566275 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-c7440cad-2445-470c-a781-f757df8139bf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:18.570206 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-20119bfb-8e40-4a57-8f36-de9d899de58f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:18.571054 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-20119bfb-8e40-4a57-8f36-de9d899de58f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:18.573710 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-c7440cad-2445-470c-a781-f757df8139bf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e" status: 200 len: 1312 microversion: 2.1 time: 0.082870 Jul 11 11:28:18.574280 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 177/361] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:18 2022] GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e => generated 1312 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:18.578912 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-20119bfb-8e40-4a57-8f36-de9d899de58f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:18.579500 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-20119bfb-8e40-4a57-8f36-de9d899de58f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:18.580367 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-20119bfb-8e40-4a57-8f36-de9d899de58f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:18.581067 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-20119bfb-8e40-4a57-8f36-de9d899de58f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:18.649771 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-20119bfb-8e40-4a57-8f36-de9d899de58f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:18.657085 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-20119bfb-8e40-4a57-8f36-de9d899de58f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1250 microversion: 2.1 time: 0.091299 Jul 11 11:28:18.657659 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 185/362] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:18 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1250 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:28:19.050393 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-ca548749-9ee8-4ab9-aeca-fe8f7c6e9780 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:19.050999 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-ca548749-9ee8-4ab9-aeca-fe8f7c6e9780 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] [instance: b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:19.058180 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ca548749-9ee8-4ab9-aeca-fe8f7c6e9780 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:19.058623 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ca548749-9ee8-4ab9-aeca-fe8f7c6e9780 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:19.059409 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ca548749-9ee8-4ab9-aeca-fe8f7c6e9780 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:19.059924 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ca548749-9ee8-4ab9-aeca-fe8f7c6e9780 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:19.079057 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-28c2376b-40ae-4518-8be8-9743f58045b6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:19.079695 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-28c2376b-40ae-4518-8be8-9743f58045b6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:19.085640 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-28c2376b-40ae-4518-8be8-9743f58045b6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:19.086086 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-28c2376b-40ae-4518-8be8-9743f58045b6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:19.086850 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-28c2376b-40ae-4518-8be8-9743f58045b6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:19.087308 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-28c2376b-40ae-4518-8be8-9743f58045b6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:19.122816 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-ca548749-9ee8-4ab9-aeca-fe8f7c6e9780 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc29ac59eed483b8c6443c397505adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890e7e79ff744b6b9589f166cd7d8979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:19.130505 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-ca548749-9ee8-4ab9-aeca-fe8f7c6e9780 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] 10.222.0.26 "GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0" status: 200 len: 1274 microversion: 2.1 time: 0.084020 Jul 11 11:28:19.131063 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 178/363] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:19 2022] GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0 => generated 1274 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:19.215966 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-28c2376b-40ae-4518-8be8-9743f58045b6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:19.223755 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-28c2376b-40ae-4518-8be8-9743f58045b6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:19.225258 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-28c2376b-40ae-4518-8be8-9743f58045b6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:19.226981 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-28c2376b-40ae-4518-8be8-9743f58045b6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1739 microversion: 2.20 time: 0.152646 Jul 11 11:28:19.227586 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 186/364] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:28:19 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1739 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 11:28:19.592429 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-8a33d981-107a-46f8-a86f-553b3f9702f8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:19.593220 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-8a33d981-107a-46f8-a86f-553b3f9702f8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:19.600638 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8a33d981-107a-46f8-a86f-553b3f9702f8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:19.601762 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8a33d981-107a-46f8-a86f-553b3f9702f8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:19.602723 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8a33d981-107a-46f8-a86f-553b3f9702f8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:19.603184 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8a33d981-107a-46f8-a86f-553b3f9702f8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:19.670196 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-8a33d981-107a-46f8-a86f-553b3f9702f8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:19.673419 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-f8adea84-7064-4066-8264-9fecb41dc635 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:19.674028 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-f8adea84-7064-4066-8264-9fecb41dc635 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:19.677853 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-8a33d981-107a-46f8-a86f-553b3f9702f8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e" status: 200 len: 1312 microversion: 2.1 time: 0.089870 Jul 11 11:28:19.678426 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 179/365] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:19 2022] GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e => generated 1312 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:19.681258 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f8adea84-7064-4066-8264-9fecb41dc635 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:19.681727 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f8adea84-7064-4066-8264-9fecb41dc635 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:19.682497 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f8adea84-7064-4066-8264-9fecb41dc635 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:19.682932 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f8adea84-7064-4066-8264-9fecb41dc635 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:19.742025 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-f8adea84-7064-4066-8264-9fecb41dc635 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:19.749241 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-f8adea84-7064-4066-8264-9fecb41dc635 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1250 microversion: 2.1 time: 0.079592 Jul 11 11:28:19.749806 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 187/366] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:19 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1250 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:28:20.148389 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-e9acd9b3-2dfb-4bbe-8b53-307606502efd tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:20.149020 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-e9acd9b3-2dfb-4bbe-8b53-307606502efd tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] [instance: b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:20.154987 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e9acd9b3-2dfb-4bbe-8b53-307606502efd tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:20.155469 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e9acd9b3-2dfb-4bbe-8b53-307606502efd tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:20.156229 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e9acd9b3-2dfb-4bbe-8b53-307606502efd tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:20.156664 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e9acd9b3-2dfb-4bbe-8b53-307606502efd tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:20.216718 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-e9acd9b3-2dfb-4bbe-8b53-307606502efd tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc29ac59eed483b8c6443c397505adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890e7e79ff744b6b9589f166cd7d8979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:20.223975 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-e9acd9b3-2dfb-4bbe-8b53-307606502efd tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] 10.222.0.26 "GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0" status: 200 len: 1274 microversion: 2.1 time: 0.079990 Jul 11 11:28:20.224541 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 180/367] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:20 2022] GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0 => generated 1274 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:20.245069 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-88032299-2810-4383-8d15-b3de071c8fbf tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:20.245672 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-88032299-2810-4383-8d15-b3de071c8fbf tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:20.251706 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-88032299-2810-4383-8d15-b3de071c8fbf tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:20.252094 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-88032299-2810-4383-8d15-b3de071c8fbf tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:20.252853 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-88032299-2810-4383-8d15-b3de071c8fbf tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:20.253284 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-88032299-2810-4383-8d15-b3de071c8fbf tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:20.381133 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-88032299-2810-4383-8d15-b3de071c8fbf tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:20.388918 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-88032299-2810-4383-8d15-b3de071c8fbf tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:20.390414 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-88032299-2810-4383-8d15-b3de071c8fbf tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:20.391589 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-88032299-2810-4383-8d15-b3de071c8fbf tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1739 microversion: 2.20 time: 0.150357 Jul 11 11:28:20.392142 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 188/368] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:28:20 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1739 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:28:20.697117 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-ea11f1bb-cbee-441f-ba3d-3ed7f1600f8e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:20.697743 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-ea11f1bb-cbee-441f-ba3d-3ed7f1600f8e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:20.699578 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell0:SELECT=4 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:28:20.700679 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell0:SELECT=20 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:28:20.705461 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ea11f1bb-cbee-441f-ba3d-3ed7f1600f8e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:20.705903 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ea11f1bb-cbee-441f-ba3d-3ed7f1600f8e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:20.708600 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ea11f1bb-cbee-441f-ba3d-3ed7f1600f8e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:20.708600 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ea11f1bb-cbee-441f-ba3d-3ed7f1600f8e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:20.765820 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-55b3b37e-0059-4451-8594-2a3022a9d29c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:20.766329 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-55b3b37e-0059-4451-8594-2a3022a9d29c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:20.767811 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-ea11f1bb-cbee-441f-ba3d-3ed7f1600f8e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:20.772985 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-55b3b37e-0059-4451-8594-2a3022a9d29c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:20.773434 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-55b3b37e-0059-4451-8594-2a3022a9d29c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:20.774212 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-55b3b37e-0059-4451-8594-2a3022a9d29c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:20.774647 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-55b3b37e-0059-4451-8594-2a3022a9d29c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:20.776328 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-ea11f1bb-cbee-441f-ba3d-3ed7f1600f8e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e" status: 200 len: 1312 microversion: 2.1 time: 0.083675 Jul 11 11:28:20.776885 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 181/369] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:20 2022] GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e => generated 1312 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:20.834806 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-55b3b37e-0059-4451-8594-2a3022a9d29c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:20.842655 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-55b3b37e-0059-4451-8594-2a3022a9d29c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1250 microversion: 2.1 time: 0.080674 Jul 11 11:28:20.843246 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 189/370] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:20 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1250 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:28:21.243393 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-e212fb85-85f2-47a0-94db-e8d501f898a4 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:21.244091 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-e212fb85-85f2-47a0-94db-e8d501f898a4 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] [instance: b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:21.251058 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e212fb85-85f2-47a0-94db-e8d501f898a4 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:21.251630 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e212fb85-85f2-47a0-94db-e8d501f898a4 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:21.252513 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e212fb85-85f2-47a0-94db-e8d501f898a4 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:21.253043 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e212fb85-85f2-47a0-94db-e8d501f898a4 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:21.322498 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-e212fb85-85f2-47a0-94db-e8d501f898a4 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc29ac59eed483b8c6443c397505adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890e7e79ff744b6b9589f166cd7d8979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:21.330961 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-e212fb85-85f2-47a0-94db-e8d501f898a4 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] 10.222.0.26 "GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0" status: 200 len: 1274 microversion: 2.1 time: 0.092683 Jul 11 11:28:21.331657 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 182/371] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:21 2022] GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0 => generated 1274 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:21.409740 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-7c898f12-8644-4626-a0dd-d31f66108045 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:21.410349 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-7c898f12-8644-4626-a0dd-d31f66108045 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:21.412266 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell0:SELECT=12 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:28:21.417822 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7c898f12-8644-4626-a0dd-d31f66108045 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:21.418291 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7c898f12-8644-4626-a0dd-d31f66108045 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:21.419044 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7c898f12-8644-4626-a0dd-d31f66108045 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:21.419518 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7c898f12-8644-4626-a0dd-d31f66108045 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:21.559404 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-7c898f12-8644-4626-a0dd-d31f66108045 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:21.567562 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-7c898f12-8644-4626-a0dd-d31f66108045 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:21.569076 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-7c898f12-8644-4626-a0dd-d31f66108045 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:21.570299 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-7c898f12-8644-4626-a0dd-d31f66108045 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1739 microversion: 2.20 time: 0.164473 Jul 11 11:28:21.570933 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 190/372] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:28:21 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1739 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:28:21.793573 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-a2aec0f1-976d-4722-88bc-65fd31482ea6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:21.794182 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-a2aec0f1-976d-4722-88bc-65fd31482ea6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:21.800640 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a2aec0f1-976d-4722-88bc-65fd31482ea6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:21.801085 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a2aec0f1-976d-4722-88bc-65fd31482ea6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:21.801844 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a2aec0f1-976d-4722-88bc-65fd31482ea6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:21.802279 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a2aec0f1-976d-4722-88bc-65fd31482ea6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:21.859070 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-74bb8ed5-b01b-4ae7-9022-8531d4d5e005 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:21.859713 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-74bb8ed5-b01b-4ae7-9022-8531d4d5e005 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:21.862862 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-a2aec0f1-976d-4722-88bc-65fd31482ea6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:21.866838 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-74bb8ed5-b01b-4ae7-9022-8531d4d5e005 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:21.867409 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-74bb8ed5-b01b-4ae7-9022-8531d4d5e005 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:21.868182 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-74bb8ed5-b01b-4ae7-9022-8531d4d5e005 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:21.868620 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-74bb8ed5-b01b-4ae7-9022-8531d4d5e005 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:21.870965 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-a2aec0f1-976d-4722-88bc-65fd31482ea6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e" status: 200 len: 1312 microversion: 2.1 time: 0.081278 Jul 11 11:28:21.871571 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 183/373] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:21 2022] GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e => generated 1312 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:21.931045 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-74bb8ed5-b01b-4ae7-9022-8531d4d5e005 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:21.938989 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-74bb8ed5-b01b-4ae7-9022-8531d4d5e005 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1250 microversion: 2.1 time: 0.083457 Jul 11 11:28:21.939239 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 191/374] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:21 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1250 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:22.348292 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-675e6d2a-85d0-41f7-83f9-1474d244ae0b tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:22.348842 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-675e6d2a-85d0-41f7-83f9-1474d244ae0b tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] [instance: b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:22.354857 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-675e6d2a-85d0-41f7-83f9-1474d244ae0b tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:22.355329 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-675e6d2a-85d0-41f7-83f9-1474d244ae0b tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:22.356084 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-675e6d2a-85d0-41f7-83f9-1474d244ae0b tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:22.356516 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-675e6d2a-85d0-41f7-83f9-1474d244ae0b tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:22.416833 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-675e6d2a-85d0-41f7-83f9-1474d244ae0b tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc29ac59eed483b8c6443c397505adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890e7e79ff744b6b9589f166cd7d8979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:22.424094 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-675e6d2a-85d0-41f7-83f9-1474d244ae0b tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] 10.222.0.26 "GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0" status: 200 len: 1274 microversion: 2.1 time: 0.079711 Jul 11 11:28:22.424655 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 184/375] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:22 2022] GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0 => generated 1274 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:22.589144 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-d1356449-b6a3-4c12-8860-aa15d5ee5d5f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:22.589742 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-d1356449-b6a3-4c12-8860-aa15d5ee5d5f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:22.595767 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d1356449-b6a3-4c12-8860-aa15d5ee5d5f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:22.596211 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d1356449-b6a3-4c12-8860-aa15d5ee5d5f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:22.596957 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d1356449-b6a3-4c12-8860-aa15d5ee5d5f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:22.597383 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d1356449-b6a3-4c12-8860-aa15d5ee5d5f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:22.729708 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-d1356449-b6a3-4c12-8860-aa15d5ee5d5f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:22.737594 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-d1356449-b6a3-4c12-8860-aa15d5ee5d5f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:22.739099 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-d1356449-b6a3-4c12-8860-aa15d5ee5d5f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:22.740268 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-d1356449-b6a3-4c12-8860-aa15d5ee5d5f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1739 microversion: 2.20 time: 0.155625 Jul 11 11:28:22.740885 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 192/376] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:28:22 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1739 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:28:22.887673 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-0f2df57e-020a-42ef-af0d-7ab57331a2fb tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:22.888313 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-0f2df57e-020a-42ef-af0d-7ab57331a2fb tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:22.895337 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0f2df57e-020a-42ef-af0d-7ab57331a2fb tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:22.895865 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0f2df57e-020a-42ef-af0d-7ab57331a2fb tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:22.896684 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0f2df57e-020a-42ef-af0d-7ab57331a2fb tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:22.897219 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0f2df57e-020a-42ef-af0d-7ab57331a2fb tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:22.955360 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-4543cfe7-0e46-4826-8eee-fe06f9b54073 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:22.956012 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-4543cfe7-0e46-4826-8eee-fe06f9b54073 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:22.964132 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4543cfe7-0e46-4826-8eee-fe06f9b54073 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:22.964622 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4543cfe7-0e46-4826-8eee-fe06f9b54073 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:22.965602 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4543cfe7-0e46-4826-8eee-fe06f9b54073 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:22.966143 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4543cfe7-0e46-4826-8eee-fe06f9b54073 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:22.994843 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-0f2df57e-020a-42ef-af0d-7ab57331a2fb tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:23.002038 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-0f2df57e-020a-42ef-af0d-7ab57331a2fb tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e" status: 200 len: 1312 microversion: 2.1 time: 0.118189 Jul 11 11:28:23.002594 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 185/377] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:22 2022] GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e => generated 1312 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:23.038539 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-4543cfe7-0e46-4826-8eee-fe06f9b54073 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:23.047192 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-4543cfe7-0e46-4826-8eee-fe06f9b54073 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1250 microversion: 2.1 time: 0.095612 Jul 11 11:28:23.047867 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 193/378] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:22 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1250 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:23.441005 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-5722dc5f-1b7f-48a9-9691-00171c83fdc2 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:23.441616 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-5722dc5f-1b7f-48a9-9691-00171c83fdc2 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] [instance: b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:23.447784 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5722dc5f-1b7f-48a9-9691-00171c83fdc2 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:23.448235 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5722dc5f-1b7f-48a9-9691-00171c83fdc2 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:23.448998 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5722dc5f-1b7f-48a9-9691-00171c83fdc2 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:23.449431 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5722dc5f-1b7f-48a9-9691-00171c83fdc2 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:23.513019 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-5722dc5f-1b7f-48a9-9691-00171c83fdc2 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc29ac59eed483b8c6443c397505adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890e7e79ff744b6b9589f166cd7d8979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:23.520493 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-5722dc5f-1b7f-48a9-9691-00171c83fdc2 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] 10.222.0.26 "GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0" status: 200 len: 1274 microversion: 2.1 time: 0.083460 Jul 11 11:28:23.521057 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 186/379] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:23 2022] GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0 => generated 1274 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:23.759796 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-3308a8a2-e61a-4560-a385-4e9921bdb802 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:23.760579 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-3308a8a2-e61a-4560-a385-4e9921bdb802 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:23.767338 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3308a8a2-e61a-4560-a385-4e9921bdb802 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:23.767901 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3308a8a2-e61a-4560-a385-4e9921bdb802 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:23.768769 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3308a8a2-e61a-4560-a385-4e9921bdb802 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:23.769305 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3308a8a2-e61a-4560-a385-4e9921bdb802 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:23.906229 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-3308a8a2-e61a-4560-a385-4e9921bdb802 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:23.915368 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-3308a8a2-e61a-4560-a385-4e9921bdb802 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:23.916875 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-3308a8a2-e61a-4560-a385-4e9921bdb802 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:23.918031 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-3308a8a2-e61a-4560-a385-4e9921bdb802 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1739 microversion: 2.20 time: 0.163276 Jul 11 11:28:23.918595 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 194/380] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:28:23 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1739 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:28:24.019336 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-4a6b59b7-d6f9-46a6-8876-9fd04a8d0220 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:24.020336 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-4a6b59b7-d6f9-46a6-8876-9fd04a8d0220 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:24.026974 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4a6b59b7-d6f9-46a6-8876-9fd04a8d0220 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:24.029266 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4a6b59b7-d6f9-46a6-8876-9fd04a8d0220 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:24.029266 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4a6b59b7-d6f9-46a6-8876-9fd04a8d0220 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:24.029266 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4a6b59b7-d6f9-46a6-8876-9fd04a8d0220 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:24.065772 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-f315c3da-f591-4af1-9109-5ffc3756fccf tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:24.067138 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-f315c3da-f591-4af1-9109-5ffc3756fccf tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:24.074074 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f315c3da-f591-4af1-9109-5ffc3756fccf tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:24.074549 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f315c3da-f591-4af1-9109-5ffc3756fccf tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:24.075554 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f315c3da-f591-4af1-9109-5ffc3756fccf tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:24.076035 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f315c3da-f591-4af1-9109-5ffc3756fccf tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:24.090714 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-4a6b59b7-d6f9-46a6-8876-9fd04a8d0220 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:24.098420 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-4a6b59b7-d6f9-46a6-8876-9fd04a8d0220 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e" status: 200 len: 1312 microversion: 2.1 time: 0.083009 Jul 11 11:28:24.099049 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 187/381] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:24 2022] GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e => generated 1312 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:24.139316 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-f315c3da-f591-4af1-9109-5ffc3756fccf tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:24.146775 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-f315c3da-f591-4af1-9109-5ffc3756fccf tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1250 microversion: 2.1 time: 0.085927 Jul 11 11:28:24.147415 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 195/382] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:24 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1250 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:24.537618 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-ae35ca78-fbc6-4cf4-9119-aefde3687a7a tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:24.538143 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-ae35ca78-fbc6-4cf4-9119-aefde3687a7a tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] [instance: b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:24.544105 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ae35ca78-fbc6-4cf4-9119-aefde3687a7a tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:24.544545 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ae35ca78-fbc6-4cf4-9119-aefde3687a7a tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:24.545291 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ae35ca78-fbc6-4cf4-9119-aefde3687a7a tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:24.545745 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ae35ca78-fbc6-4cf4-9119-aefde3687a7a tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:24.549612 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=100 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:28:24.605040 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-ae35ca78-fbc6-4cf4-9119-aefde3687a7a tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc29ac59eed483b8c6443c397505adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890e7e79ff744b6b9589f166cd7d8979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:24.613060 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-ae35ca78-fbc6-4cf4-9119-aefde3687a7a tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] 10.222.0.26 "GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0" status: 200 len: 1274 microversion: 2.1 time: 0.079290 Jul 11 11:28:24.613640 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 188/383] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:24 2022] GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0 => generated 1274 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:24.938068 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-e4151b58-ebe9-44e0-8946-d5059798f2bd tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:24.938673 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-e4151b58-ebe9-44e0-8946-d5059798f2bd tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:24.945449 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e4151b58-ebe9-44e0-8946-d5059798f2bd tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:24.945901 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e4151b58-ebe9-44e0-8946-d5059798f2bd tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:24.946669 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e4151b58-ebe9-44e0-8946-d5059798f2bd tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:24.947105 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e4151b58-ebe9-44e0-8946-d5059798f2bd tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:25.078390 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-e4151b58-ebe9-44e0-8946-d5059798f2bd tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:25.086964 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-e4151b58-ebe9-44e0-8946-d5059798f2bd tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:25.088471 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-e4151b58-ebe9-44e0-8946-d5059798f2bd tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:25.089605 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-e4151b58-ebe9-44e0-8946-d5059798f2bd tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1739 microversion: 2.20 time: 0.155496 Jul 11 11:28:25.090166 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 196/384] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:28:24 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1739 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:28:25.114562 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-ac6b78e0-c0af-4f60-b201-c962220358bb tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:25.115189 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-ac6b78e0-c0af-4f60-b201-c962220358bb tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:25.121941 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ac6b78e0-c0af-4f60-b201-c962220358bb tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:25.122406 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ac6b78e0-c0af-4f60-b201-c962220358bb tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:25.123309 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ac6b78e0-c0af-4f60-b201-c962220358bb tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:25.123744 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ac6b78e0-c0af-4f60-b201-c962220358bb tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:25.164337 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-5002f607-df2a-4a1b-a982-06f808d34cc3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:25.164988 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-5002f607-df2a-4a1b-a982-06f808d34cc3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:25.171230 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5002f607-df2a-4a1b-a982-06f808d34cc3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:25.171707 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5002f607-df2a-4a1b-a982-06f808d34cc3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:25.172474 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5002f607-df2a-4a1b-a982-06f808d34cc3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:25.172905 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5002f607-df2a-4a1b-a982-06f808d34cc3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:25.184985 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-ac6b78e0-c0af-4f60-b201-c962220358bb tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:25.192486 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-ac6b78e0-c0af-4f60-b201-c962220358bb tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e" status: 200 len: 1312 microversion: 2.1 time: 0.081888 Jul 11 11:28:25.193058 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 189/385] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:25 2022] GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e => generated 1312 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:25.234962 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-5002f607-df2a-4a1b-a982-06f808d34cc3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:25.242280 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-5002f607-df2a-4a1b-a982-06f808d34cc3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1250 microversion: 2.1 time: 0.082260 Jul 11 11:28:25.242836 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 197/386] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:25 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1250 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:28:25.632608 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-9f8e1791-441c-40eb-be60-19fd424f9402 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:25.633251 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-9f8e1791-441c-40eb-be60-19fd424f9402 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] [instance: b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:25.640676 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9f8e1791-441c-40eb-be60-19fd424f9402 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:25.641127 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9f8e1791-441c-40eb-be60-19fd424f9402 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:25.642028 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9f8e1791-441c-40eb-be60-19fd424f9402 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:25.642514 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9f8e1791-441c-40eb-be60-19fd424f9402 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:25.711236 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-9f8e1791-441c-40eb-be60-19fd424f9402 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc29ac59eed483b8c6443c397505adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890e7e79ff744b6b9589f166cd7d8979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:25.719634 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-9f8e1791-441c-40eb-be60-19fd424f9402 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] 10.222.0.26 "GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0" status: 200 len: 1274 microversion: 2.1 time: 0.093570 Jul 11 11:28:25.720302 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 190/387] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:25 2022] GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0 => generated 1274 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:26.107609 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-b2ff34fe-7bc4-4754-8a19-2348ca0b5b68 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:26.108210 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-b2ff34fe-7bc4-4754-8a19-2348ca0b5b68 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:26.114620 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b2ff34fe-7bc4-4754-8a19-2348ca0b5b68 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:26.115057 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b2ff34fe-7bc4-4754-8a19-2348ca0b5b68 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:26.115844 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b2ff34fe-7bc4-4754-8a19-2348ca0b5b68 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:26.116272 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b2ff34fe-7bc4-4754-8a19-2348ca0b5b68 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:26.208999 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-1895dbb9-e3bf-4b09-9f25-7ade523e0059 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:26.209610 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-1895dbb9-e3bf-4b09-9f25-7ade523e0059 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:26.217100 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1895dbb9-e3bf-4b09-9f25-7ade523e0059 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:26.217646 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1895dbb9-e3bf-4b09-9f25-7ade523e0059 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:26.218418 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1895dbb9-e3bf-4b09-9f25-7ade523e0059 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:26.218851 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1895dbb9-e3bf-4b09-9f25-7ade523e0059 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:26.242789 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-b2ff34fe-7bc4-4754-8a19-2348ca0b5b68 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:26.250708 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-b2ff34fe-7bc4-4754-8a19-2348ca0b5b68 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:26.252260 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-b2ff34fe-7bc4-4754-8a19-2348ca0b5b68 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:26.253592 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-b2ff34fe-7bc4-4754-8a19-2348ca0b5b68 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1739 microversion: 2.20 time: 0.149651 Jul 11 11:28:26.254307 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 198/388] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:28:26 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1739 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:28:26.259410 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-f3deefdb-2d31-4bca-90de-272b0dee73fd tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:26.259951 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-f3deefdb-2d31-4bca-90de-272b0dee73fd tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:26.265990 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f3deefdb-2d31-4bca-90de-272b0dee73fd tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:26.266432 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f3deefdb-2d31-4bca-90de-272b0dee73fd tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:26.267244 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f3deefdb-2d31-4bca-90de-272b0dee73fd tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:26.267701 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f3deefdb-2d31-4bca-90de-272b0dee73fd tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:26.297645 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-1895dbb9-e3bf-4b09-9f25-7ade523e0059 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:26.306828 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-1895dbb9-e3bf-4b09-9f25-7ade523e0059 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e" status: 200 len: 1312 microversion: 2.1 time: 0.101494 Jul 11 11:28:26.307453 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 191/389] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:26 2022] GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e => generated 1312 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:28:26.336209 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-f3deefdb-2d31-4bca-90de-272b0dee73fd tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:26.343910 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-f3deefdb-2d31-4bca-90de-272b0dee73fd tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1250 microversion: 2.1 time: 0.088370 Jul 11 11:28:26.344526 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 199/390] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:26 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1250 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:26.736400 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-88b6f254-6519-422d-84ff-ba47163f002c tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:26.737011 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-88b6f254-6519-422d-84ff-ba47163f002c tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] [instance: b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:26.743633 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-88b6f254-6519-422d-84ff-ba47163f002c tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:26.744080 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-88b6f254-6519-422d-84ff-ba47163f002c tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:26.744875 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-88b6f254-6519-422d-84ff-ba47163f002c tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:26.745315 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-88b6f254-6519-422d-84ff-ba47163f002c tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:26.808830 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-88b6f254-6519-422d-84ff-ba47163f002c tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc29ac59eed483b8c6443c397505adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890e7e79ff744b6b9589f166cd7d8979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:26.816202 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-88b6f254-6519-422d-84ff-ba47163f002c tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] 10.222.0.26 "GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0" status: 200 len: 1274 microversion: 2.1 time: 0.083640 Jul 11 11:28:26.816757 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 192/391] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:26 2022] GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0 => generated 1274 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:27.271537 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-ba52453f-370a-4258-9404-5d50ea653634 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:27.272138 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-ba52453f-370a-4258-9404-5d50ea653634 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:27.279042 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ba52453f-370a-4258-9404-5d50ea653634 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:27.279505 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ba52453f-370a-4258-9404-5d50ea653634 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:27.280255 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ba52453f-370a-4258-9404-5d50ea653634 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:27.280679 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ba52453f-370a-4258-9404-5d50ea653634 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:27.327405 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-ce16cc2f-5767-4c08-8a7d-435c9863bf45 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:27.327941 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-ce16cc2f-5767-4c08-8a7d-435c9863bf45 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:27.334412 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ce16cc2f-5767-4c08-8a7d-435c9863bf45 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:27.334861 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ce16cc2f-5767-4c08-8a7d-435c9863bf45 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:27.336153 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ce16cc2f-5767-4c08-8a7d-435c9863bf45 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:27.336594 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ce16cc2f-5767-4c08-8a7d-435c9863bf45 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:27.402112 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-ce16cc2f-5767-4c08-8a7d-435c9863bf45 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:27.410157 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-ce16cc2f-5767-4c08-8a7d-435c9863bf45 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e" status: 200 len: 1312 microversion: 2.1 time: 0.086812 Jul 11 11:28:27.411003 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 193/392] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:27 2022] GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e => generated 1312 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:28:27.424669 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-9a1fe364-fbb7-4c2a-a141-1351e5bafe33 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:27.425284 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-9a1fe364-fbb7-4c2a-a141-1351e5bafe33 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:27.427927 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-ba52453f-370a-4258-9404-5d50ea653634 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:27.432447 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9a1fe364-fbb7-4c2a-a141-1351e5bafe33 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:27.433273 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9a1fe364-fbb7-4c2a-a141-1351e5bafe33 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:27.433821 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9a1fe364-fbb7-4c2a-a141-1351e5bafe33 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:27.434350 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9a1fe364-fbb7-4c2a-a141-1351e5bafe33 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:27.439296 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-ba52453f-370a-4258-9404-5d50ea653634 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:27.440632 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-ba52453f-370a-4258-9404-5d50ea653634 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:27.442034 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-ba52453f-370a-4258-9404-5d50ea653634 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1739 microversion: 2.20 time: 0.174312 Jul 11 11:28:27.442601 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 200/393] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:28:27 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1739 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:28:27.506110 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-9a1fe364-fbb7-4c2a-a141-1351e5bafe33 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:27.514105 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-9a1fe364-fbb7-4c2a-a141-1351e5bafe33 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1250 microversion: 2.1 time: 0.093431 Jul 11 11:28:27.514664 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 194/394] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:27 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1250 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:27.832134 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-b4c82587-6f41-48a6-87a1-2d6ed68fbd2c tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:27.832737 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-b4c82587-6f41-48a6-87a1-2d6ed68fbd2c tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] [instance: b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:27.838731 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b4c82587-6f41-48a6-87a1-2d6ed68fbd2c tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:27.839178 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b4c82587-6f41-48a6-87a1-2d6ed68fbd2c tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:27.839963 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b4c82587-6f41-48a6-87a1-2d6ed68fbd2c tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:27.840394 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b4c82587-6f41-48a6-87a1-2d6ed68fbd2c tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:27.856863 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=100 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:28:27.902470 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-b4c82587-6f41-48a6-87a1-2d6ed68fbd2c tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc29ac59eed483b8c6443c397505adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890e7e79ff744b6b9589f166cd7d8979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:27.909937 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-b4c82587-6f41-48a6-87a1-2d6ed68fbd2c tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] 10.222.0.26 "GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0" status: 200 len: 1274 microversion: 2.1 time: 0.081795 Jul 11 11:28:27.910498 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 201/395] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:27 2022] GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0 => generated 1274 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:28.427077 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-ff0ab8df-f867-4b6e-85f7-6b98c160cce2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:28.427708 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-ff0ab8df-f867-4b6e-85f7-6b98c160cce2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:28.435139 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ff0ab8df-f867-4b6e-85f7-6b98c160cce2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:28.435617 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ff0ab8df-f867-4b6e-85f7-6b98c160cce2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:28.436381 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ff0ab8df-f867-4b6e-85f7-6b98c160cce2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:28.436813 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ff0ab8df-f867-4b6e-85f7-6b98c160cce2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:28.461284 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-8382fa0f-5266-46d4-9fb9-ccf243f6ad0b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:28.462613 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-8382fa0f-5266-46d4-9fb9-ccf243f6ad0b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:28.474158 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8382fa0f-5266-46d4-9fb9-ccf243f6ad0b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:28.474611 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8382fa0f-5266-46d4-9fb9-ccf243f6ad0b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:28.475407 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8382fa0f-5266-46d4-9fb9-ccf243f6ad0b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:28.476360 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8382fa0f-5266-46d4-9fb9-ccf243f6ad0b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:28.498764 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-ff0ab8df-f867-4b6e-85f7-6b98c160cce2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:28.508061 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-ff0ab8df-f867-4b6e-85f7-6b98c160cce2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e" status: 200 len: 1312 microversion: 2.1 time: 0.084811 Jul 11 11:28:28.508627 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 195/396] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:28 2022] GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e => generated 1312 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:28.530854 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-69e8d55e-ac54-4644-94ab-96c5dccf07ee tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:28.531621 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-69e8d55e-ac54-4644-94ab-96c5dccf07ee tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:28.537710 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-69e8d55e-ac54-4644-94ab-96c5dccf07ee tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:28.538752 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-69e8d55e-ac54-4644-94ab-96c5dccf07ee tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:28.539602 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-69e8d55e-ac54-4644-94ab-96c5dccf07ee tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:28.540131 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-69e8d55e-ac54-4644-94ab-96c5dccf07ee tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:28.600317 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-69e8d55e-ac54-4644-94ab-96c5dccf07ee tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:28.608268 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-69e8d55e-ac54-4644-94ab-96c5dccf07ee tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1250 microversion: 2.1 time: 0.081223 Jul 11 11:28:28.608848 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 196/397] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:28 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1250 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:28:28.614219 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-8382fa0f-5266-46d4-9fb9-ccf243f6ad0b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:28.622176 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-8382fa0f-5266-46d4-9fb9-ccf243f6ad0b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:28.623707 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-8382fa0f-5266-46d4-9fb9-ccf243f6ad0b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:28.624861 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-8382fa0f-5266-46d4-9fb9-ccf243f6ad0b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1739 microversion: 2.20 time: 0.167825 Jul 11 11:28:28.625412 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 202/398] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:28:28 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1739 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 11:28:28.927716 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-adce469c-7d2c-46e0-afce-630afc019b19 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:28.928349 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-adce469c-7d2c-46e0-afce-630afc019b19 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] [instance: b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:28.936269 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-adce469c-7d2c-46e0-afce-630afc019b19 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:28.936499 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-adce469c-7d2c-46e0-afce-630afc019b19 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:28.937274 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-adce469c-7d2c-46e0-afce-630afc019b19 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:28.937930 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-adce469c-7d2c-46e0-afce-630afc019b19 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:29.008560 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-adce469c-7d2c-46e0-afce-630afc019b19 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc29ac59eed483b8c6443c397505adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890e7e79ff744b6b9589f166cd7d8979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:29.016020 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-adce469c-7d2c-46e0-afce-630afc019b19 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] 10.222.0.26 "GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0" status: 200 len: 1274 microversion: 2.1 time: 0.092462 Jul 11 11:28:29.016584 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 197/399] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:28 2022] GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0 => generated 1274 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:29.524573 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-5f8e62c5-128b-4035-abee-661bd09866e5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:29.525179 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-5f8e62c5-128b-4035-abee-661bd09866e5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:29.531536 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5f8e62c5-128b-4035-abee-661bd09866e5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:29.531983 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5f8e62c5-128b-4035-abee-661bd09866e5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:29.532741 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5f8e62c5-128b-4035-abee-661bd09866e5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:29.533191 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5f8e62c5-128b-4035-abee-661bd09866e5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:29.593025 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-5f8e62c5-128b-4035-abee-661bd09866e5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:29.600253 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-5f8e62c5-128b-4035-abee-661bd09866e5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e" status: 200 len: 1312 microversion: 2.1 time: 0.079514 Jul 11 11:28:29.600844 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 203/400] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:29 2022] GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e => generated 1312 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:29.624712 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-28cf25be-3876-4001-a3a6-7d8838fc42ab tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:29.625315 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-28cf25be-3876-4001-a3a6-7d8838fc42ab tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:29.631681 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-28cf25be-3876-4001-a3a6-7d8838fc42ab tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:29.632164 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-28cf25be-3876-4001-a3a6-7d8838fc42ab tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:29.633432 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-28cf25be-3876-4001-a3a6-7d8838fc42ab tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:29.633861 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-28cf25be-3876-4001-a3a6-7d8838fc42ab tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:29.642565 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-b5b9e427-daeb-4a41-8533-ccccedfe9b71 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:29.643167 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-b5b9e427-daeb-4a41-8533-ccccedfe9b71 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:29.649066 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b5b9e427-daeb-4a41-8533-ccccedfe9b71 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:29.649509 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b5b9e427-daeb-4a41-8533-ccccedfe9b71 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:29.650264 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b5b9e427-daeb-4a41-8533-ccccedfe9b71 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:29.650688 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b5b9e427-daeb-4a41-8533-ccccedfe9b71 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:29.701459 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-28cf25be-3876-4001-a3a6-7d8838fc42ab tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:29.709772 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-28cf25be-3876-4001-a3a6-7d8838fc42ab tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1250 microversion: 2.1 time: 0.088787 Jul 11 11:28:29.710384 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 198/401] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:29 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1250 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:29.791818 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-b5b9e427-daeb-4a41-8533-ccccedfe9b71 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:29.799921 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-b5b9e427-daeb-4a41-8533-ccccedfe9b71 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:29.801422 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-b5b9e427-daeb-4a41-8533-ccccedfe9b71 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:29.802559 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-b5b9e427-daeb-4a41-8533-ccccedfe9b71 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1739 microversion: 2.20 time: 0.163765 Jul 11 11:28:29.803115 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 204/402] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:28:29 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1739 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 11:28:30.032842 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-eebcef16-f6ef-4f3f-bfb7-0228d14b2635 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:30.033361 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-eebcef16-f6ef-4f3f-bfb7-0228d14b2635 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] [instance: b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:30.039783 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-eebcef16-f6ef-4f3f-bfb7-0228d14b2635 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:30.040220 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-eebcef16-f6ef-4f3f-bfb7-0228d14b2635 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:30.040961 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-eebcef16-f6ef-4f3f-bfb7-0228d14b2635 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:30.041386 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-eebcef16-f6ef-4f3f-bfb7-0228d14b2635 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:30.102130 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-eebcef16-f6ef-4f3f-bfb7-0228d14b2635 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc29ac59eed483b8c6443c397505adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890e7e79ff744b6b9589f166cd7d8979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:30.110373 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-eebcef16-f6ef-4f3f-bfb7-0228d14b2635 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] 10.222.0.26 "GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0" status: 200 len: 1274 microversion: 2.1 time: 0.081361 Jul 11 11:28:30.110995 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 199/403] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:30 2022] GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0 => generated 1274 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:30.616904 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-c1251e4e-76ca-45fb-ae15-5fc19531e00f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:30.617593 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-c1251e4e-76ca-45fb-ae15-5fc19531e00f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:30.624034 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c1251e4e-76ca-45fb-ae15-5fc19531e00f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:30.624478 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c1251e4e-76ca-45fb-ae15-5fc19531e00f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:30.625231 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c1251e4e-76ca-45fb-ae15-5fc19531e00f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:30.625664 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c1251e4e-76ca-45fb-ae15-5fc19531e00f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:30.684661 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-c1251e4e-76ca-45fb-ae15-5fc19531e00f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:30.692028 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-c1251e4e-76ca-45fb-ae15-5fc19531e00f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e" status: 200 len: 1312 microversion: 2.1 time: 0.078906 Jul 11 11:28:30.692588 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 205/404] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:30 2022] GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e => generated 1312 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:30.725509 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-5cf0a377-466f-4f44-95ab-27bd8e1e6d85 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:30.726708 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-5cf0a377-466f-4f44-95ab-27bd8e1e6d85 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:30.733354 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5cf0a377-466f-4f44-95ab-27bd8e1e6d85 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:30.733801 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5cf0a377-466f-4f44-95ab-27bd8e1e6d85 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:30.734568 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5cf0a377-466f-4f44-95ab-27bd8e1e6d85 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:30.735005 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5cf0a377-466f-4f44-95ab-27bd8e1e6d85 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:30.795125 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-5cf0a377-466f-4f44-95ab-27bd8e1e6d85 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:30.802273 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-5cf0a377-466f-4f44-95ab-27bd8e1e6d85 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1250 microversion: 2.1 time: 0.080552 Jul 11 11:28:30.802823 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 200/405] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:30 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1250 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:30.820891 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-20e924f1-a6d3-4385-a99d-2a8126291c9b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:30.821429 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-20e924f1-a6d3-4385-a99d-2a8126291c9b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:30.827548 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-20e924f1-a6d3-4385-a99d-2a8126291c9b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:30.827993 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-20e924f1-a6d3-4385-a99d-2a8126291c9b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:30.828740 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-20e924f1-a6d3-4385-a99d-2a8126291c9b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:30.829169 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-20e924f1-a6d3-4385-a99d-2a8126291c9b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:30.958110 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-20e924f1-a6d3-4385-a99d-2a8126291c9b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:30.966014 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-20e924f1-a6d3-4385-a99d-2a8126291c9b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:30.969918 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-20e924f1-a6d3-4385-a99d-2a8126291c9b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:30.969918 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-20e924f1-a6d3-4385-a99d-2a8126291c9b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1739 microversion: 2.20 time: 0.152229 Jul 11 11:28:30.969918 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 206/406] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:28:30 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1739 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:28:31.127599 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-0ad46817-6e40-4e22-8c56-bd175c3a0ebf tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:31.128214 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-0ad46817-6e40-4e22-8c56-bd175c3a0ebf tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] [instance: b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:31.130037 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:28:31.135350 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0ad46817-6e40-4e22-8c56-bd175c3a0ebf tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:31.135804 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0ad46817-6e40-4e22-8c56-bd175c3a0ebf tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:31.136566 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0ad46817-6e40-4e22-8c56-bd175c3a0ebf tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:31.137002 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0ad46817-6e40-4e22-8c56-bd175c3a0ebf tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:31.199792 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-0ad46817-6e40-4e22-8c56-bd175c3a0ebf tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc29ac59eed483b8c6443c397505adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890e7e79ff744b6b9589f166cd7d8979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:31.207389 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-0ad46817-6e40-4e22-8c56-bd175c3a0ebf tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] 10.222.0.26 "GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0" status: 200 len: 1274 microversion: 2.1 time: 0.083626 Jul 11 11:28:31.207948 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 201/407] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:31 2022] GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0 => generated 1274 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:31.711456 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-a9a2302f-4c35-4c23-a149-a17ba230295a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:31.712061 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-a9a2302f-4c35-4c23-a149-a17ba230295a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:31.718521 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a9a2302f-4c35-4c23-a149-a17ba230295a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:31.718968 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a9a2302f-4c35-4c23-a149-a17ba230295a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:31.719889 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a9a2302f-4c35-4c23-a149-a17ba230295a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:31.721586 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a9a2302f-4c35-4c23-a149-a17ba230295a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:31.781384 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-a9a2302f-4c35-4c23-a149-a17ba230295a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:31.789201 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-a9a2302f-4c35-4c23-a149-a17ba230295a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e" status: 200 len: 1312 microversion: 2.1 time: 0.081535 Jul 11 11:28:31.789767 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 207/408] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:31 2022] GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e => generated 1312 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:31.818923 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-328bd34d-4c61-41fa-afa3-51d14cdd7265 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:31.819568 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-328bd34d-4c61-41fa-afa3-51d14cdd7265 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:31.825988 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-328bd34d-4c61-41fa-afa3-51d14cdd7265 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:31.826437 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-328bd34d-4c61-41fa-afa3-51d14cdd7265 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:31.827228 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-328bd34d-4c61-41fa-afa3-51d14cdd7265 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:31.827685 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-328bd34d-4c61-41fa-afa3-51d14cdd7265 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:31.889446 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-328bd34d-4c61-41fa-afa3-51d14cdd7265 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:31.896952 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-328bd34d-4c61-41fa-afa3-51d14cdd7265 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1250 microversion: 2.1 time: 0.081897 Jul 11 11:28:31.897542 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 202/409] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:31 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1250 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:31.989751 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-77c3ae82-c817-4f73-8152-7d2ee2620a32 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:31.990353 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-77c3ae82-c817-4f73-8152-7d2ee2620a32 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:31.996888 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-77c3ae82-c817-4f73-8152-7d2ee2620a32 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:31.997331 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-77c3ae82-c817-4f73-8152-7d2ee2620a32 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:31.998082 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-77c3ae82-c817-4f73-8152-7d2ee2620a32 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:31.998511 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-77c3ae82-c817-4f73-8152-7d2ee2620a32 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:32.126845 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-77c3ae82-c817-4f73-8152-7d2ee2620a32 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:32.134747 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-77c3ae82-c817-4f73-8152-7d2ee2620a32 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:32.136339 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-77c3ae82-c817-4f73-8152-7d2ee2620a32 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:32.137520 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-77c3ae82-c817-4f73-8152-7d2ee2620a32 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1739 microversion: 2.20 time: 0.151623 Jul 11 11:28:32.138025 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 208/410] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:28:31 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1739 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:28:32.223947 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-d4a48bcc-7070-4fec-b812-59b7e1abb817 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:32.224571 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-d4a48bcc-7070-4fec-b812-59b7e1abb817 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] [instance: b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:32.230693 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d4a48bcc-7070-4fec-b812-59b7e1abb817 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:32.231197 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d4a48bcc-7070-4fec-b812-59b7e1abb817 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:32.232001 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d4a48bcc-7070-4fec-b812-59b7e1abb817 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:32.232448 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d4a48bcc-7070-4fec-b812-59b7e1abb817 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:32.292202 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-d4a48bcc-7070-4fec-b812-59b7e1abb817 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc29ac59eed483b8c6443c397505adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890e7e79ff744b6b9589f166cd7d8979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:32.299409 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-d4a48bcc-7070-4fec-b812-59b7e1abb817 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] 10.222.0.26 "GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0" status: 200 len: 1274 microversion: 2.1 time: 0.079437 Jul 11 11:28:32.299960 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 203/411] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:32 2022] GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0 => generated 1274 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:32.805911 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-11913212-2728-4c73-ba19-f7d8e4f6c5cc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:32.806508 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-11913212-2728-4c73-ba19-f7d8e4f6c5cc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:32.812881 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-11913212-2728-4c73-ba19-f7d8e4f6c5cc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:32.813318 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-11913212-2728-4c73-ba19-f7d8e4f6c5cc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:32.814066 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-11913212-2728-4c73-ba19-f7d8e4f6c5cc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:32.814488 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-11913212-2728-4c73-ba19-f7d8e4f6c5cc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:32.874032 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-11913212-2728-4c73-ba19-f7d8e4f6c5cc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:32.881309 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-11913212-2728-4c73-ba19-f7d8e4f6c5cc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e" status: 200 len: 1312 microversion: 2.1 time: 0.079457 Jul 11 11:28:32.881865 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 209/412] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:32 2022] GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e => generated 1312 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:32.913865 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-0986b09d-9b01-4001-b6bc-7b0952e4de04 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:32.914419 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-0986b09d-9b01-4001-b6bc-7b0952e4de04 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:32.920878 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0986b09d-9b01-4001-b6bc-7b0952e4de04 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:32.921325 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0986b09d-9b01-4001-b6bc-7b0952e4de04 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:32.922078 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0986b09d-9b01-4001-b6bc-7b0952e4de04 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:32.922509 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0986b09d-9b01-4001-b6bc-7b0952e4de04 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:32.981702 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-0986b09d-9b01-4001-b6bc-7b0952e4de04 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:32.985034 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=100 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:28:32.989170 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-0986b09d-9b01-4001-b6bc-7b0952e4de04 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1250 microversion: 2.1 time: 0.079160 Jul 11 11:28:32.989732 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 204/413] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:32 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1250 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:33.155617 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-c1145422-859e-4da3-8b94-88f4a4b10394 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:33.156257 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-c1145422-859e-4da3-8b94-88f4a4b10394 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:33.162255 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c1145422-859e-4da3-8b94-88f4a4b10394 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:33.162704 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c1145422-859e-4da3-8b94-88f4a4b10394 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:33.163490 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c1145422-859e-4da3-8b94-88f4a4b10394 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:33.163977 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c1145422-859e-4da3-8b94-88f4a4b10394 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:33.291057 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-c1145422-859e-4da3-8b94-88f4a4b10394 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:33.298814 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-c1145422-859e-4da3-8b94-88f4a4b10394 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:33.300339 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-c1145422-859e-4da3-8b94-88f4a4b10394 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:33.301476 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-c1145422-859e-4da3-8b94-88f4a4b10394 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1739 microversion: 2.20 time: 0.149820 Jul 11 11:28:33.302038 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 210/414] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:28:33 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1739 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:28:33.316587 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-b920d9fd-d385-4d05-a331-13d1715196f5 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:33.317234 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-b920d9fd-d385-4d05-a331-13d1715196f5 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] [instance: b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:33.324152 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b920d9fd-d385-4d05-a331-13d1715196f5 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:33.329845 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b920d9fd-d385-4d05-a331-13d1715196f5 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:33.329845 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b920d9fd-d385-4d05-a331-13d1715196f5 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:33.329845 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b920d9fd-d385-4d05-a331-13d1715196f5 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:33.385454 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-b920d9fd-d385-4d05-a331-13d1715196f5 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc29ac59eed483b8c6443c397505adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890e7e79ff744b6b9589f166cd7d8979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:33.396202 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-b920d9fd-d385-4d05-a331-13d1715196f5 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] 10.222.0.26 "GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0" status: 200 len: 1274 microversion: 2.1 time: 0.083370 Jul 11 11:28:33.396772 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 205/415] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:33 2022] GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0 => generated 1274 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:33.898247 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-3cf0c43e-b72f-4782-8e3a-88ff9fca3db2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:33.898885 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-3cf0c43e-b72f-4782-8e3a-88ff9fca3db2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:33.905358 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3cf0c43e-b72f-4782-8e3a-88ff9fca3db2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:33.905806 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3cf0c43e-b72f-4782-8e3a-88ff9fca3db2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:33.906563 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3cf0c43e-b72f-4782-8e3a-88ff9fca3db2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:33.906995 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3cf0c43e-b72f-4782-8e3a-88ff9fca3db2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:33.967748 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-3cf0c43e-b72f-4782-8e3a-88ff9fca3db2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:33.974915 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-3cf0c43e-b72f-4782-8e3a-88ff9fca3db2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e" status: 200 len: 1312 microversion: 2.1 time: 0.081003 Jul 11 11:28:33.975507 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 211/416] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:33 2022] GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e => generated 1312 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:34.007658 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-e15e41dd-7644-402f-a303-fb895d19a322 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:34.008292 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-e15e41dd-7644-402f-a303-fb895d19a322 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:34.014733 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e15e41dd-7644-402f-a303-fb895d19a322 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:34.015178 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e15e41dd-7644-402f-a303-fb895d19a322 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:34.015964 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e15e41dd-7644-402f-a303-fb895d19a322 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:34.016400 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e15e41dd-7644-402f-a303-fb895d19a322 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:34.079436 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-e15e41dd-7644-402f-a303-fb895d19a322 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:34.087532 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-e15e41dd-7644-402f-a303-fb895d19a322 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1250 microversion: 2.1 time: 0.083560 Jul 11 11:28:34.088099 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 206/417] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:34 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1250 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:34.320566 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-e5e2e94b-30c8-4336-b3ef-5284b08aade3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:34.321267 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-e5e2e94b-30c8-4336-b3ef-5284b08aade3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:34.327450 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e5e2e94b-30c8-4336-b3ef-5284b08aade3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:34.331025 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e5e2e94b-30c8-4336-b3ef-5284b08aade3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:34.331025 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e5e2e94b-30c8-4336-b3ef-5284b08aade3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:34.331025 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e5e2e94b-30c8-4336-b3ef-5284b08aade3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:34.412722 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-a07c0589-3bdc-4ab9-b68a-d9db6c2e84ac tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:34.413854 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-a07c0589-3bdc-4ab9-b68a-d9db6c2e84ac tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] [instance: b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:34.419918 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a07c0589-3bdc-4ab9-b68a-d9db6c2e84ac tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:34.420360 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a07c0589-3bdc-4ab9-b68a-d9db6c2e84ac tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:34.421125 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a07c0589-3bdc-4ab9-b68a-d9db6c2e84ac tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:34.421558 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a07c0589-3bdc-4ab9-b68a-d9db6c2e84ac tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:34.463622 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-e5e2e94b-30c8-4336-b3ef-5284b08aade3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:34.471544 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-e5e2e94b-30c8-4336-b3ef-5284b08aade3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:34.472977 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-e5e2e94b-30c8-4336-b3ef-5284b08aade3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:34.474141 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-e5e2e94b-30c8-4336-b3ef-5284b08aade3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1739 microversion: 2.20 time: 0.157691 Jul 11 11:28:34.474694 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 212/418] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:28:34 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1739 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:28:34.483213 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-a07c0589-3bdc-4ab9-b68a-d9db6c2e84ac tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc29ac59eed483b8c6443c397505adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890e7e79ff744b6b9589f166cd7d8979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:34.490676 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-a07c0589-3bdc-4ab9-b68a-d9db6c2e84ac tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] 10.222.0.26 "GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0" status: 200 len: 1274 microversion: 2.1 time: 0.081806 Jul 11 11:28:34.491231 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 207/419] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:34 2022] GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0 => generated 1274 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:28:34.992216 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-844b8a25-3516-4a2e-af01-2eb1fdf1a142 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:34.992827 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-844b8a25-3516-4a2e-af01-2eb1fdf1a142 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:34.995110 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=97 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:28:34.999870 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-844b8a25-3516-4a2e-af01-2eb1fdf1a142 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:35.000317 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-844b8a25-3516-4a2e-af01-2eb1fdf1a142 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:35.001074 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-844b8a25-3516-4a2e-af01-2eb1fdf1a142 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:35.001508 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-844b8a25-3516-4a2e-af01-2eb1fdf1a142 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:35.067520 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-844b8a25-3516-4a2e-af01-2eb1fdf1a142 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:35.075578 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-844b8a25-3516-4a2e-af01-2eb1fdf1a142 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e" status: 200 len: 1312 microversion: 2.1 time: 0.087156 Jul 11 11:28:35.076147 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 213/420] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:34 2022] GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e => generated 1312 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:35.104299 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-3267e9a6-201d-42fd-9a1b-34b0de97d376 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:35.104894 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-3267e9a6-201d-42fd-9a1b-34b0de97d376 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:35.111293 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3267e9a6-201d-42fd-9a1b-34b0de97d376 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:35.111735 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3267e9a6-201d-42fd-9a1b-34b0de97d376 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:35.112479 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3267e9a6-201d-42fd-9a1b-34b0de97d376 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:35.112903 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3267e9a6-201d-42fd-9a1b-34b0de97d376 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:35.171370 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-3267e9a6-201d-42fd-9a1b-34b0de97d376 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:35.178493 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-3267e9a6-201d-42fd-9a1b-34b0de97d376 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1250 microversion: 2.1 time: 0.078550 Jul 11 11:28:35.179103 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 208/421] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:35 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1250 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:35.493706 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-96c9da12-655c-4921-8bb8-5af20c4f2ff3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:35.494309 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-96c9da12-655c-4921-8bb8-5af20c4f2ff3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:35.500323 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-96c9da12-655c-4921-8bb8-5af20c4f2ff3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:35.500769 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-96c9da12-655c-4921-8bb8-5af20c4f2ff3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:35.501534 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-96c9da12-655c-4921-8bb8-5af20c4f2ff3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:35.501951 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-96c9da12-655c-4921-8bb8-5af20c4f2ff3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:35.507721 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-9fb50b19-2372-4b7d-be50-109de2697104 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:35.508454 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-9fb50b19-2372-4b7d-be50-109de2697104 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] [instance: b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:35.514510 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9fb50b19-2372-4b7d-be50-109de2697104 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:35.514959 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9fb50b19-2372-4b7d-be50-109de2697104 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:35.515755 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9fb50b19-2372-4b7d-be50-109de2697104 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:35.516186 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9fb50b19-2372-4b7d-be50-109de2697104 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:35.579968 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-9fb50b19-2372-4b7d-be50-109de2697104 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc29ac59eed483b8c6443c397505adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890e7e79ff744b6b9589f166cd7d8979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:35.587466 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-9fb50b19-2372-4b7d-be50-109de2697104 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] 10.222.0.26 "GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0" status: 200 len: 1274 microversion: 2.1 time: 0.083475 Jul 11 11:28:35.596475 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 209/422] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:35 2022] GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0 => generated 1274 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:28:35.634579 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-96c9da12-655c-4921-8bb8-5af20c4f2ff3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:35.642369 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-96c9da12-655c-4921-8bb8-5af20c4f2ff3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:35.643896 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-96c9da12-655c-4921-8bb8-5af20c4f2ff3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:35.645031 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-96c9da12-655c-4921-8bb8-5af20c4f2ff3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1739 microversion: 2.20 time: 0.155823 Jul 11 11:28:35.645585 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 214/423] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:28:35 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1739 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:28:36.092579 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-87c71e61-c720-471e-ab8d-a740ce633287 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:36.093193 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-87c71e61-c720-471e-ab8d-a740ce633287 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:36.099158 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-87c71e61-c720-471e-ab8d-a740ce633287 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:36.099636 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-87c71e61-c720-471e-ab8d-a740ce633287 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:36.100411 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-87c71e61-c720-471e-ab8d-a740ce633287 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:36.100834 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-87c71e61-c720-471e-ab8d-a740ce633287 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:36.163364 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-87c71e61-c720-471e-ab8d-a740ce633287 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:36.170814 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-87c71e61-c720-471e-ab8d-a740ce633287 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e" status: 200 len: 1312 microversion: 2.1 time: 0.082114 Jul 11 11:28:36.171406 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 210/424] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:36 2022] GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e => generated 1312 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:36.195640 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-87186719-26db-4a10-9d5f-07cb192934f4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:36.196243 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-87186719-26db-4a10-9d5f-07cb192934f4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:36.202625 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-87186719-26db-4a10-9d5f-07cb192934f4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:36.203063 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-87186719-26db-4a10-9d5f-07cb192934f4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:36.203843 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-87186719-26db-4a10-9d5f-07cb192934f4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:36.204277 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-87186719-26db-4a10-9d5f-07cb192934f4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:36.269688 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-87186719-26db-4a10-9d5f-07cb192934f4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:36.271821 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-87186719-26db-4a10-9d5f-07cb192934f4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1250 microversion: 2.1 time: 0.080527 Jul 11 11:28:36.272667 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 215/425] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:36 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1250 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:36.604670 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-60c626e6-49b9-4a58-9442-4f819004b4e7 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:36.605193 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-60c626e6-49b9-4a58-9442-4f819004b4e7 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] [instance: b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:36.611184 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-60c626e6-49b9-4a58-9442-4f819004b4e7 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:36.611656 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-60c626e6-49b9-4a58-9442-4f819004b4e7 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:36.612407 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-60c626e6-49b9-4a58-9442-4f819004b4e7 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:36.612841 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-60c626e6-49b9-4a58-9442-4f819004b4e7 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:36.664169 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-8b9f5533-2c22-46bf-8774-fb0af5c29f28 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:36.664768 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-8b9f5533-2c22-46bf-8774-fb0af5c29f28 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:36.670819 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8b9f5533-2c22-46bf-8774-fb0af5c29f28 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:36.671301 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8b9f5533-2c22-46bf-8774-fb0af5c29f28 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:36.672057 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8b9f5533-2c22-46bf-8774-fb0af5c29f28 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:36.672474 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-60c626e6-49b9-4a58-9442-4f819004b4e7 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc29ac59eed483b8c6443c397505adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890e7e79ff744b6b9589f166cd7d8979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:36.672603 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8b9f5533-2c22-46bf-8774-fb0af5c29f28 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:36.680604 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-60c626e6-49b9-4a58-9442-4f819004b4e7 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] 10.222.0.26 "GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0" status: 200 len: 1274 microversion: 2.1 time: 0.080069 Jul 11 11:28:36.681165 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 211/426] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:36 2022] GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0 => generated 1274 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:36.797568 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-8b9f5533-2c22-46bf-8774-fb0af5c29f28 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:36.806230 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-8b9f5533-2c22-46bf-8774-fb0af5c29f28 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:36.807829 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-8b9f5533-2c22-46bf-8774-fb0af5c29f28 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:36.808972 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-8b9f5533-2c22-46bf-8774-fb0af5c29f28 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1739 microversion: 2.20 time: 0.149240 Jul 11 11:28:36.809536 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 216/427] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:28:36 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1739 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 11:28:37.188372 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-08aa6f56-c204-40c7-8924-6eeaa4106045 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:37.188980 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-08aa6f56-c204-40c7-8924-6eeaa4106045 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:37.195509 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-08aa6f56-c204-40c7-8924-6eeaa4106045 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:37.195956 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-08aa6f56-c204-40c7-8924-6eeaa4106045 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:37.196716 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-08aa6f56-c204-40c7-8924-6eeaa4106045 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:37.197150 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-08aa6f56-c204-40c7-8924-6eeaa4106045 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:37.256845 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-08aa6f56-c204-40c7-8924-6eeaa4106045 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:37.264635 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-08aa6f56-c204-40c7-8924-6eeaa4106045 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e" status: 200 len: 1312 microversion: 2.1 time: 0.080089 Jul 11 11:28:37.265199 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 212/428] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:37 2022] GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e => generated 1312 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:37.288033 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-54faa26d-2b02-4a30-963f-ecb953c2b085 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:37.288659 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-54faa26d-2b02-4a30-963f-ecb953c2b085 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:37.295107 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-54faa26d-2b02-4a30-963f-ecb953c2b085 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:37.295583 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-54faa26d-2b02-4a30-963f-ecb953c2b085 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:37.296366 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-54faa26d-2b02-4a30-963f-ecb953c2b085 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:37.296796 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-54faa26d-2b02-4a30-963f-ecb953c2b085 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:37.356882 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-54faa26d-2b02-4a30-963f-ecb953c2b085 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:37.364055 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-54faa26d-2b02-4a30-963f-ecb953c2b085 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1250 microversion: 2.1 time: 0.079809 Jul 11 11:28:37.364631 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 217/429] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:37 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1250 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:37.697327 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-be2537b9-a497-482c-8c47-17ad57fa77a1 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:37.697941 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-be2537b9-a497-482c-8c47-17ad57fa77a1 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] [instance: b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:37.704093 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-be2537b9-a497-482c-8c47-17ad57fa77a1 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:37.704568 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-be2537b9-a497-482c-8c47-17ad57fa77a1 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:37.705327 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-be2537b9-a497-482c-8c47-17ad57fa77a1 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:37.705762 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-be2537b9-a497-482c-8c47-17ad57fa77a1 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:37.766129 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-be2537b9-a497-482c-8c47-17ad57fa77a1 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc29ac59eed483b8c6443c397505adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890e7e79ff744b6b9589f166cd7d8979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:37.774468 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-be2537b9-a497-482c-8c47-17ad57fa77a1 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] 10.222.0.26 "GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0" status: 200 len: 1274 microversion: 2.1 time: 0.081543 Jul 11 11:28:37.775032 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 213/430] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:37 2022] GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0 => generated 1274 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:37.826903 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-f651ee78-eb52-49cb-ad3f-65efc0b5d922 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:37.827510 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-f651ee78-eb52-49cb-ad3f-65efc0b5d922 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:37.833418 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f651ee78-eb52-49cb-ad3f-65efc0b5d922 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:37.833852 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f651ee78-eb52-49cb-ad3f-65efc0b5d922 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:37.834596 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f651ee78-eb52-49cb-ad3f-65efc0b5d922 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:37.835020 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f651ee78-eb52-49cb-ad3f-65efc0b5d922 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:37.838860 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=100 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:28:37.963804 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-f651ee78-eb52-49cb-ad3f-65efc0b5d922 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:37.971612 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-f651ee78-eb52-49cb-ad3f-65efc0b5d922 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:37.973177 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-f651ee78-eb52-49cb-ad3f-65efc0b5d922 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:37.974305 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-f651ee78-eb52-49cb-ad3f-65efc0b5d922 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1739 microversion: 2.20 time: 0.151305 Jul 11 11:28:37.974847 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 218/431] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:28:37 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1739 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:28:38.282136 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-a274c9d9-b0b3-42b4-a696-4b734ebd051d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:38.282742 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-a274c9d9-b0b3-42b4-a696-4b734ebd051d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:38.289670 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a274c9d9-b0b3-42b4-a696-4b734ebd051d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:38.290114 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a274c9d9-b0b3-42b4-a696-4b734ebd051d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:38.290863 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a274c9d9-b0b3-42b4-a696-4b734ebd051d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:38.291322 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a274c9d9-b0b3-42b4-a696-4b734ebd051d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:38.357087 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-a274c9d9-b0b3-42b4-a696-4b734ebd051d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:38.362910 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-a274c9d9-b0b3-42b4-a696-4b734ebd051d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e" status: 200 len: 1312 microversion: 2.1 time: 0.084706 Jul 11 11:28:38.363505 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 214/432] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:38 2022] GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e => generated 1312 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:28:38.380977 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-012c683e-1085-4919-b202-f51a3e0520c2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:38.381726 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-012c683e-1085-4919-b202-f51a3e0520c2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:38.388069 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-012c683e-1085-4919-b202-f51a3e0520c2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:38.388510 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-012c683e-1085-4919-b202-f51a3e0520c2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:38.389254 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-012c683e-1085-4919-b202-f51a3e0520c2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:38.389684 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-012c683e-1085-4919-b202-f51a3e0520c2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:38.448205 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-012c683e-1085-4919-b202-f51a3e0520c2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:38.455343 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-012c683e-1085-4919-b202-f51a3e0520c2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1250 microversion: 2.1 time: 0.078109 Jul 11 11:28:38.455896 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 219/433] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:38 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1250 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:38.791152 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-fc55b034-e53d-4a49-996e-9dc7e1f7d5d9 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:38.791898 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-fc55b034-e53d-4a49-996e-9dc7e1f7d5d9 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] [instance: b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:38.797943 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fc55b034-e53d-4a49-996e-9dc7e1f7d5d9 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:38.798390 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fc55b034-e53d-4a49-996e-9dc7e1f7d5d9 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:38.799148 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fc55b034-e53d-4a49-996e-9dc7e1f7d5d9 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:38.799608 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fc55b034-e53d-4a49-996e-9dc7e1f7d5d9 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:38.859954 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-fc55b034-e53d-4a49-996e-9dc7e1f7d5d9 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc29ac59eed483b8c6443c397505adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890e7e79ff744b6b9589f166cd7d8979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:38.867287 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-fc55b034-e53d-4a49-996e-9dc7e1f7d5d9 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] 10.222.0.26 "GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0" status: 200 len: 1274 microversion: 2.1 time: 0.079978 Jul 11 11:28:38.868077 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 215/434] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:38 2022] GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0 => generated 1274 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:38.992180 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-0a067d44-b458-4b9a-acf5-8704856551e0 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:38.992784 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-0a067d44-b458-4b9a-acf5-8704856551e0 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:38.999391 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0a067d44-b458-4b9a-acf5-8704856551e0 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:38.999835 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0a067d44-b458-4b9a-acf5-8704856551e0 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:39.000689 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0a067d44-b458-4b9a-acf5-8704856551e0 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:39.000999 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0a067d44-b458-4b9a-acf5-8704856551e0 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:39.154035 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-0a067d44-b458-4b9a-acf5-8704856551e0 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:39.161994 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-0a067d44-b458-4b9a-acf5-8704856551e0 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:39.163685 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-0a067d44-b458-4b9a-acf5-8704856551e0 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:39.164829 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-0a067d44-b458-4b9a-acf5-8704856551e0 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1739 microversion: 2.20 time: 0.176635 Jul 11 11:28:39.165387 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 220/435] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:28:38 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1739 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:28:39.380287 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-71203111-8f8a-4e5a-af0d-79ae73df00e4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:39.380890 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-71203111-8f8a-4e5a-af0d-79ae73df00e4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:39.387371 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-71203111-8f8a-4e5a-af0d-79ae73df00e4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:39.387815 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-71203111-8f8a-4e5a-af0d-79ae73df00e4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:39.388568 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-71203111-8f8a-4e5a-af0d-79ae73df00e4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:39.388992 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-71203111-8f8a-4e5a-af0d-79ae73df00e4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:39.458864 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-71203111-8f8a-4e5a-af0d-79ae73df00e4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:39.466163 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-71203111-8f8a-4e5a-af0d-79ae73df00e4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e" status: 200 len: 1312 microversion: 2.1 time: 0.089570 Jul 11 11:28:39.466727 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 216/436] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:39 2022] GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e => generated 1312 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:28:39.472318 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-d73c3c7c-969a-4afe-9c2f-76b0adc65fde tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:39.473050 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-d73c3c7c-969a-4afe-9c2f-76b0adc65fde tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:39.479528 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d73c3c7c-969a-4afe-9c2f-76b0adc65fde tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:39.479975 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d73c3c7c-969a-4afe-9c2f-76b0adc65fde tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:39.480731 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d73c3c7c-969a-4afe-9c2f-76b0adc65fde tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:39.481161 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d73c3c7c-969a-4afe-9c2f-76b0adc65fde tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:39.541109 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-d73c3c7c-969a-4afe-9c2f-76b0adc65fde tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:39.548382 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-d73c3c7c-969a-4afe-9c2f-76b0adc65fde tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1250 microversion: 2.1 time: 0.079808 Jul 11 11:28:39.548949 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 221/437] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:39 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1250 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:39.883284 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-f56ac11d-22a4-4d78-a6ef-51f470e3033b tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:39.883923 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-f56ac11d-22a4-4d78-a6ef-51f470e3033b tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] [instance: b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:39.889930 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f56ac11d-22a4-4d78-a6ef-51f470e3033b tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:39.890377 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f56ac11d-22a4-4d78-a6ef-51f470e3033b tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:39.891136 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f56ac11d-22a4-4d78-a6ef-51f470e3033b tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:39.891633 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f56ac11d-22a4-4d78-a6ef-51f470e3033b tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:39.953115 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-f56ac11d-22a4-4d78-a6ef-51f470e3033b tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc29ac59eed483b8c6443c397505adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890e7e79ff744b6b9589f166cd7d8979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:39.960421 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-f56ac11d-22a4-4d78-a6ef-51f470e3033b tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] 10.222.0.26 "GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0" status: 200 len: 1274 microversion: 2.1 time: 0.080998 Jul 11 11:28:39.960974 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 217/438] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:39 2022] GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0 => generated 1274 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:40.183528 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-e626aa01-afd4-4cbf-81c6-60526a6cf8b8 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:40.184135 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-e626aa01-afd4-4cbf-81c6-60526a6cf8b8 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:40.190144 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e626aa01-afd4-4cbf-81c6-60526a6cf8b8 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:40.190588 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e626aa01-afd4-4cbf-81c6-60526a6cf8b8 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:40.191378 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e626aa01-afd4-4cbf-81c6-60526a6cf8b8 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:40.191809 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e626aa01-afd4-4cbf-81c6-60526a6cf8b8 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:40.318301 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-e626aa01-afd4-4cbf-81c6-60526a6cf8b8 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:40.326341 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-e626aa01-afd4-4cbf-81c6-60526a6cf8b8 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:40.327885 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-e626aa01-afd4-4cbf-81c6-60526a6cf8b8 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:40.329027 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-e626aa01-afd4-4cbf-81c6-60526a6cf8b8 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1739 microversion: 2.20 time: 0.150214 Jul 11 11:28:40.329579 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 222/439] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:28:40 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1739 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:28:40.482848 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-b04ed4db-8cae-4623-b396-d6db5d756f44 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:40.483489 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-b04ed4db-8cae-4623-b396-d6db5d756f44 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:40.489971 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b04ed4db-8cae-4623-b396-d6db5d756f44 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:40.490422 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b04ed4db-8cae-4623-b396-d6db5d756f44 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:40.491179 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b04ed4db-8cae-4623-b396-d6db5d756f44 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:40.492392 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b04ed4db-8cae-4623-b396-d6db5d756f44 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:40.555468 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-b04ed4db-8cae-4623-b396-d6db5d756f44 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:40.563092 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-b04ed4db-8cae-4623-b396-d6db5d756f44 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e" status: 200 len: 1312 microversion: 2.1 time: 0.084042 Jul 11 11:28:40.563691 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 218/440] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:40 2022] GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e => generated 1312 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:40.565911 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-96e89460-bf27-4301-bb12-5bc63617c8af tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:40.566517 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-96e89460-bf27-4301-bb12-5bc63617c8af tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:40.572937 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-96e89460-bf27-4301-bb12-5bc63617c8af tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:40.573376 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-96e89460-bf27-4301-bb12-5bc63617c8af tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:40.574128 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-96e89460-bf27-4301-bb12-5bc63617c8af tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:40.574581 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-96e89460-bf27-4301-bb12-5bc63617c8af tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:40.634525 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-96e89460-bf27-4301-bb12-5bc63617c8af tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:40.641888 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-96e89460-bf27-4301-bb12-5bc63617c8af tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1250 microversion: 2.1 time: 0.079860 Jul 11 11:28:40.642446 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 223/441] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:40 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1250 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:28:40.977364 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-265e3faa-6104-45de-9bfb-32d0278ef980 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:40.977963 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-265e3faa-6104-45de-9bfb-32d0278ef980 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] [instance: b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:40.984172 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-265e3faa-6104-45de-9bfb-32d0278ef980 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:40.984611 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-265e3faa-6104-45de-9bfb-32d0278ef980 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:40.985358 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-265e3faa-6104-45de-9bfb-32d0278ef980 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:40.985785 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-265e3faa-6104-45de-9bfb-32d0278ef980 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:41.050512 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-265e3faa-6104-45de-9bfb-32d0278ef980 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc29ac59eed483b8c6443c397505adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890e7e79ff744b6b9589f166cd7d8979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:41.059472 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-265e3faa-6104-45de-9bfb-32d0278ef980 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] 10.222.0.26 "GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0" status: 200 len: 1274 microversion: 2.1 time: 0.086349 Jul 11 11:28:41.061455 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 219/442] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:40 2022] GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0 => generated 1274 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:28:41.347128 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-d0d025c7-3bbb-4ee4-98a3-db675a159b6d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:41.347683 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-d0d025c7-3bbb-4ee4-98a3-db675a159b6d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:41.353683 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d0d025c7-3bbb-4ee4-98a3-db675a159b6d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:41.354124 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d0d025c7-3bbb-4ee4-98a3-db675a159b6d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:41.354876 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d0d025c7-3bbb-4ee4-98a3-db675a159b6d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:41.355335 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d0d025c7-3bbb-4ee4-98a3-db675a159b6d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:41.488535 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-d0d025c7-3bbb-4ee4-98a3-db675a159b6d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:41.496595 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-d0d025c7-3bbb-4ee4-98a3-db675a159b6d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:41.498102 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-d0d025c7-3bbb-4ee4-98a3-db675a159b6d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:41.499261 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-d0d025c7-3bbb-4ee4-98a3-db675a159b6d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1739 microversion: 2.20 time: 0.156019 Jul 11 11:28:41.499828 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 224/443] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:28:41 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1739 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:28:41.579909 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-63aa971f-da7f-417d-91f3-4d6a8f7e9229 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:41.580516 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-63aa971f-da7f-417d-91f3-4d6a8f7e9229 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:41.587491 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-63aa971f-da7f-417d-91f3-4d6a8f7e9229 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:41.587938 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-63aa971f-da7f-417d-91f3-4d6a8f7e9229 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:41.588693 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-63aa971f-da7f-417d-91f3-4d6a8f7e9229 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:41.589126 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-63aa971f-da7f-417d-91f3-4d6a8f7e9229 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:41.649351 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-63aa971f-da7f-417d-91f3-4d6a8f7e9229 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:41.656801 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-63aa971f-da7f-417d-91f3-4d6a8f7e9229 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e" status: 200 len: 1312 microversion: 2.1 time: 0.080662 Jul 11 11:28:41.657374 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 220/444] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:41 2022] GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e => generated 1312 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:41.657903 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-9f4a71a8-585e-4fdb-992c-0604d1b54368 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:41.658604 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-9f4a71a8-585e-4fdb-992c-0604d1b54368 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:41.665559 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9f4a71a8-585e-4fdb-992c-0604d1b54368 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:41.665999 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9f4a71a8-585e-4fdb-992c-0604d1b54368 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:41.666757 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9f4a71a8-585e-4fdb-992c-0604d1b54368 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:41.667188 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9f4a71a8-585e-4fdb-992c-0604d1b54368 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:41.725792 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-9f4a71a8-585e-4fdb-992c-0604d1b54368 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:41.733434 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-9f4a71a8-585e-4fdb-992c-0604d1b54368 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1250 microversion: 2.1 time: 0.079298 Jul 11 11:28:41.733995 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 225/445] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:41 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1250 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:28:42.079761 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-fe038f09-09b9-4bb7-9754-72757ef3c322 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:42.080367 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-fe038f09-09b9-4bb7-9754-72757ef3c322 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] [instance: b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:42.086649 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fe038f09-09b9-4bb7-9754-72757ef3c322 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:42.087088 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fe038f09-09b9-4bb7-9754-72757ef3c322 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:42.087941 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fe038f09-09b9-4bb7-9754-72757ef3c322 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:42.088389 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fe038f09-09b9-4bb7-9754-72757ef3c322 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:42.110153 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=100 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:28:42.153776 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-fe038f09-09b9-4bb7-9754-72757ef3c322 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc29ac59eed483b8c6443c397505adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890e7e79ff744b6b9589f166cd7d8979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:42.161518 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-fe038f09-09b9-4bb7-9754-72757ef3c322 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] 10.222.0.26 "GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0" status: 200 len: 1274 microversion: 2.1 time: 0.086862 Jul 11 11:28:42.162173 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 221/446] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:42 2022] GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0 => generated 1274 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:42.519280 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-17013f4e-7a3e-4dd6-ae1b-d6fc306f5437 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:42.519897 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-17013f4e-7a3e-4dd6-ae1b-d6fc306f5437 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:42.526460 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-17013f4e-7a3e-4dd6-ae1b-d6fc306f5437 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:42.526910 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-17013f4e-7a3e-4dd6-ae1b-d6fc306f5437 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:42.527699 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-17013f4e-7a3e-4dd6-ae1b-d6fc306f5437 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:42.528140 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-17013f4e-7a3e-4dd6-ae1b-d6fc306f5437 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:42.657716 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-17013f4e-7a3e-4dd6-ae1b-d6fc306f5437 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:42.665672 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-17013f4e-7a3e-4dd6-ae1b-d6fc306f5437 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:42.667176 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-17013f4e-7a3e-4dd6-ae1b-d6fc306f5437 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:42.668363 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-17013f4e-7a3e-4dd6-ae1b-d6fc306f5437 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1739 microversion: 2.20 time: 0.153056 Jul 11 11:28:42.669028 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 226/447] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:28:42 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1739 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:28:42.674040 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-4d450c34-915f-4a3b-b710-55b31cb7e85b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:42.675441 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-4d450c34-915f-4a3b-b710-55b31cb7e85b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:42.682117 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4d450c34-915f-4a3b-b710-55b31cb7e85b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:42.682562 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4d450c34-915f-4a3b-b710-55b31cb7e85b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:42.683369 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4d450c34-915f-4a3b-b710-55b31cb7e85b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:42.683805 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4d450c34-915f-4a3b-b710-55b31cb7e85b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:42.745875 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-4d450c34-915f-4a3b-b710-55b31cb7e85b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:42.749729 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-2e05c096-9c26-4a8f-afb9-f4a8be8aec09 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:42.750340 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-2e05c096-9c26-4a8f-afb9-f4a8be8aec09 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:42.753197 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-4d450c34-915f-4a3b-b710-55b31cb7e85b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e" status: 200 len: 1312 microversion: 2.1 time: 0.083068 Jul 11 11:28:42.753754 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 222/448] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:42 2022] GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e => generated 1312 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:42.756476 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2e05c096-9c26-4a8f-afb9-f4a8be8aec09 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:42.756929 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2e05c096-9c26-4a8f-afb9-f4a8be8aec09 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:42.758296 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2e05c096-9c26-4a8f-afb9-f4a8be8aec09 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:42.758730 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2e05c096-9c26-4a8f-afb9-f4a8be8aec09 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:42.817155 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-2e05c096-9c26-4a8f-afb9-f4a8be8aec09 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:42.825007 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-2e05c096-9c26-4a8f-afb9-f4a8be8aec09 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1250 microversion: 2.1 time: 0.079062 Jul 11 11:28:42.825569 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 227/449] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:42 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1250 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:28:43.178766 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-f84b9582-8d51-4c7e-bf0e-3b3076ab6677 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:43.179886 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-f84b9582-8d51-4c7e-bf0e-3b3076ab6677 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] [instance: b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:43.186167 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f84b9582-8d51-4c7e-bf0e-3b3076ab6677 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:43.186620 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f84b9582-8d51-4c7e-bf0e-3b3076ab6677 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:43.187408 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f84b9582-8d51-4c7e-bf0e-3b3076ab6677 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:43.187838 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f84b9582-8d51-4c7e-bf0e-3b3076ab6677 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:43.249993 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-f84b9582-8d51-4c7e-bf0e-3b3076ab6677 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc29ac59eed483b8c6443c397505adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890e7e79ff744b6b9589f166cd7d8979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:43.258184 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-f84b9582-8d51-4c7e-bf0e-3b3076ab6677 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] 10.222.0.26 "GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0" status: 200 len: 1274 microversion: 2.1 time: 0.082744 Jul 11 11:28:43.258743 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 223/450] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:43 2022] GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0 => generated 1274 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:43.686619 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-a65bf125-f3c4-4ee8-bef1-45da52cea9e1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:43.687225 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-a65bf125-f3c4-4ee8-bef1-45da52cea9e1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:43.693781 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a65bf125-f3c4-4ee8-bef1-45da52cea9e1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:43.694224 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a65bf125-f3c4-4ee8-bef1-45da52cea9e1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:43.694979 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a65bf125-f3c4-4ee8-bef1-45da52cea9e1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:43.695451 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a65bf125-f3c4-4ee8-bef1-45da52cea9e1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:43.769888 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-d1e5ebdc-53c2-4ce7-8ced-b76c215d3c2c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:43.770445 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-d1e5ebdc-53c2-4ce7-8ced-b76c215d3c2c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:43.777390 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d1e5ebdc-53c2-4ce7-8ced-b76c215d3c2c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:43.777830 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d1e5ebdc-53c2-4ce7-8ced-b76c215d3c2c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:43.778581 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d1e5ebdc-53c2-4ce7-8ced-b76c215d3c2c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:43.779007 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d1e5ebdc-53c2-4ce7-8ced-b76c215d3c2c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:43.825722 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-a65bf125-f3c4-4ee8-bef1-45da52cea9e1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:43.837217 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-a65bf125-f3c4-4ee8-bef1-45da52cea9e1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:43.837217 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-a65bf125-f3c4-4ee8-bef1-45da52cea9e1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:43.837217 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-a65bf125-f3c4-4ee8-bef1-45da52cea9e1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1739 microversion: 2.20 time: 0.154057 Jul 11 11:28:43.837632 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 228/451] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:28:43 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1739 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:28:43.841733 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-d1e5ebdc-53c2-4ce7-8ced-b76c215d3c2c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:43.842095 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-11f7412f-093e-4c67-8a50-0d21dfa9ffa4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:43.842766 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-11f7412f-093e-4c67-8a50-0d21dfa9ffa4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:43.848799 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-11f7412f-093e-4c67-8a50-0d21dfa9ffa4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:43.849191 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-d1e5ebdc-53c2-4ce7-8ced-b76c215d3c2c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e" status: 200 len: 1312 microversion: 2.1 time: 0.083202 Jul 11 11:28:43.849372 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-11f7412f-093e-4c67-8a50-0d21dfa9ffa4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:43.849748 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 224/452] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:43 2022] GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e => generated 1312 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:28:43.850266 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-11f7412f-093e-4c67-8a50-0d21dfa9ffa4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:43.850764 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-11f7412f-093e-4c67-8a50-0d21dfa9ffa4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:43.909673 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-11f7412f-093e-4c67-8a50-0d21dfa9ffa4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:43.917649 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-11f7412f-093e-4c67-8a50-0d21dfa9ffa4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1250 microversion: 2.1 time: 0.079067 Jul 11 11:28:43.918210 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 229/453] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:43 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1250 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:44.274998 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-5de8b905-7097-4318-b58d-ba45526a9aa9 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:44.275623 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-5de8b905-7097-4318-b58d-ba45526a9aa9 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] [instance: b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:44.281479 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5de8b905-7097-4318-b58d-ba45526a9aa9 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:44.281919 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5de8b905-7097-4318-b58d-ba45526a9aa9 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:44.282667 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5de8b905-7097-4318-b58d-ba45526a9aa9 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:44.283091 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5de8b905-7097-4318-b58d-ba45526a9aa9 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:44.343462 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-5de8b905-7097-4318-b58d-ba45526a9aa9 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc29ac59eed483b8c6443c397505adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890e7e79ff744b6b9589f166cd7d8979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:44.350606 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-5de8b905-7097-4318-b58d-ba45526a9aa9 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] 10.222.0.26 "GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0" status: 200 len: 1274 microversion: 2.1 time: 0.080107 Jul 11 11:28:44.351164 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 225/454] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:44 2022] GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0 => generated 1274 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:44.855864 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-a47c053f-71f3-431a-931d-e907535e0fde tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:44.856451 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-a47c053f-71f3-431a-931d-e907535e0fde tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:44.862999 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a47c053f-71f3-431a-931d-e907535e0fde tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:44.863481 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a47c053f-71f3-431a-931d-e907535e0fde tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:44.864244 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a47c053f-71f3-431a-931d-e907535e0fde tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:44.864672 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a47c053f-71f3-431a-931d-e907535e0fde tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:44.865632 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-5ec27edf-4fb1-44a4-a38c-a3ba4c81f03a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:44.866280 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-5ec27edf-4fb1-44a4-a38c-a3ba4c81f03a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:44.873340 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5ec27edf-4fb1-44a4-a38c-a3ba4c81f03a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:44.873782 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5ec27edf-4fb1-44a4-a38c-a3ba4c81f03a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:44.874540 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5ec27edf-4fb1-44a4-a38c-a3ba4c81f03a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:44.874967 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5ec27edf-4fb1-44a4-a38c-a3ba4c81f03a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:44.939305 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-5ec27edf-4fb1-44a4-a38c-a3ba4c81f03a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:44.946564 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-5ec27edf-4fb1-44a4-a38c-a3ba4c81f03a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e" status: 200 len: 1312 microversion: 2.1 time: 0.084654 Jul 11 11:28:44.947137 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 226/455] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:44 2022] GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e => generated 1312 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:28:44.951618 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-79e7d790-f1ed-438e-9be5-7506696bf0a2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:44.952216 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-79e7d790-f1ed-438e-9be5-7506696bf0a2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:44.958033 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-79e7d790-f1ed-438e-9be5-7506696bf0a2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:44.958486 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-79e7d790-f1ed-438e-9be5-7506696bf0a2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:44.959246 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-79e7d790-f1ed-438e-9be5-7506696bf0a2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:44.959702 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-79e7d790-f1ed-438e-9be5-7506696bf0a2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:44.997079 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-a47c053f-71f3-431a-931d-e907535e0fde tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:45.004965 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-a47c053f-71f3-431a-931d-e907535e0fde tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:45.006463 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-a47c053f-71f3-431a-931d-e907535e0fde tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:45.007643 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-a47c053f-71f3-431a-931d-e907535e0fde tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1739 microversion: 2.20 time: 0.155665 Jul 11 11:28:45.008198 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 230/456] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:28:44 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1739 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:28:45.019230 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-79e7d790-f1ed-438e-9be5-7506696bf0a2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:45.026715 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-79e7d790-f1ed-438e-9be5-7506696bf0a2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1250 microversion: 2.1 time: 0.078628 Jul 11 11:28:45.027283 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 227/457] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:44 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1250 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:45.366919 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-f6e2645d-d291-4a81-9cbc-3a8eb617a40f tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:45.367561 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-f6e2645d-d291-4a81-9cbc-3a8eb617a40f tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] [instance: b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:45.373521 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f6e2645d-d291-4a81-9cbc-3a8eb617a40f tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:45.373969 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f6e2645d-d291-4a81-9cbc-3a8eb617a40f tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:45.374732 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f6e2645d-d291-4a81-9cbc-3a8eb617a40f tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:45.375170 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f6e2645d-d291-4a81-9cbc-3a8eb617a40f tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:45.435033 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-f6e2645d-d291-4a81-9cbc-3a8eb617a40f tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc29ac59eed483b8c6443c397505adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890e7e79ff744b6b9589f166cd7d8979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:45.442536 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-f6e2645d-d291-4a81-9cbc-3a8eb617a40f tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] 10.222.0.26 "GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0" status: 200 len: 1274 microversion: 2.1 time: 0.079345 Jul 11 11:28:45.443110 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 231/458] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:45 2022] GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0 => generated 1274 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:45.963345 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-9032f044-c758-4852-b4fa-3f08288e90bb tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:45.963881 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-9032f044-c758-4852-b4fa-3f08288e90bb tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:45.970319 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9032f044-c758-4852-b4fa-3f08288e90bb tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:45.970768 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9032f044-c758-4852-b4fa-3f08288e90bb tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:45.971606 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9032f044-c758-4852-b4fa-3f08288e90bb tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:45.972079 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9032f044-c758-4852-b4fa-3f08288e90bb tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:46.026353 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-2bd63534-12bb-40e9-8baa-308435c4ad5b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:46.026965 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-2bd63534-12bb-40e9-8baa-308435c4ad5b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:46.033066 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-9032f044-c758-4852-b4fa-3f08288e90bb tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:46.033547 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2bd63534-12bb-40e9-8baa-308435c4ad5b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:46.033999 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2bd63534-12bb-40e9-8baa-308435c4ad5b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:46.034768 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2bd63534-12bb-40e9-8baa-308435c4ad5b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:46.035417 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2bd63534-12bb-40e9-8baa-308435c4ad5b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:46.040565 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-9032f044-c758-4852-b4fa-3f08288e90bb tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e" status: 200 len: 1312 microversion: 2.1 time: 0.081178 Jul 11 11:28:46.041330 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 228/459] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:45 2022] GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e => generated 1312 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:46.055310 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-c9480d3e-1d14-4ab1-8ac3-56982066b170 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:46.056181 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-c9480d3e-1d14-4ab1-8ac3-56982066b170 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:46.062131 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c9480d3e-1d14-4ab1-8ac3-56982066b170 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:46.062581 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c9480d3e-1d14-4ab1-8ac3-56982066b170 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:46.063375 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c9480d3e-1d14-4ab1-8ac3-56982066b170 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:46.063811 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c9480d3e-1d14-4ab1-8ac3-56982066b170 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:46.126032 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-c9480d3e-1d14-4ab1-8ac3-56982066b170 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:46.134143 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-c9480d3e-1d14-4ab1-8ac3-56982066b170 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1250 microversion: 2.1 time: 0.083032 Jul 11 11:28:46.134716 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 229/460] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:46 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1250 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:46.171538 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-2bd63534-12bb-40e9-8baa-308435c4ad5b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:46.179881 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-2bd63534-12bb-40e9-8baa-308435c4ad5b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:46.181658 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-2bd63534-12bb-40e9-8baa-308435c4ad5b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:46.182803 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-2bd63534-12bb-40e9-8baa-308435c4ad5b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1739 microversion: 2.20 time: 0.160928 Jul 11 11:28:46.183388 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 232/461] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:28:46 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1739 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 11:28:46.459308 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-75578a57-2032-4614-b5e1-fbeca8e603fc tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:46.459910 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-75578a57-2032-4614-b5e1-fbeca8e603fc tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] [instance: b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:46.466025 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-75578a57-2032-4614-b5e1-fbeca8e603fc tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:46.466464 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-75578a57-2032-4614-b5e1-fbeca8e603fc tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:46.467208 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-75578a57-2032-4614-b5e1-fbeca8e603fc tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:46.467656 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-75578a57-2032-4614-b5e1-fbeca8e603fc tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:46.532088 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-75578a57-2032-4614-b5e1-fbeca8e603fc tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc29ac59eed483b8c6443c397505adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890e7e79ff744b6b9589f166cd7d8979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:46.539843 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-75578a57-2032-4614-b5e1-fbeca8e603fc tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] 10.222.0.26 "GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0" status: 200 len: 1274 microversion: 2.1 time: 0.084420 Jul 11 11:28:46.540399 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 230/462] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:46 2022] GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0 => generated 1274 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:47.058005 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-8ba05c07-c25c-4a36-b656-771aeeadd5d1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:47.058608 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-8ba05c07-c25c-4a36-b656-771aeeadd5d1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:47.065410 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8ba05c07-c25c-4a36-b656-771aeeadd5d1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:47.065952 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8ba05c07-c25c-4a36-b656-771aeeadd5d1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:47.066714 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8ba05c07-c25c-4a36-b656-771aeeadd5d1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:47.067154 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8ba05c07-c25c-4a36-b656-771aeeadd5d1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:47.130183 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-8ba05c07-c25c-4a36-b656-771aeeadd5d1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:47.138348 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-8ba05c07-c25c-4a36-b656-771aeeadd5d1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e" status: 200 len: 1312 microversion: 2.1 time: 0.084414 Jul 11 11:28:47.138979 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 233/463] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:47 2022] GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e => generated 1312 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:47.150354 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-df721e2a-251b-42f5-a7dc-366390641f25 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:47.150959 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-df721e2a-251b-42f5-a7dc-366390641f25 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:47.157378 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-df721e2a-251b-42f5-a7dc-366390641f25 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:47.157816 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-df721e2a-251b-42f5-a7dc-366390641f25 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:47.158565 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-df721e2a-251b-42f5-a7dc-366390641f25 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:47.158993 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-df721e2a-251b-42f5-a7dc-366390641f25 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:47.201176 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-44d8769b-d95e-4dc7-b960-7ae9cbb48036 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:47.201808 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-44d8769b-d95e-4dc7-b960-7ae9cbb48036 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:47.207708 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-44d8769b-d95e-4dc7-b960-7ae9cbb48036 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:47.208152 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-44d8769b-d95e-4dc7-b960-7ae9cbb48036 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:47.208901 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-44d8769b-d95e-4dc7-b960-7ae9cbb48036 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:47.209334 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-44d8769b-d95e-4dc7-b960-7ae9cbb48036 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:47.219076 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-df721e2a-251b-42f5-a7dc-366390641f25 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:47.227123 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-df721e2a-251b-42f5-a7dc-366390641f25 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1250 microversion: 2.1 time: 0.081161 Jul 11 11:28:47.227728 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 231/464] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:47 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1250 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:47.334926 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-44d8769b-d95e-4dc7-b960-7ae9cbb48036 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:47.337121 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=100 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:28:47.343469 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-44d8769b-d95e-4dc7-b960-7ae9cbb48036 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:47.344973 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-44d8769b-d95e-4dc7-b960-7ae9cbb48036 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:47.346113 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-44d8769b-d95e-4dc7-b960-7ae9cbb48036 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1739 microversion: 2.20 time: 0.148746 Jul 11 11:28:47.346671 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 234/465] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:28:47 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1739 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 11:28:47.556565 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-846c8ccf-ed8e-475e-98fb-2865d504c2e1 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:47.557174 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-846c8ccf-ed8e-475e-98fb-2865d504c2e1 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] [instance: b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:47.563085 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-846c8ccf-ed8e-475e-98fb-2865d504c2e1 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:47.563562 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-846c8ccf-ed8e-475e-98fb-2865d504c2e1 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:47.564319 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-846c8ccf-ed8e-475e-98fb-2865d504c2e1 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:47.564778 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-846c8ccf-ed8e-475e-98fb-2865d504c2e1 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:47.629908 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-846c8ccf-ed8e-475e-98fb-2865d504c2e1 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc29ac59eed483b8c6443c397505adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890e7e79ff744b6b9589f166cd7d8979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:47.634190 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-846c8ccf-ed8e-475e-98fb-2865d504c2e1 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] 10.222.0.26 "GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0" status: 200 len: 1274 microversion: 2.1 time: 0.081731 Jul 11 11:28:47.634755 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 232/466] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:47 2022] GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0 => generated 1274 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:28:48.155493 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-78a43c37-ed37-4b68-8990-9049d12f3c50 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:48.156103 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-78a43c37-ed37-4b68-8990-9049d12f3c50 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:48.162599 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-78a43c37-ed37-4b68-8990-9049d12f3c50 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:48.163048 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-78a43c37-ed37-4b68-8990-9049d12f3c50 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:48.164511 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-78a43c37-ed37-4b68-8990-9049d12f3c50 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:48.164944 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-78a43c37-ed37-4b68-8990-9049d12f3c50 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:48.224926 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-78a43c37-ed37-4b68-8990-9049d12f3c50 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:48.232627 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-78a43c37-ed37-4b68-8990-9049d12f3c50 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e" status: 200 len: 1312 microversion: 2.1 time: 0.081417 Jul 11 11:28:48.233201 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 235/467] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:48 2022] GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e => generated 1312 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:48.243607 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-ed9af67e-35c2-4d52-b0f1-1e49caf32996 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:48.244235 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-ed9af67e-35c2-4d52-b0f1-1e49caf32996 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:48.250630 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ed9af67e-35c2-4d52-b0f1-1e49caf32996 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:48.251068 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ed9af67e-35c2-4d52-b0f1-1e49caf32996 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:48.251855 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ed9af67e-35c2-4d52-b0f1-1e49caf32996 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:48.252284 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ed9af67e-35c2-4d52-b0f1-1e49caf32996 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:48.311740 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-ed9af67e-35c2-4d52-b0f1-1e49caf32996 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:48.318863 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-ed9af67e-35c2-4d52-b0f1-1e49caf32996 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1250 microversion: 2.1 time: 0.079113 Jul 11 11:28:48.319444 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 233/468] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:48 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1250 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:48.364382 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-21c08c96-bd3e-4e69-a72c-116761e8c20d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:48.365051 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-21c08c96-bd3e-4e69-a72c-116761e8c20d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:48.370988 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-21c08c96-bd3e-4e69-a72c-116761e8c20d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:48.371476 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-21c08c96-bd3e-4e69-a72c-116761e8c20d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:48.372234 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-21c08c96-bd3e-4e69-a72c-116761e8c20d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:48.372697 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-21c08c96-bd3e-4e69-a72c-116761e8c20d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:48.500989 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-21c08c96-bd3e-4e69-a72c-116761e8c20d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:48.509768 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-21c08c96-bd3e-4e69-a72c-116761e8c20d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:48.511267 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-21c08c96-bd3e-4e69-a72c-116761e8c20d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:48.512446 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-21c08c96-bd3e-4e69-a72c-116761e8c20d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1739 microversion: 2.20 time: 0.151951 Jul 11 11:28:48.513001 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 236/469] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:28:48 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1739 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:28:48.650640 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-d73eb9f7-67f2-4ecb-a3d9-0b54b26f629b tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:48.651343 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-d73eb9f7-67f2-4ecb-a3d9-0b54b26f629b tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] [instance: b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:48.657213 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d73eb9f7-67f2-4ecb-a3d9-0b54b26f629b tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:48.657652 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d73eb9f7-67f2-4ecb-a3d9-0b54b26f629b tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:48.658394 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d73eb9f7-67f2-4ecb-a3d9-0b54b26f629b tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:48.658815 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d73eb9f7-67f2-4ecb-a3d9-0b54b26f629b tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:48.720795 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-d73eb9f7-67f2-4ecb-a3d9-0b54b26f629b tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc29ac59eed483b8c6443c397505adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890e7e79ff744b6b9589f166cd7d8979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:48.728475 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-d73eb9f7-67f2-4ecb-a3d9-0b54b26f629b tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] 10.222.0.26 "GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0" status: 200 len: 1274 microversion: 2.1 time: 0.081599 Jul 11 11:28:48.729034 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 234/470] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:48 2022] GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0 => generated 1274 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:49.252413 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-447c679e-06f6-426b-b6dc-c0afa5e741c3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:49.253018 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-447c679e-06f6-426b-b6dc-c0afa5e741c3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:49.260001 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-447c679e-06f6-426b-b6dc-c0afa5e741c3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:49.260443 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-447c679e-06f6-426b-b6dc-c0afa5e741c3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:49.261188 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-447c679e-06f6-426b-b6dc-c0afa5e741c3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:49.261614 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-447c679e-06f6-426b-b6dc-c0afa5e741c3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:49.321150 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-447c679e-06f6-426b-b6dc-c0afa5e741c3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:49.328635 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-447c679e-06f6-426b-b6dc-c0afa5e741c3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e" status: 200 len: 1312 microversion: 2.1 time: 0.080010 Jul 11 11:28:49.329160 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 237/471] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:49 2022] GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e => generated 1312 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:49.335804 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-d62918f1-16ca-4729-86f8-847506b8e3ce tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:49.336412 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-d62918f1-16ca-4729-86f8-847506b8e3ce tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:49.342928 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d62918f1-16ca-4729-86f8-847506b8e3ce tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:49.343425 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d62918f1-16ca-4729-86f8-847506b8e3ce tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:49.344190 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d62918f1-16ca-4729-86f8-847506b8e3ce tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:49.344626 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d62918f1-16ca-4729-86f8-847506b8e3ce tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:49.403956 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-d62918f1-16ca-4729-86f8-847506b8e3ce tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:49.411119 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-d62918f1-16ca-4729-86f8-847506b8e3ce tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1250 microversion: 2.1 time: 0.079431 Jul 11 11:28:49.411706 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 235/472] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:49 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1250 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:49.529679 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-b05b59be-965a-456e-9f72-d21282781de5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:49.530320 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-b05b59be-965a-456e-9f72-d21282781de5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:49.536400 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b05b59be-965a-456e-9f72-d21282781de5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:49.536851 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b05b59be-965a-456e-9f72-d21282781de5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:49.537613 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b05b59be-965a-456e-9f72-d21282781de5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:49.538049 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b05b59be-965a-456e-9f72-d21282781de5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:49.667759 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-b05b59be-965a-456e-9f72-d21282781de5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:49.675565 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-b05b59be-965a-456e-9f72-d21282781de5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:49.677108 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-b05b59be-965a-456e-9f72-d21282781de5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:49.678252 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-b05b59be-965a-456e-9f72-d21282781de5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1739 microversion: 2.20 time: 0.152402 Jul 11 11:28:49.678815 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 238/473] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:28:49 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1739 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:28:49.744922 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-54d595eb-d6dc-4608-8d84-16fb3e7fd701 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:49.745524 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-54d595eb-d6dc-4608-8d84-16fb3e7fd701 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] [instance: b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:49.751522 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-54d595eb-d6dc-4608-8d84-16fb3e7fd701 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:49.751967 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-54d595eb-d6dc-4608-8d84-16fb3e7fd701 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:49.752723 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-54d595eb-d6dc-4608-8d84-16fb3e7fd701 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:49.753151 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-54d595eb-d6dc-4608-8d84-16fb3e7fd701 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:49.813950 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-54d595eb-d6dc-4608-8d84-16fb3e7fd701 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc29ac59eed483b8c6443c397505adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890e7e79ff744b6b9589f166cd7d8979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:49.821699 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-54d595eb-d6dc-4608-8d84-16fb3e7fd701 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] 10.222.0.26 "GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0" status: 200 len: 1274 microversion: 2.1 time: 0.080592 Jul 11 11:28:49.824786 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 236/474] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:49 2022] GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0 => generated 1274 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:50.346033 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-de6c7fc0-e329-4e9c-a982-47c97de7f492 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:50.346580 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-de6c7fc0-e329-4e9c-a982-47c97de7f492 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:50.353254 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-de6c7fc0-e329-4e9c-a982-47c97de7f492 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:50.353692 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-de6c7fc0-e329-4e9c-a982-47c97de7f492 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:50.354441 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-de6c7fc0-e329-4e9c-a982-47c97de7f492 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:50.354868 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-de6c7fc0-e329-4e9c-a982-47c97de7f492 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:50.413723 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-de6c7fc0-e329-4e9c-a982-47c97de7f492 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:50.421140 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-de6c7fc0-e329-4e9c-a982-47c97de7f492 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e" status: 200 len: 1312 microversion: 2.1 time: 0.078952 Jul 11 11:28:50.421709 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 239/475] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:50 2022] GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e => generated 1312 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:50.427877 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-697e4d00-64b8-4f02-8072-a7588b844e10 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:50.428480 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-697e4d00-64b8-4f02-8072-a7588b844e10 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:50.435761 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-697e4d00-64b8-4f02-8072-a7588b844e10 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:50.436199 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-697e4d00-64b8-4f02-8072-a7588b844e10 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:50.436943 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-697e4d00-64b8-4f02-8072-a7588b844e10 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:50.437367 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-697e4d00-64b8-4f02-8072-a7588b844e10 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:50.496175 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-697e4d00-64b8-4f02-8072-a7588b844e10 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:50.503201 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-697e4d00-64b8-4f02-8072-a7588b844e10 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1250 microversion: 2.1 time: 0.079077 Jul 11 11:28:50.503782 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 237/476] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:50 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1250 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:50.695986 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-2a2a753d-cda3-4696-abc6-c18405472b22 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:50.696593 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-2a2a753d-cda3-4696-abc6-c18405472b22 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:50.702496 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2a2a753d-cda3-4696-abc6-c18405472b22 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:50.702940 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2a2a753d-cda3-4696-abc6-c18405472b22 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:50.703731 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2a2a753d-cda3-4696-abc6-c18405472b22 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:50.704165 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2a2a753d-cda3-4696-abc6-c18405472b22 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:50.828120 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-2a2a753d-cda3-4696-abc6-c18405472b22 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:50.835834 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-2a2a753d-cda3-4696-abc6-c18405472b22 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:50.837330 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-2a2a753d-cda3-4696-abc6-c18405472b22 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:50.838559 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-2a2a753d-cda3-4696-abc6-c18405472b22 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1739 microversion: 2.20 time: 0.147008 Jul 11 11:28:50.839112 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 240/477] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:28:50 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1739 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:28:50.843400 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-75f167e9-898c-4f06-89f8-d747d9c6b45c tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:50.843985 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-75f167e9-898c-4f06-89f8-d747d9c6b45c tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] [instance: b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:50.849984 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-75f167e9-898c-4f06-89f8-d747d9c6b45c tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:50.850429 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-75f167e9-898c-4f06-89f8-d747d9c6b45c tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:50.851768 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-75f167e9-898c-4f06-89f8-d747d9c6b45c tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:50.852171 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-75f167e9-898c-4f06-89f8-d747d9c6b45c tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:50.864294 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=100 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:28:50.916369 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-75f167e9-898c-4f06-89f8-d747d9c6b45c tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc29ac59eed483b8c6443c397505adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890e7e79ff744b6b9589f166cd7d8979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:50.924326 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-75f167e9-898c-4f06-89f8-d747d9c6b45c tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] 10.222.0.26 "GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0" status: 200 len: 1274 microversion: 2.1 time: 0.084773 Jul 11 11:28:50.924894 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 238/478] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:50 2022] GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0 => generated 1274 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:28:51.438374 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-72f0d899-f1f1-4d05-81b1-2b17afb8d714 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:51.438979 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-72f0d899-f1f1-4d05-81b1-2b17afb8d714 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:51.445446 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-72f0d899-f1f1-4d05-81b1-2b17afb8d714 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:51.445893 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-72f0d899-f1f1-4d05-81b1-2b17afb8d714 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:51.446644 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-72f0d899-f1f1-4d05-81b1-2b17afb8d714 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:51.447078 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-72f0d899-f1f1-4d05-81b1-2b17afb8d714 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:51.506256 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-72f0d899-f1f1-4d05-81b1-2b17afb8d714 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:51.514021 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-72f0d899-f1f1-4d05-81b1-2b17afb8d714 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e" status: 200 len: 1312 microversion: 2.1 time: 0.079444 Jul 11 11:28:51.514591 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 241/479] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:51 2022] GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e => generated 1312 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:51.520542 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-2f06997f-3219-4037-a5b4-8c29f22ad6d2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:51.521150 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-2f06997f-3219-4037-a5b4-8c29f22ad6d2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:51.528226 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2f06997f-3219-4037-a5b4-8c29f22ad6d2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:51.528674 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2f06997f-3219-4037-a5b4-8c29f22ad6d2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:51.529447 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2f06997f-3219-4037-a5b4-8c29f22ad6d2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:51.529899 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2f06997f-3219-4037-a5b4-8c29f22ad6d2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:51.590990 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-2f06997f-3219-4037-a5b4-8c29f22ad6d2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:51.598244 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-2f06997f-3219-4037-a5b4-8c29f22ad6d2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1250 microversion: 2.1 time: 0.081769 Jul 11 11:28:51.598811 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 239/480] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:51 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1250 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:51.856392 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-4a378149-773d-49c2-b205-adc854319bb4 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:51.856998 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-4a378149-773d-49c2-b205-adc854319bb4 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:51.863050 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4a378149-773d-49c2-b205-adc854319bb4 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:51.868939 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4a378149-773d-49c2-b205-adc854319bb4 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:51.868939 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4a378149-773d-49c2-b205-adc854319bb4 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:51.868939 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4a378149-773d-49c2-b205-adc854319bb4 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:51.942984 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-d8245821-7f04-4eeb-b750-2d86b01b8c26 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:51.944425 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-d8245821-7f04-4eeb-b750-2d86b01b8c26 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] [instance: b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:51.952372 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d8245821-7f04-4eeb-b750-2d86b01b8c26 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:51.952740 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d8245821-7f04-4eeb-b750-2d86b01b8c26 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:51.953499 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d8245821-7f04-4eeb-b750-2d86b01b8c26 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:51.953929 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d8245821-7f04-4eeb-b750-2d86b01b8c26 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:51.996737 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-4a378149-773d-49c2-b205-adc854319bb4 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:52.004577 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-4a378149-773d-49c2-b205-adc854319bb4 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:52.006075 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-4a378149-773d-49c2-b205-adc854319bb4 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:52.007208 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-4a378149-773d-49c2-b205-adc854319bb4 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1739 microversion: 2.20 time: 0.154696 Jul 11 11:28:52.008365 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 242/481] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:28:51 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1739 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:28:52.014306 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-d8245821-7f04-4eeb-b750-2d86b01b8c26 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc29ac59eed483b8c6443c397505adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890e7e79ff744b6b9589f166cd7d8979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:52.021883 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-d8245821-7f04-4eeb-b750-2d86b01b8c26 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] 10.222.0.26 "GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0" status: 200 len: 1274 microversion: 2.1 time: 0.084057 Jul 11 11:28:52.022436 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 240/482] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:51 2022] GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0 => generated 1274 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:28:52.531587 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-6b139433-14bc-430b-946f-bf5e307632c0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:52.532228 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-6b139433-14bc-430b-946f-bf5e307632c0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:52.538182 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6b139433-14bc-430b-946f-bf5e307632c0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:52.539140 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6b139433-14bc-430b-946f-bf5e307632c0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:52.539913 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6b139433-14bc-430b-946f-bf5e307632c0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:52.540343 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6b139433-14bc-430b-946f-bf5e307632c0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:52.599894 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-6b139433-14bc-430b-946f-bf5e307632c0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:52.607714 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-6b139433-14bc-430b-946f-bf5e307632c0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e" status: 200 len: 1312 microversion: 2.1 time: 0.080147 Jul 11 11:28:52.608281 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 243/483] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:52 2022] GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e => generated 1312 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:52.614925 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-842e6294-f0cd-4eb1-8e74-340c3f81dc85 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:52.615571 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-842e6294-f0cd-4eb1-8e74-340c3f81dc85 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:52.622515 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-842e6294-f0cd-4eb1-8e74-340c3f81dc85 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:52.624933 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-842e6294-f0cd-4eb1-8e74-340c3f81dc85 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:52.624933 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-842e6294-f0cd-4eb1-8e74-340c3f81dc85 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:52.624933 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-842e6294-f0cd-4eb1-8e74-340c3f81dc85 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:52.683797 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-842e6294-f0cd-4eb1-8e74-340c3f81dc85 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:52.691402 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-842e6294-f0cd-4eb1-8e74-340c3f81dc85 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1250 microversion: 2.1 time: 0.080552 Jul 11 11:28:52.691960 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 241/484] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:52 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1250 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:53.026676 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-acef5d25-b156-49e4-a4bb-606e98fd66cb tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:53.027331 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-acef5d25-b156-49e4-a4bb-606e98fd66cb tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:53.033949 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-acef5d25-b156-49e4-a4bb-606e98fd66cb tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:53.034394 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-acef5d25-b156-49e4-a4bb-606e98fd66cb tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:53.035148 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-acef5d25-b156-49e4-a4bb-606e98fd66cb tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:53.035608 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-acef5d25-b156-49e4-a4bb-606e98fd66cb tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:53.037962 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-f5a6b5bf-5131-4b3f-ab54-dbf20bfd06fb tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:53.039121 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-f5a6b5bf-5131-4b3f-ab54-dbf20bfd06fb tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] [instance: b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:53.045035 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f5a6b5bf-5131-4b3f-ab54-dbf20bfd06fb tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:53.045547 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f5a6b5bf-5131-4b3f-ab54-dbf20bfd06fb tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:53.046298 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f5a6b5bf-5131-4b3f-ab54-dbf20bfd06fb tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:53.046726 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f5a6b5bf-5131-4b3f-ab54-dbf20bfd06fb tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:53.113277 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-f5a6b5bf-5131-4b3f-ab54-dbf20bfd06fb tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc29ac59eed483b8c6443c397505adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890e7e79ff744b6b9589f166cd7d8979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:53.125913 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-f5a6b5bf-5131-4b3f-ab54-dbf20bfd06fb tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] 10.222.0.26 "GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0" status: 200 len: 1274 microversion: 2.1 time: 0.091985 Jul 11 11:28:53.126497 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 242/485] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:53 2022] GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0 => generated 1274 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:53.171513 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-acef5d25-b156-49e4-a4bb-606e98fd66cb tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:53.179978 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-acef5d25-b156-49e4-a4bb-606e98fd66cb tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:53.181746 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-acef5d25-b156-49e4-a4bb-606e98fd66cb tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:53.182880 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-acef5d25-b156-49e4-a4bb-606e98fd66cb tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1739 microversion: 2.20 time: 0.160233 Jul 11 11:28:53.183470 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 244/486] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:28:53 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1739 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:28:53.625051 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-826103da-007c-4a7d-aeb7-1397177c5c8b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:53.625652 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-826103da-007c-4a7d-aeb7-1397177c5c8b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:53.632020 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-826103da-007c-4a7d-aeb7-1397177c5c8b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:53.632457 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-826103da-007c-4a7d-aeb7-1397177c5c8b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:53.633198 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-826103da-007c-4a7d-aeb7-1397177c5c8b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:53.633623 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-826103da-007c-4a7d-aeb7-1397177c5c8b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:53.692977 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-826103da-007c-4a7d-aeb7-1397177c5c8b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:53.700416 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-826103da-007c-4a7d-aeb7-1397177c5c8b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e" status: 200 len: 1312 microversion: 2.1 time: 0.079161 Jul 11 11:28:53.701008 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 243/487] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:53 2022] GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e => generated 1312 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:53.707941 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-232e22ad-1f08-4b08-82b5-18bca7bbcfd1 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:53.708554 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-232e22ad-1f08-4b08-82b5-18bca7bbcfd1 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:53.715022 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-232e22ad-1f08-4b08-82b5-18bca7bbcfd1 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:53.715504 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-232e22ad-1f08-4b08-82b5-18bca7bbcfd1 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:53.716272 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-232e22ad-1f08-4b08-82b5-18bca7bbcfd1 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:53.716709 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-232e22ad-1f08-4b08-82b5-18bca7bbcfd1 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:53.779384 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-232e22ad-1f08-4b08-82b5-18bca7bbcfd1 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:53.786749 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-232e22ad-1f08-4b08-82b5-18bca7bbcfd1 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1250 microversion: 2.1 time: 0.082648 Jul 11 11:28:53.787334 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 245/488] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:53 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1250 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:54.142191 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-2febbf6e-5efe-4ceb-a2aa-8306c6fbc4a1 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:54.142821 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-2febbf6e-5efe-4ceb-a2aa-8306c6fbc4a1 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] [instance: b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:54.149369 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2febbf6e-5efe-4ceb-a2aa-8306c6fbc4a1 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:54.149806 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2febbf6e-5efe-4ceb-a2aa-8306c6fbc4a1 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:54.150728 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2febbf6e-5efe-4ceb-a2aa-8306c6fbc4a1 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:54.151158 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2febbf6e-5efe-4ceb-a2aa-8306c6fbc4a1 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:54.201648 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-20fabfd2-5504-4529-8905-e1f5d5553c89 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:54.202353 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-20fabfd2-5504-4529-8905-e1f5d5553c89 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:54.208983 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-20fabfd2-5504-4529-8905-e1f5d5553c89 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:54.209492 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-20fabfd2-5504-4529-8905-e1f5d5553c89 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:54.210342 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-20fabfd2-5504-4529-8905-e1f5d5553c89 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:54.210902 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-20fabfd2-5504-4529-8905-e1f5d5553c89 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:54.218582 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-2febbf6e-5efe-4ceb-a2aa-8306c6fbc4a1 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc29ac59eed483b8c6443c397505adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890e7e79ff744b6b9589f166cd7d8979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:54.225781 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-2febbf6e-5efe-4ceb-a2aa-8306c6fbc4a1 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] 10.222.0.26 "GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0" status: 200 len: 1274 microversion: 2.1 time: 0.087397 Jul 11 11:28:54.226407 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 244/489] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:54 2022] GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0 => generated 1274 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:54.336683 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-20fabfd2-5504-4529-8905-e1f5d5553c89 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:54.344540 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-20fabfd2-5504-4529-8905-e1f5d5553c89 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:54.346112 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-20fabfd2-5504-4529-8905-e1f5d5553c89 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:54.347241 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-20fabfd2-5504-4529-8905-e1f5d5553c89 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1739 microversion: 2.20 time: 0.149553 Jul 11 11:28:54.347820 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 246/490] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:28:54 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1739 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 11:28:54.717344 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-0e4f62c5-c86b-487c-99d2-b7ba0e6e36f9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:54.717944 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-0e4f62c5-c86b-487c-99d2-b7ba0e6e36f9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:54.724324 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0e4f62c5-c86b-487c-99d2-b7ba0e6e36f9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:54.724763 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0e4f62c5-c86b-487c-99d2-b7ba0e6e36f9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:54.725508 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0e4f62c5-c86b-487c-99d2-b7ba0e6e36f9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:54.725935 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0e4f62c5-c86b-487c-99d2-b7ba0e6e36f9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:54.786241 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-0e4f62c5-c86b-487c-99d2-b7ba0e6e36f9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:54.798537 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-0e4f62c5-c86b-487c-99d2-b7ba0e6e36f9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e" status: 200 len: 1312 microversion: 2.1 time: 0.084990 Jul 11 11:28:54.799132 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 245/491] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:54 2022] GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e => generated 1312 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:54.808061 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-8ae0aa8b-3846-4f94-a6b1-54f5cfc7623a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:54.808745 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-8ae0aa8b-3846-4f94-a6b1-54f5cfc7623a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:54.814757 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8ae0aa8b-3846-4f94-a6b1-54f5cfc7623a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:54.815200 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8ae0aa8b-3846-4f94-a6b1-54f5cfc7623a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:54.818512 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8ae0aa8b-3846-4f94-a6b1-54f5cfc7623a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:54.818957 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8ae0aa8b-3846-4f94-a6b1-54f5cfc7623a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:54.879131 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-8ae0aa8b-3846-4f94-a6b1-54f5cfc7623a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:54.886424 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-8ae0aa8b-3846-4f94-a6b1-54f5cfc7623a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1250 microversion: 2.1 time: 0.083422 Jul 11 11:28:54.886989 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 247/492] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:54 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1250 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:55.242600 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-896e1d5c-eb0a-4d52-b583-9dc0641030f4 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:55.243197 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-896e1d5c-eb0a-4d52-b583-9dc0641030f4 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] [instance: b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:55.249167 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-896e1d5c-eb0a-4d52-b583-9dc0641030f4 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:55.249602 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-896e1d5c-eb0a-4d52-b583-9dc0641030f4 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:55.250352 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-896e1d5c-eb0a-4d52-b583-9dc0641030f4 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:55.250780 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-896e1d5c-eb0a-4d52-b583-9dc0641030f4 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:55.312465 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-896e1d5c-eb0a-4d52-b583-9dc0641030f4 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc29ac59eed483b8c6443c397505adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890e7e79ff744b6b9589f166cd7d8979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:55.319684 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-896e1d5c-eb0a-4d52-b583-9dc0641030f4 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] 10.222.0.26 "GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0" status: 200 len: 1274 microversion: 2.1 time: 0.080902 Jul 11 11:28:55.320742 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 246/493] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:55 2022] GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0 => generated 1274 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:55.364915 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-40eca768-199a-43f7-acd3-d9b83d1c4848 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:55.365453 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-40eca768-199a-43f7-acd3-d9b83d1c4848 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:55.371902 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-40eca768-199a-43f7-acd3-d9b83d1c4848 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:55.372347 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-40eca768-199a-43f7-acd3-d9b83d1c4848 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:55.373102 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-40eca768-199a-43f7-acd3-d9b83d1c4848 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:55.373537 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-40eca768-199a-43f7-acd3-d9b83d1c4848 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:55.504376 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-40eca768-199a-43f7-acd3-d9b83d1c4848 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:55.512122 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-40eca768-199a-43f7-acd3-d9b83d1c4848 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:55.513608 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-40eca768-199a-43f7-acd3-d9b83d1c4848 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:55.514743 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-40eca768-199a-43f7-acd3-d9b83d1c4848 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1739 microversion: 2.20 time: 0.153786 Jul 11 11:28:55.515308 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 248/494] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:28:55 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1739 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:28:55.815861 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-3fa86a49-98af-4613-979c-913af02c53e1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:55.816471 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-3fa86a49-98af-4613-979c-913af02c53e1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:55.824519 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3fa86a49-98af-4613-979c-913af02c53e1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:55.824965 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3fa86a49-98af-4613-979c-913af02c53e1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:55.825727 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3fa86a49-98af-4613-979c-913af02c53e1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:55.826157 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3fa86a49-98af-4613-979c-913af02c53e1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:55.889251 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-3fa86a49-98af-4613-979c-913af02c53e1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:55.896717 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-3fa86a49-98af-4613-979c-913af02c53e1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e" status: 200 len: 1312 microversion: 2.1 time: 0.084641 Jul 11 11:28:55.897273 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 247/495] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:55 2022] GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e => generated 1312 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:55.902798 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-63f92242-af73-4081-8ae7-678417b38574 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:55.906751 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-63f92242-af73-4081-8ae7-678417b38574 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:55.909528 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-63f92242-af73-4081-8ae7-678417b38574 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:55.909980 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-63f92242-af73-4081-8ae7-678417b38574 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:55.910743 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-63f92242-af73-4081-8ae7-678417b38574 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:55.911180 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-63f92242-af73-4081-8ae7-678417b38574 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:55.972070 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-63f92242-af73-4081-8ae7-678417b38574 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:55.979211 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-63f92242-af73-4081-8ae7-678417b38574 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1250 microversion: 2.1 time: 0.080232 Jul 11 11:28:55.979804 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 249/496] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:55 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1250 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:56.336911 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-be053098-3ca3-4924-8070-c95719841b09 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:56.337438 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-be053098-3ca3-4924-8070-c95719841b09 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] [instance: b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:56.343572 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-be053098-3ca3-4924-8070-c95719841b09 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:56.344018 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-be053098-3ca3-4924-8070-c95719841b09 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:56.344779 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-be053098-3ca3-4924-8070-c95719841b09 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:56.345209 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-be053098-3ca3-4924-8070-c95719841b09 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:56.407605 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-be053098-3ca3-4924-8070-c95719841b09 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc29ac59eed483b8c6443c397505adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890e7e79ff744b6b9589f166cd7d8979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:56.415586 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-be053098-3ca3-4924-8070-c95719841b09 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] 10.222.0.26 "GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0" status: 200 len: 1274 microversion: 2.1 time: 0.082530 Jul 11 11:28:56.416150 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 248/497] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:56 2022] GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0 => generated 1274 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:56.532682 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-bcae03fd-ac1e-484d-a4a7-5a6c681df0ea tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:56.533292 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-bcae03fd-ac1e-484d-a4a7-5a6c681df0ea tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:56.540372 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bcae03fd-ac1e-484d-a4a7-5a6c681df0ea tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:56.540820 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bcae03fd-ac1e-484d-a4a7-5a6c681df0ea tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:56.541578 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bcae03fd-ac1e-484d-a4a7-5a6c681df0ea tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:56.542018 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bcae03fd-ac1e-484d-a4a7-5a6c681df0ea tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:56.668040 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-bcae03fd-ac1e-484d-a4a7-5a6c681df0ea tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:56.675795 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-bcae03fd-ac1e-484d-a4a7-5a6c681df0ea tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:56.677332 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-bcae03fd-ac1e-484d-a4a7-5a6c681df0ea tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:56.678478 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-bcae03fd-ac1e-484d-a4a7-5a6c681df0ea tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1739 microversion: 2.20 time: 0.149682 Jul 11 11:28:56.679035 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 250/498] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:28:56 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1739 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:28:56.913468 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-a83b9499-7ad0-4711-9be4-e41f1075b2b8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:56.914615 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-a83b9499-7ad0-4711-9be4-e41f1075b2b8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:56.921174 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a83b9499-7ad0-4711-9be4-e41f1075b2b8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:56.921625 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a83b9499-7ad0-4711-9be4-e41f1075b2b8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:56.922437 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a83b9499-7ad0-4711-9be4-e41f1075b2b8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:56.922892 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a83b9499-7ad0-4711-9be4-e41f1075b2b8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:56.983877 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-a83b9499-7ad0-4711-9be4-e41f1075b2b8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:56.991142 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-a83b9499-7ad0-4711-9be4-e41f1075b2b8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e" status: 200 len: 1312 microversion: 2.1 time: 0.081402 Jul 11 11:28:56.991786 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 249/499] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:56 2022] GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e => generated 1312 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:56.996436 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-f9e0b501-8ba3-4c18-9b4c-2fc706308833 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:56.997043 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-f9e0b501-8ba3-4c18-9b4c-2fc706308833 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:57.003107 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f9e0b501-8ba3-4c18-9b4c-2fc706308833 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:57.003569 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f9e0b501-8ba3-4c18-9b4c-2fc706308833 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:57.004324 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f9e0b501-8ba3-4c18-9b4c-2fc706308833 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:57.004758 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f9e0b501-8ba3-4c18-9b4c-2fc706308833 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:57.018864 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=100 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:28:57.083892 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-f9e0b501-8ba3-4c18-9b4c-2fc706308833 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:57.090788 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-f9e0b501-8ba3-4c18-9b4c-2fc706308833 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1250 microversion: 2.1 time: 0.098821 Jul 11 11:28:57.091377 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 251/500] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:56 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1250 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:28:57.432941 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-7c17b6c1-b910-4d8a-a786-4259530c2a0b tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:57.433604 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-7c17b6c1-b910-4d8a-a786-4259530c2a0b tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] [instance: b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:57.439812 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7c17b6c1-b910-4d8a-a786-4259530c2a0b tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:57.440335 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7c17b6c1-b910-4d8a-a786-4259530c2a0b tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:57.441276 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7c17b6c1-b910-4d8a-a786-4259530c2a0b tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:57.441777 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7c17b6c1-b910-4d8a-a786-4259530c2a0b tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:57.526264 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-7c17b6c1-b910-4d8a-a786-4259530c2a0b tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc29ac59eed483b8c6443c397505adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890e7e79ff744b6b9589f166cd7d8979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:57.534121 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-7c17b6c1-b910-4d8a-a786-4259530c2a0b tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] 10.222.0.26 "GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0" status: 200 len: 1274 microversion: 2.1 time: 0.105592 Jul 11 11:28:57.534783 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 250/501] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:57 2022] GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0 => generated 1274 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:57.697947 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-7233da3f-ecf3-48a6-b65f-c7ed1a237bc9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:57.698867 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-7233da3f-ecf3-48a6-b65f-c7ed1a237bc9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:57.705773 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7233da3f-ecf3-48a6-b65f-c7ed1a237bc9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:57.706218 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7233da3f-ecf3-48a6-b65f-c7ed1a237bc9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:57.706974 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7233da3f-ecf3-48a6-b65f-c7ed1a237bc9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:57.707429 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7233da3f-ecf3-48a6-b65f-c7ed1a237bc9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:57.888514 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-7233da3f-ecf3-48a6-b65f-c7ed1a237bc9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:57.905193 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-7233da3f-ecf3-48a6-b65f-c7ed1a237bc9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:57.907327 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-7233da3f-ecf3-48a6-b65f-c7ed1a237bc9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:57.908374 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-7233da3f-ecf3-48a6-b65f-c7ed1a237bc9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1739 microversion: 2.20 time: 0.214973 Jul 11 11:28:57.908944 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 252/502] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:28:57 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1739 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:28:58.009389 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-61809ad5-cbc6-47ae-9518-1b1139ef8220 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:58.010752 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-61809ad5-cbc6-47ae-9518-1b1139ef8220 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:58.015632 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_api:SELECT=100 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:28:58.019405 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-61809ad5-cbc6-47ae-9518-1b1139ef8220 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:58.019953 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-61809ad5-cbc6-47ae-9518-1b1139ef8220 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:58.020818 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-61809ad5-cbc6-47ae-9518-1b1139ef8220 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:58.021346 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-61809ad5-cbc6-47ae-9518-1b1139ef8220 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:58.108126 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-b0ab922e-c1db-42f9-8780-84cd76905fb4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:58.109069 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-61809ad5-cbc6-47ae-9518-1b1139ef8220 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:58.111741 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-b0ab922e-c1db-42f9-8780-84cd76905fb4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:58.120470 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b0ab922e-c1db-42f9-8780-84cd76905fb4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:58.121229 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b0ab922e-c1db-42f9-8780-84cd76905fb4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:58.122170 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b0ab922e-c1db-42f9-8780-84cd76905fb4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:58.122753 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b0ab922e-c1db-42f9-8780-84cd76905fb4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:58.123832 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-61809ad5-cbc6-47ae-9518-1b1139ef8220 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e" status: 200 len: 1300 microversion: 2.1 time: 0.119053 Jul 11 11:28:58.124702 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 251/503] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:58 2022] GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e => generated 1300 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:58.198720 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-b0ab922e-c1db-42f9-8780-84cd76905fb4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:58.206216 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-b0ab922e-c1db-42f9-8780-84cd76905fb4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1250 microversion: 2.1 time: 0.101826 Jul 11 11:28:58.206794 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 253/504] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:58 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1250 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:58.551850 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-f3de34f8-c96f-4094-b4d3-64f80bb66044 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:58.552851 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-f3de34f8-c96f-4094-b4d3-64f80bb66044 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] [instance: b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:58.560526 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f3de34f8-c96f-4094-b4d3-64f80bb66044 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:58.561227 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f3de34f8-c96f-4094-b4d3-64f80bb66044 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:58.562216 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f3de34f8-c96f-4094-b4d3-64f80bb66044 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:58.562651 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f3de34f8-c96f-4094-b4d3-64f80bb66044 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:58.637760 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-f3de34f8-c96f-4094-b4d3-64f80bb66044 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc29ac59eed483b8c6443c397505adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890e7e79ff744b6b9589f166cd7d8979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:58.645616 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-f3de34f8-c96f-4094-b4d3-64f80bb66044 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] 10.222.0.26 "GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0" status: 200 len: 1274 microversion: 2.1 time: 0.098004 Jul 11 11:28:58.646184 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 252/505] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:58 2022] GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0 => generated 1274 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:28:58.930325 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-19aff157-1e0b-4cad-ab87-b2b4f88bbb86 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:58.931378 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-19aff157-1e0b-4cad-ab87-b2b4f88bbb86 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:58.938591 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-19aff157-1e0b-4cad-ab87-b2b4f88bbb86 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:58.939177 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-19aff157-1e0b-4cad-ab87-b2b4f88bbb86 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:58.939989 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-19aff157-1e0b-4cad-ab87-b2b4f88bbb86 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:58.940422 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-19aff157-1e0b-4cad-ab87-b2b4f88bbb86 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:59.146706 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-73e68042-96dc-4299-8974-19d342dd74d1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:59.147407 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-19aff157-1e0b-4cad-ab87-b2b4f88bbb86 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:59.147837 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-73e68042-96dc-4299-8974-19d342dd74d1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:59.162012 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-19aff157-1e0b-4cad-ab87-b2b4f88bbb86 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:59.164037 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-19aff157-1e0b-4cad-ab87-b2b4f88bbb86 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:59.164851 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-73e68042-96dc-4299-8974-19d342dd74d1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:59.165307 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-73e68042-96dc-4299-8974-19d342dd74d1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:59.166084 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-73e68042-96dc-4299-8974-19d342dd74d1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:59.166518 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-73e68042-96dc-4299-8974-19d342dd74d1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:59.166885 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-19aff157-1e0b-4cad-ab87-b2b4f88bbb86 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1739 microversion: 2.20 time: 0.241193 Jul 11 11:28:59.167728 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 254/506] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:28:58 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1739 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:28:59.223004 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-9232c8d6-61dd-42ab-8d5b-d51d23cbea61 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:59.239955 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-9232c8d6-61dd-42ab-8d5b-d51d23cbea61 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:59.256534 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9232c8d6-61dd-42ab-8d5b-d51d23cbea61 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:59.259134 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9232c8d6-61dd-42ab-8d5b-d51d23cbea61 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:59.262996 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9232c8d6-61dd-42ab-8d5b-d51d23cbea61 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:59.263996 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9232c8d6-61dd-42ab-8d5b-d51d23cbea61 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:59.314943 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-73e68042-96dc-4299-8974-19d342dd74d1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:59.325822 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-73e68042-96dc-4299-8974-19d342dd74d1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e" status: 200 len: 1300 microversion: 2.1 time: 0.183551 Jul 11 11:28:59.327291 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 253/507] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:59 2022] GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e => generated 1300 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:59.372036 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-9232c8d6-61dd-42ab-8d5b-d51d23cbea61 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:59.381387 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-9232c8d6-61dd-42ab-8d5b-d51d23cbea61 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1250 microversion: 2.1 time: 0.162074 Jul 11 11:28:59.381949 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 255/508] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:59 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1250 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:28:59.665100 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-40e4e9af-c6f4-40dc-9935-428825ce8bf9 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:28:59.666051 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-40e4e9af-c6f4-40dc-9935-428825ce8bf9 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] [instance: b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:28:59.673081 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-40e4e9af-c6f4-40dc-9935-428825ce8bf9 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:59.673537 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-40e4e9af-c6f4-40dc-9935-428825ce8bf9 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:59.674310 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-40e4e9af-c6f4-40dc-9935-428825ce8bf9 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:28:59.674753 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-40e4e9af-c6f4-40dc-9935-428825ce8bf9 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:28:59.786522 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-40e4e9af-c6f4-40dc-9935-428825ce8bf9 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc29ac59eed483b8c6443c397505adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890e7e79ff744b6b9589f166cd7d8979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:28:59.790384 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=100 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:28:59.800130 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-40e4e9af-c6f4-40dc-9935-428825ce8bf9 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] 10.222.0.26 "GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0" status: 200 len: 1274 microversion: 2.1 time: 0.139382 Jul 11 11:28:59.801091 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 254/509] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:28:59 2022] GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0 => generated 1274 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:29:00.197402 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-a8f5520d-78bf-40f3-8219-a5c510577985 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:00.198816 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-a8f5520d-78bf-40f3-8219-a5c510577985 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:00.215848 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a8f5520d-78bf-40f3-8219-a5c510577985 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:00.216335 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a8f5520d-78bf-40f3-8219-a5c510577985 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:00.221044 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a8f5520d-78bf-40f3-8219-a5c510577985 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:00.223377 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a8f5520d-78bf-40f3-8219-a5c510577985 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:00.342629 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-991ca310-203f-4be3-9d01-3b788821c722 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:00.344149 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-991ca310-203f-4be3-9d01-3b788821c722 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:00.351533 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-991ca310-203f-4be3-9d01-3b788821c722 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:00.352345 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-991ca310-203f-4be3-9d01-3b788821c722 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:00.353374 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-991ca310-203f-4be3-9d01-3b788821c722 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:00.354283 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-991ca310-203f-4be3-9d01-3b788821c722 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:00.470248 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-991ca310-203f-4be3-9d01-3b788821c722 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:00.481145 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-991ca310-203f-4be3-9d01-3b788821c722 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e" status: 200 len: 1300 microversion: 2.1 time: 0.142944 Jul 11 11:29:00.482403 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 255/510] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:29:00 2022] GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e => generated 1300 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:29:00.492112 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-475cb684-48a0-46b4-8c8b-f5bd863433e7 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:00.493083 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-475cb684-48a0-46b4-8c8b-f5bd863433e7 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:00.499618 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-a8f5520d-78bf-40f3-8219-a5c510577985 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:00.504441 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-475cb684-48a0-46b4-8c8b-f5bd863433e7 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:00.504441 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-475cb684-48a0-46b4-8c8b-f5bd863433e7 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:00.504441 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-475cb684-48a0-46b4-8c8b-f5bd863433e7 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:00.505235 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-475cb684-48a0-46b4-8c8b-f5bd863433e7 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:00.514372 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-a8f5520d-78bf-40f3-8219-a5c510577985 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:00.516464 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-a8f5520d-78bf-40f3-8219-a5c510577985 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:00.518181 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-a8f5520d-78bf-40f3-8219-a5c510577985 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1739 microversion: 2.20 time: 0.328069 Jul 11 11:29:00.519280 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 256/511] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:29:00 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1739 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:29:00.614703 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-475cb684-48a0-46b4-8c8b-f5bd863433e7 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:00.639916 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-475cb684-48a0-46b4-8c8b-f5bd863433e7 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1242 microversion: 2.1 time: 0.156006 Jul 11 11:29:00.651756 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 256/512] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:29:00 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1242 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:29:00.818786 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-d21ce626-c9d6-431c-bb22-96d0634ea503 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:00.822531 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-d21ce626-c9d6-431c-bb22-96d0634ea503 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] [instance: b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:00.833196 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d21ce626-c9d6-431c-bb22-96d0634ea503 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:00.833653 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d21ce626-c9d6-431c-bb22-96d0634ea503 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:00.834427 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d21ce626-c9d6-431c-bb22-96d0634ea503 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:00.834864 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d21ce626-c9d6-431c-bb22-96d0634ea503 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:00.964493 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-d21ce626-c9d6-431c-bb22-96d0634ea503 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc29ac59eed483b8c6443c397505adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890e7e79ff744b6b9589f166cd7d8979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:00.976821 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-d21ce626-c9d6-431c-bb22-96d0634ea503 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] 10.222.0.26 "GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0" status: 200 len: 1272 microversion: 2.1 time: 0.161695 Jul 11 11:29:00.977986 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 257/513] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:29:00 2022] GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0 => generated 1272 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:29:01.500506 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-11fc5123-2da4-44e2-8c55-59bc907716fe tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:01.501133 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-11fc5123-2da4-44e2-8c55-59bc907716fe tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:01.520273 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-11fc5123-2da4-44e2-8c55-59bc907716fe tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:01.520720 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-11fc5123-2da4-44e2-8c55-59bc907716fe tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:01.521514 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-11fc5123-2da4-44e2-8c55-59bc907716fe tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:01.521944 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-11fc5123-2da4-44e2-8c55-59bc907716fe tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:01.538011 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-40abc2d5-7515-46e1-9557-55d6b530f076 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:01.539171 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-40abc2d5-7515-46e1-9557-55d6b530f076 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:01.562262 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-40abc2d5-7515-46e1-9557-55d6b530f076 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:01.562708 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-40abc2d5-7515-46e1-9557-55d6b530f076 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:01.563703 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-40abc2d5-7515-46e1-9557-55d6b530f076 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:01.564330 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-40abc2d5-7515-46e1-9557-55d6b530f076 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:01.869716 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-40abc2d5-7515-46e1-9557-55d6b530f076 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:01.884394 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-40abc2d5-7515-46e1-9557-55d6b530f076 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:01.885906 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-40abc2d5-7515-46e1-9557-55d6b530f076 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:01.887082 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-40abc2d5-7515-46e1-9557-55d6b530f076 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1739 microversion: 2.20 time: 0.352957 Jul 11 11:29:01.887709 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 258/514] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:29:01 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1739 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 11:29:01.897019 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-f17f301b-5af3-4f72-95ea-c0ec681d2c7e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:01.897868 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-f17f301b-5af3-4f72-95ea-c0ec681d2c7e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:01.933335 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f17f301b-5af3-4f72-95ea-c0ec681d2c7e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:01.934095 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f17f301b-5af3-4f72-95ea-c0ec681d2c7e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:01.935960 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f17f301b-5af3-4f72-95ea-c0ec681d2c7e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:01.936397 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f17f301b-5af3-4f72-95ea-c0ec681d2c7e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:02.079199 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-f17f301b-5af3-4f72-95ea-c0ec681d2c7e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:02.099154 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-f17f301b-5af3-4f72-95ea-c0ec681d2c7e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1298 microversion: 2.1 time: 0.207352 Jul 11 11:29:02.103795 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 259/515] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:29:01 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1298 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:29:02.109057 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-b391e87d-d285-4b85-a02e-adb8d3d5b225 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:02.110032 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-b391e87d-d285-4b85-a02e-adb8d3d5b225 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] [instance: b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:02.119979 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-11fc5123-2da4-44e2-8c55-59bc907716fe tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:02.131380 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-11fc5123-2da4-44e2-8c55-59bc907716fe tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e" status: 200 len: 1368 microversion: 2.1 time: 0.636599 Jul 11 11:29:02.134967 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b391e87d-d285-4b85-a02e-adb8d3d5b225 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:02.135866 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 257/516] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:29:01 2022] GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e => generated 1368 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:29:02.138517 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b391e87d-d285-4b85-a02e-adb8d3d5b225 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:02.139495 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b391e87d-d285-4b85-a02e-adb8d3d5b225 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:02.140159 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b391e87d-d285-4b85-a02e-adb8d3d5b225 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:02.495324 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-b391e87d-d285-4b85-a02e-adb8d3d5b225 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc29ac59eed483b8c6443c397505adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890e7e79ff744b6b9589f166cd7d8979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:02.505543 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-b391e87d-d285-4b85-a02e-adb8d3d5b225 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] 10.222.0.26 "GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0" status: 200 len: 1314 microversion: 2.1 time: 0.400386 Jul 11 11:29:02.519687 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 260/517] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:29:02 2022] GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0 => generated 1314 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:29:02.525175 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-bbcf668f-5fca-49e0-bf10-88e665450a8a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:29:02.536273 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-bbcf668f-5fca-49e0-bf10-88e665450a8a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:02.537033 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-bbcf668f-5fca-49e0-bf10-88e665450a8a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:02.673640 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-bbcf668f-5fca-49e0-bf10-88e665450a8a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Going to try to stop instance {{(pid=118322) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 11 11:29:02.912420 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-53b3d3e6-e45a-4550-9629-2ad53fad3d07 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:02.913681 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-53b3d3e6-e45a-4550-9629-2ad53fad3d07 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:02.923626 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-bbcf668f-5fca-49e0-bf10-88e665450a8a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "POST /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/action" status: 202 len: 0 microversion: 2.1 time: 0.402148 Jul 11 11:29:02.924824 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 258/518] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Jul 11 11:29:02 2022] POST /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/action => generated 0 bytes in 404 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 11 11:29:02.932806 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-53b3d3e6-e45a-4550-9629-2ad53fad3d07 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:02.935481 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-7e9540e6-fba3-4dc8-a1c4-07ccad3c3a3e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:02.935723 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-53b3d3e6-e45a-4550-9629-2ad53fad3d07 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:02.936440 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-53b3d3e6-e45a-4550-9629-2ad53fad3d07 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:02.937013 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-7e9540e6-fba3-4dc8-a1c4-07ccad3c3a3e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:02.941280 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-53b3d3e6-e45a-4550-9629-2ad53fad3d07 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:02.952365 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7e9540e6-fba3-4dc8-a1c4-07ccad3c3a3e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:02.952365 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7e9540e6-fba3-4dc8-a1c4-07ccad3c3a3e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:02.952365 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7e9540e6-fba3-4dc8-a1c4-07ccad3c3a3e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:02.952365 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7e9540e6-fba3-4dc8-a1c4-07ccad3c3a3e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:03.221737 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-53b3d3e6-e45a-4550-9629-2ad53fad3d07 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:03.233927 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-53b3d3e6-e45a-4550-9629-2ad53fad3d07 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:03.236071 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-53b3d3e6-e45a-4550-9629-2ad53fad3d07 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:03.238526 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-53b3d3e6-e45a-4550-9629-2ad53fad3d07 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1739 microversion: 2.20 time: 0.337159 Jul 11 11:29:03.239733 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 261/519] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:29:02 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1739 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 11:29:03.248699 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-cfe91b62-5d60-4ab5-9892-512e6c019320 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:03.250581 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-cfe91b62-5d60-4ab5-9892-512e6c019320 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:03.264487 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-cfe91b62-5d60-4ab5-9892-512e6c019320 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:03.265252 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-cfe91b62-5d60-4ab5-9892-512e6c019320 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:03.266394 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-cfe91b62-5d60-4ab5-9892-512e6c019320 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:03.267121 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-cfe91b62-5d60-4ab5-9892-512e6c019320 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:03.269020 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-7e9540e6-fba3-4dc8-a1c4-07ccad3c3a3e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:03.282273 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-7e9540e6-fba3-4dc8-a1c4-07ccad3c3a3e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1723 microversion: 2.1 time: 0.353375 Jul 11 11:29:03.296579 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 259/520] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:29:02 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1723 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:29:03.302949 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-966b6040-dbec-4d4c-8fa3-f8e2c29da7e3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:03.303657 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-966b6040-dbec-4d4c-8fa3-f8e2c29da7e3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:03.312788 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-966b6040-dbec-4d4c-8fa3-f8e2c29da7e3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:03.313964 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-966b6040-dbec-4d4c-8fa3-f8e2c29da7e3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:03.315502 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-966b6040-dbec-4d4c-8fa3-f8e2c29da7e3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:03.316096 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-966b6040-dbec-4d4c-8fa3-f8e2c29da7e3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:03.384410 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-cfe91b62-5d60-4ab5-9892-512e6c019320 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:03.405326 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-cfe91b62-5d60-4ab5-9892-512e6c019320 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1304 microversion: 2.1 time: 0.163352 Jul 11 11:29:03.407161 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 262/521] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:29:03 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1304 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:29:03.427598 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [req-9e9b6060-609e-4b16-bdb3-131faaf696e7 req-08905985-7086-450b-af81-32be0db0bd9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e", "tag": "14c018a2-6bb9-4f49-bd4c-0dfd7f207193"}]} {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:29:03.458503 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_api:SELECT=100 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:29:03.465890 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [req-9e9b6060-609e-4b16-bdb3-131faaf696e7 req-08905985-7086-450b-af81-32be0db0bd9b service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:03.473655 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [req-9e9b6060-609e-4b16-bdb3-131faaf696e7 req-08905985-7086-450b-af81-32be0db0bd9b service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:03.513816 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.compute.server_external_events [req-9e9b6060-609e-4b16-bdb3-131faaf696e7 req-08905985-7086-450b-af81-32be0db0bd9b service nova] Creating event network-changed:14c018a2-6bb9-4f49-bd4c-0dfd7f207193 for instance 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e on hv-cinder-84842 Jul 11 11:29:03.529042 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [req-9e9b6060-609e-4b16-bdb3-131faaf696e7 req-08905985-7086-450b-af81-32be0db0bd9b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117947 Jul 11 11:29:03.535340 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 263/522] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 11:29:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:29:03.570542 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-299ec7cc-2ffd-4c7a-8bb9-86eccce06fb1 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:03.573255 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-299ec7cc-2ffd-4c7a-8bb9-86eccce06fb1 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] [instance: b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:03.601785 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-299ec7cc-2ffd-4c7a-8bb9-86eccce06fb1 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:03.603545 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-299ec7cc-2ffd-4c7a-8bb9-86eccce06fb1 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:03.609353 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-299ec7cc-2ffd-4c7a-8bb9-86eccce06fb1 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:03.609810 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-299ec7cc-2ffd-4c7a-8bb9-86eccce06fb1 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:03.638944 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-966b6040-dbec-4d4c-8fa3-f8e2c29da7e3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:03.646615 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-966b6040-dbec-4d4c-8fa3-f8e2c29da7e3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e" status: 200 len: 1368 microversion: 2.1 time: 0.348904 Jul 11 11:29:03.653308 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 260/523] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:29:03 2022] GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e => generated 1368 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:29:03.659673 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [req-adf22974-8225-422d-bb69-6201cb837462 req-676b1c7f-6704-47c1-aa5e-079d2255d78f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0", "tag": "c667a1ab-f4f0-43bf-aa75-4bd7508e68f9"}]} {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:29:03.674154 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [req-adf22974-8225-422d-bb69-6201cb837462 req-676b1c7f-6704-47c1-aa5e-079d2255d78f service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:03.690553 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [req-adf22974-8225-422d-bb69-6201cb837462 req-676b1c7f-6704-47c1-aa5e-079d2255d78f service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:03.703762 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.compute.server_external_events [req-adf22974-8225-422d-bb69-6201cb837462 req-676b1c7f-6704-47c1-aa5e-079d2255d78f service nova] Creating event network-changed:c667a1ab-f4f0-43bf-aa75-4bd7508e68f9 for instance b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0 on hv-cinder-84842 Jul 11 11:29:03.714663 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [req-adf22974-8225-422d-bb69-6201cb837462 req-676b1c7f-6704-47c1-aa5e-079d2255d78f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059455 Jul 11 11:29:03.715721 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 261/524] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 11:29:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:29:03.979997 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-299ec7cc-2ffd-4c7a-8bb9-86eccce06fb1 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc29ac59eed483b8c6443c397505adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890e7e79ff744b6b9589f166cd7d8979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:03.990224 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-299ec7cc-2ffd-4c7a-8bb9-86eccce06fb1 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] 10.222.0.26 "GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0" status: 200 len: 1314 microversion: 2.1 time: 0.451556 Jul 11 11:29:03.991289 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 264/525] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:29:03 2022] GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0 => generated 1314 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:29:04.259500 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-b83702ea-2b48-4a9b-9fc9-6a71ef68c809 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:04.261229 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-b83702ea-2b48-4a9b-9fc9-6a71ef68c809 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:04.269573 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b83702ea-2b48-4a9b-9fc9-6a71ef68c809 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:04.270477 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b83702ea-2b48-4a9b-9fc9-6a71ef68c809 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:04.273949 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b83702ea-2b48-4a9b-9fc9-6a71ef68c809 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:04.276125 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b83702ea-2b48-4a9b-9fc9-6a71ef68c809 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:04.311586 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-542cc568-0962-4406-97e4-207d325dfdb2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:04.312514 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-542cc568-0962-4406-97e4-207d325dfdb2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:04.336875 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-542cc568-0962-4406-97e4-207d325dfdb2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:04.339031 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-542cc568-0962-4406-97e4-207d325dfdb2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:04.340616 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-542cc568-0962-4406-97e4-207d325dfdb2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:04.341076 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-542cc568-0962-4406-97e4-207d325dfdb2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:04.501155 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-b83702ea-2b48-4a9b-9fc9-6a71ef68c809 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:04.511866 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-b83702ea-2b48-4a9b-9fc9-6a71ef68c809 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:04.513342 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-b83702ea-2b48-4a9b-9fc9-6a71ef68c809 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:04.514742 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-b83702ea-2b48-4a9b-9fc9-6a71ef68c809 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1739 microversion: 2.20 time: 0.260572 Jul 11 11:29:04.515331 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 262/526] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:29:04 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1739 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:29:04.519943 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-60f836fc-7e0b-4c32-86a7-4bb48d0a87eb tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:04.520722 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-60f836fc-7e0b-4c32-86a7-4bb48d0a87eb tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:04.527073 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-60f836fc-7e0b-4c32-86a7-4bb48d0a87eb tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:04.527957 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-60f836fc-7e0b-4c32-86a7-4bb48d0a87eb tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:04.528897 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-60f836fc-7e0b-4c32-86a7-4bb48d0a87eb tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:04.529499 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-60f836fc-7e0b-4c32-86a7-4bb48d0a87eb tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:04.563330 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-542cc568-0962-4406-97e4-207d325dfdb2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:04.572208 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-542cc568-0962-4406-97e4-207d325dfdb2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1723 microversion: 2.1 time: 0.267951 Jul 11 11:29:04.572784 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 265/527] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:29:04 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1723 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:29:04.673548 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-046413b6-0f76-4781-916d-a8452fac68f8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:04.675040 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-046413b6-0f76-4781-916d-a8452fac68f8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:04.688174 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-046413b6-0f76-4781-916d-a8452fac68f8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:04.688919 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-046413b6-0f76-4781-916d-a8452fac68f8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:04.690083 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-046413b6-0f76-4781-916d-a8452fac68f8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:04.690680 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-046413b6-0f76-4781-916d-a8452fac68f8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:04.742155 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-60f836fc-7e0b-4c32-86a7-4bb48d0a87eb tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:04.750540 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-60f836fc-7e0b-4c32-86a7-4bb48d0a87eb tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1372 microversion: 2.1 time: 0.233960 Jul 11 11:29:04.760044 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 263/528] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:29:04 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1372 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:29:04.860946 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-046413b6-0f76-4781-916d-a8452fac68f8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:04.870440 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-046413b6-0f76-4781-916d-a8452fac68f8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e" status: 200 len: 1368 microversion: 2.1 time: 0.202856 Jul 11 11:29:04.871436 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 266/529] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:29:04 2022] GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e => generated 1368 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:29:05.012451 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-506dc5e7-3bcc-4a25-9be8-ca36c7c2703f tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:05.013052 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-506dc5e7-3bcc-4a25-9be8-ca36c7c2703f tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] [instance: b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:05.019862 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-506dc5e7-3bcc-4a25-9be8-ca36c7c2703f tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:05.020496 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-506dc5e7-3bcc-4a25-9be8-ca36c7c2703f tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:05.021404 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-506dc5e7-3bcc-4a25-9be8-ca36c7c2703f tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:05.022006 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-506dc5e7-3bcc-4a25-9be8-ca36c7c2703f tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:05.172189 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-506dc5e7-3bcc-4a25-9be8-ca36c7c2703f tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc29ac59eed483b8c6443c397505adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890e7e79ff744b6b9589f166cd7d8979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:05.179043 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-506dc5e7-3bcc-4a25-9be8-ca36c7c2703f tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] 10.222.0.26 "GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0" status: 200 len: 1314 microversion: 2.1 time: 0.170252 Jul 11 11:29:05.188960 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 264/530] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:29:05 2022] GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:29:05.533662 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-639070d3-7ae1-461d-9c15-26b8554a0093 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:05.534328 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-639070d3-7ae1-461d-9c15-26b8554a0093 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:05.541185 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-639070d3-7ae1-461d-9c15-26b8554a0093 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:05.541630 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-639070d3-7ae1-461d-9c15-26b8554a0093 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:05.542399 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-639070d3-7ae1-461d-9c15-26b8554a0093 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:05.542835 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-639070d3-7ae1-461d-9c15-26b8554a0093 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:05.589618 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-dca64984-b710-4f60-bf5f-22afa05216a0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:05.590255 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-dca64984-b710-4f60-bf5f-22afa05216a0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:05.596776 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-dca64984-b710-4f60-bf5f-22afa05216a0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:05.597217 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-dca64984-b710-4f60-bf5f-22afa05216a0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:05.597978 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-dca64984-b710-4f60-bf5f-22afa05216a0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:05.598685 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-dca64984-b710-4f60-bf5f-22afa05216a0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:05.685428 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-639070d3-7ae1-461d-9c15-26b8554a0093 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:05.695647 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-639070d3-7ae1-461d-9c15-26b8554a0093 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:05.697329 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-639070d3-7ae1-461d-9c15-26b8554a0093 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:05.698507 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-639070d3-7ae1-461d-9c15-26b8554a0093 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1739 microversion: 2.20 time: 0.169150 Jul 11 11:29:05.699137 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 267/531] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:29:05 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1739 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:29:05.740204 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-dca64984-b710-4f60-bf5f-22afa05216a0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:05.748980 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-dca64984-b710-4f60-bf5f-22afa05216a0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1723 microversion: 2.1 time: 0.163326 Jul 11 11:29:05.749575 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 265/532] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:29:05 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:29:05.766959 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-42eaccc0-c255-49b1-abca-03eaa6fb54e3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:05.767602 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-42eaccc0-c255-49b1-abca-03eaa6fb54e3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:05.773678 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-42eaccc0-c255-49b1-abca-03eaa6fb54e3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:05.774115 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-42eaccc0-c255-49b1-abca-03eaa6fb54e3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:05.774864 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-42eaccc0-c255-49b1-abca-03eaa6fb54e3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:05.775314 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-42eaccc0-c255-49b1-abca-03eaa6fb54e3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:05.887686 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-4b7cfdca-6fe7-448f-8c56-5e4138778c47 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:05.888308 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-4b7cfdca-6fe7-448f-8c56-5e4138778c47 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:05.894504 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4b7cfdca-6fe7-448f-8c56-5e4138778c47 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:05.894953 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4b7cfdca-6fe7-448f-8c56-5e4138778c47 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:05.895773 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4b7cfdca-6fe7-448f-8c56-5e4138778c47 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:05.896198 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4b7cfdca-6fe7-448f-8c56-5e4138778c47 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:05.901524 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-42eaccc0-c255-49b1-abca-03eaa6fb54e3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:05.903920 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=100 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:29:05.909904 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-42eaccc0-c255-49b1-abca-03eaa6fb54e3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1372 microversion: 2.1 time: 0.146666 Jul 11 11:29:05.910565 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 268/533] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:29:05 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1372 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:29:06.043591 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-4b7cfdca-6fe7-448f-8c56-5e4138778c47 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:06.059996 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-4b7cfdca-6fe7-448f-8c56-5e4138778c47 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e" status: 200 len: 1368 microversion: 2.1 time: 0.171532 Jul 11 11:29:06.061190 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 266/534] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:29:05 2022] GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e => generated 1368 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:29:06.196438 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-81049261-ad62-4d67-bd0b-db026cdba46c tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:06.197591 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-81049261-ad62-4d67-bd0b-db026cdba46c tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] [instance: b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:06.204214 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-81049261-ad62-4d67-bd0b-db026cdba46c tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:06.204659 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-81049261-ad62-4d67-bd0b-db026cdba46c tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:06.205419 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-81049261-ad62-4d67-bd0b-db026cdba46c tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:06.205845 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-81049261-ad62-4d67-bd0b-db026cdba46c tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:06.383832 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-81049261-ad62-4d67-bd0b-db026cdba46c tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc29ac59eed483b8c6443c397505adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890e7e79ff744b6b9589f166cd7d8979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:06.391525 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-81049261-ad62-4d67-bd0b-db026cdba46c tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] 10.222.0.26 "GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0" status: 200 len: 1314 microversion: 2.1 time: 0.198971 Jul 11 11:29:06.392397 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 269/535] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:29:06 2022] GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0 => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:29:06.717536 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-442cb950-806d-4635-919e-868d15e253e2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:06.718553 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-442cb950-806d-4635-919e-868d15e253e2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:06.725899 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-442cb950-806d-4635-919e-868d15e253e2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:06.726781 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-442cb950-806d-4635-919e-868d15e253e2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:06.727814 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-442cb950-806d-4635-919e-868d15e253e2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:06.728481 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-442cb950-806d-4635-919e-868d15e253e2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:06.767243 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-947a6ff9-25d9-4a62-a686-4f5f2603c8f0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:06.768469 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-947a6ff9-25d9-4a62-a686-4f5f2603c8f0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:06.782765 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-947a6ff9-25d9-4a62-a686-4f5f2603c8f0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:06.786544 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-947a6ff9-25d9-4a62-a686-4f5f2603c8f0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:06.787925 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-947a6ff9-25d9-4a62-a686-4f5f2603c8f0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:06.788631 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-947a6ff9-25d9-4a62-a686-4f5f2603c8f0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:07.019188 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-442cb950-806d-4635-919e-868d15e253e2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:07.028759 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-442cb950-806d-4635-919e-868d15e253e2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:07.037094 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-442cb950-806d-4635-919e-868d15e253e2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:07.039149 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-442cb950-806d-4635-919e-868d15e253e2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1739 microversion: 2.20 time: 0.324929 Jul 11 11:29:07.050768 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 267/536] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:29:06 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1739 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:29:07.060299 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-17683c5b-321d-4d65-829a-8222f60c968b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:07.060937 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-17683c5b-321d-4d65-829a-8222f60c968b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:07.080475 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-17683c5b-321d-4d65-829a-8222f60c968b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:07.080960 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-17683c5b-321d-4d65-829a-8222f60c968b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:07.081746 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-17683c5b-321d-4d65-829a-8222f60c968b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:07.082186 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-17683c5b-321d-4d65-829a-8222f60c968b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:07.451582 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-17683c5b-321d-4d65-829a-8222f60c968b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:07.464148 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-17683c5b-321d-4d65-829a-8222f60c968b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1372 microversion: 2.1 time: 0.419265 Jul 11 11:29:07.468688 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 268/537] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:29:07 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1372 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:29:07.482198 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-72a7b34c-f49f-411b-99d3-048531e3f40c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:07.482824 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-72a7b34c-f49f-411b-99d3-048531e3f40c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:07.489112 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-72a7b34c-f49f-411b-99d3-048531e3f40c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:07.489564 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-72a7b34c-f49f-411b-99d3-048531e3f40c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:07.490338 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-72a7b34c-f49f-411b-99d3-048531e3f40c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:07.490769 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-72a7b34c-f49f-411b-99d3-048531e3f40c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:07.540788 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-947a6ff9-25d9-4a62-a686-4f5f2603c8f0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:07.556951 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-947a6ff9-25d9-4a62-a686-4f5f2603c8f0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1723 microversion: 2.1 time: 0.794580 Jul 11 11:29:07.557732 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 270/538] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:29:06 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1723 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:29:07.570570 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-caf24b44-645a-4752-8e11-ba711a705885 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:07.571161 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-caf24b44-645a-4752-8e11-ba711a705885 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] [instance: b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:07.581361 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-caf24b44-645a-4752-8e11-ba711a705885 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:07.581805 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-caf24b44-645a-4752-8e11-ba711a705885 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:07.582576 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-caf24b44-645a-4752-8e11-ba711a705885 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:07.583009 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-caf24b44-645a-4752-8e11-ba711a705885 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:07.681994 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-72a7b34c-f49f-411b-99d3-048531e3f40c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:07.691745 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-72a7b34c-f49f-411b-99d3-048531e3f40c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e" status: 200 len: 1368 microversion: 2.1 time: 0.220375 Jul 11 11:29:07.692244 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 269/539] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:29:07 2022] GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e => generated 1368 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:29:07.831182 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-caf24b44-645a-4752-8e11-ba711a705885 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc29ac59eed483b8c6443c397505adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890e7e79ff744b6b9589f166cd7d8979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:07.844752 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-caf24b44-645a-4752-8e11-ba711a705885 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] 10.222.0.26 "GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0" status: 200 len: 1314 microversion: 2.1 time: 0.286049 Jul 11 11:29:07.846911 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 271/540] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:29:07 2022] GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0 => generated 1314 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:29:08.059830 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-8b4dbbd1-a3d3-4fd5-a102-92e46928e9de tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:08.060364 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-8b4dbbd1-a3d3-4fd5-a102-92e46928e9de tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:08.074870 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8b4dbbd1-a3d3-4fd5-a102-92e46928e9de tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:08.078541 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8b4dbbd1-a3d3-4fd5-a102-92e46928e9de tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:08.081252 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8b4dbbd1-a3d3-4fd5-a102-92e46928e9de tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:08.087759 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8b4dbbd1-a3d3-4fd5-a102-92e46928e9de tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:08.287168 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [req-a6db4db7-20d8-4cbd-b30c-89bacab4a6f9 req-251fc708-e9a6-4fdb-8119-0bdb4f703fa6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6", "tag": "21e04d85-904d-403f-aac1-fe7bfdc5fbb9"}]} {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:29:08.310121 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [req-a6db4db7-20d8-4cbd-b30c-89bacab4a6f9 req-251fc708-e9a6-4fdb-8119-0bdb4f703fa6 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:08.311488 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [req-a6db4db7-20d8-4cbd-b30c-89bacab4a6f9 req-251fc708-e9a6-4fdb-8119-0bdb4f703fa6 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:08.330282 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-8b4dbbd1-a3d3-4fd5-a102-92e46928e9de tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:08.340628 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-8b4dbbd1-a3d3-4fd5-a102-92e46928e9de tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:08.343072 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-8b4dbbd1-a3d3-4fd5-a102-92e46928e9de tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:08.346377 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-8b4dbbd1-a3d3-4fd5-a102-92e46928e9de tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1739 microversion: 2.20 time: 0.291988 Jul 11 11:29:08.347606 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 270/541] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:29:08 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1739 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:29:08.359907 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.compute.server_external_events [req-a6db4db7-20d8-4cbd-b30c-89bacab4a6f9 req-251fc708-e9a6-4fdb-8119-0bdb4f703fa6 service nova] Creating event network-changed:21e04d85-904d-403f-aac1-fe7bfdc5fbb9 for instance 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 on hv-cinder-84842 Jul 11 11:29:08.380412 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [req-a6db4db7-20d8-4cbd-b30c-89bacab4a6f9 req-251fc708-e9a6-4fdb-8119-0bdb4f703fa6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103406 Jul 11 11:29:08.381811 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 272/542] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 11:29:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:29:08.486255 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-a4f6a904-9e90-4acd-b287-d1d70520eb4b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:08.487039 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-a4f6a904-9e90-4acd-b287-d1d70520eb4b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:08.498461 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a4f6a904-9e90-4acd-b287-d1d70520eb4b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:08.498750 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a4f6a904-9e90-4acd-b287-d1d70520eb4b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:08.502786 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a4f6a904-9e90-4acd-b287-d1d70520eb4b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:08.504678 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a4f6a904-9e90-4acd-b287-d1d70520eb4b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:08.530315 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:29:08.574551 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-be13e7e2-5750-4b7e-a454-2b8b792ae2f2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:08.576002 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-be13e7e2-5750-4b7e-a454-2b8b792ae2f2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:08.606527 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-be13e7e2-5750-4b7e-a454-2b8b792ae2f2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:08.607223 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-be13e7e2-5750-4b7e-a454-2b8b792ae2f2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:08.608620 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-be13e7e2-5750-4b7e-a454-2b8b792ae2f2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:08.609631 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-be13e7e2-5750-4b7e-a454-2b8b792ae2f2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:08.734418 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-a4f6a904-9e90-4acd-b287-d1d70520eb4b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:08.745497 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-a4f6a904-9e90-4acd-b287-d1d70520eb4b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1372 microversion: 2.1 time: 0.264000 Jul 11 11:29:08.746108 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 271/543] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:29:08 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1372 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:29:08.762807 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-5e5af627-68d2-4792-a751-751e60837e94 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:08.763466 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-5e5af627-68d2-4792-a751-751e60837e94 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:08.769921 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5e5af627-68d2-4792-a751-751e60837e94 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:08.770364 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5e5af627-68d2-4792-a751-751e60837e94 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:08.777104 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5e5af627-68d2-4792-a751-751e60837e94 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:08.777808 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5e5af627-68d2-4792-a751-751e60837e94 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:08.880105 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-be13e7e2-5750-4b7e-a454-2b8b792ae2f2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:08.892572 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-be13e7e2-5750-4b7e-a454-2b8b792ae2f2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1723 microversion: 2.1 time: 0.322188 Jul 11 11:29:08.894807 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 273/544] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:29:08 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1723 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:29:08.899770 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-99b2dd44-6f8e-4d2b-be21-8ee94eec9dab tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:08.900367 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-99b2dd44-6f8e-4d2b-be21-8ee94eec9dab tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] [instance: b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:08.915875 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-99b2dd44-6f8e-4d2b-be21-8ee94eec9dab tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:08.916569 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-99b2dd44-6f8e-4d2b-be21-8ee94eec9dab tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:08.921906 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-99b2dd44-6f8e-4d2b-be21-8ee94eec9dab tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:08.921906 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-99b2dd44-6f8e-4d2b-be21-8ee94eec9dab tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:08.956096 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-5e5af627-68d2-4792-a751-751e60837e94 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:08.960938 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-5e5af627-68d2-4792-a751-751e60837e94 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e" status: 200 len: 1368 microversion: 2.1 time: 0.213728 Jul 11 11:29:08.961811 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 272/545] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:29:08 2022] GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e => generated 1368 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:29:09.157277 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-99b2dd44-6f8e-4d2b-be21-8ee94eec9dab tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc29ac59eed483b8c6443c397505adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890e7e79ff744b6b9589f166cd7d8979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:09.166512 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-99b2dd44-6f8e-4d2b-be21-8ee94eec9dab tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] 10.222.0.26 "GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0" status: 200 len: 1314 microversion: 2.1 time: 0.270381 Jul 11 11:29:09.167077 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 274/546] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:29:08 2022] GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0 => generated 1314 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:29:09.365544 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-0054a472-172a-4a43-89c1-5df06621672e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:09.366237 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-0054a472-172a-4a43-89c1-5df06621672e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:09.388333 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0054a472-172a-4a43-89c1-5df06621672e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:09.388784 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0054a472-172a-4a43-89c1-5df06621672e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:09.389572 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0054a472-172a-4a43-89c1-5df06621672e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:09.390017 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0054a472-172a-4a43-89c1-5df06621672e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:09.558617 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-0054a472-172a-4a43-89c1-5df06621672e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:09.568438 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-0054a472-172a-4a43-89c1-5df06621672e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:09.569959 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-0054a472-172a-4a43-89c1-5df06621672e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:09.571735 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-0054a472-172a-4a43-89c1-5df06621672e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1739 microversion: 2.20 time: 0.210066 Jul 11 11:29:09.572312 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 273/547] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:29:09 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1739 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:29:09.762544 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-00c2ced9-2b21-4fc3-937e-c7143b104ec4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:09.763088 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-00c2ced9-2b21-4fc3-937e-c7143b104ec4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:09.769366 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-00c2ced9-2b21-4fc3-937e-c7143b104ec4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:09.769816 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-00c2ced9-2b21-4fc3-937e-c7143b104ec4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:09.770576 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-00c2ced9-2b21-4fc3-937e-c7143b104ec4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:09.771077 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-00c2ced9-2b21-4fc3-937e-c7143b104ec4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:09.911244 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-3a7559de-6fb9-4f0f-80a8-aa2d8514a408 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:09.911788 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-3a7559de-6fb9-4f0f-80a8-aa2d8514a408 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:09.913640 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-00c2ced9-2b21-4fc3-937e-c7143b104ec4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:09.918667 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3a7559de-6fb9-4f0f-80a8-aa2d8514a408 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:09.919123 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3a7559de-6fb9-4f0f-80a8-aa2d8514a408 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:09.919944 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3a7559de-6fb9-4f0f-80a8-aa2d8514a408 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:09.920380 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3a7559de-6fb9-4f0f-80a8-aa2d8514a408 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:09.927795 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-00c2ced9-2b21-4fc3-937e-c7143b104ec4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1372 microversion: 2.1 time: 0.169098 Jul 11 11:29:09.928394 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 275/548] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:29:09 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1372 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:29:09.978352 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-a6a6b503-a9d0-4dec-a775-68a7b6888f39 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:09.978962 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-a6a6b503-a9d0-4dec-a775-68a7b6888f39 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:09.985757 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a6a6b503-a9d0-4dec-a775-68a7b6888f39 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:09.986359 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a6a6b503-a9d0-4dec-a775-68a7b6888f39 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:09.987333 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a6a6b503-a9d0-4dec-a775-68a7b6888f39 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:09.987763 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a6a6b503-a9d0-4dec-a775-68a7b6888f39 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:10.074104 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-3a7559de-6fb9-4f0f-80a8-aa2d8514a408 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:10.085033 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-3a7559de-6fb9-4f0f-80a8-aa2d8514a408 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1723 microversion: 2.1 time: 0.177856 Jul 11 11:29:10.086144 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 274/549] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:29:09 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:29:10.130613 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-a6a6b503-a9d0-4dec-a775-68a7b6888f39 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:10.138131 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-a6a6b503-a9d0-4dec-a775-68a7b6888f39 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e" status: 200 len: 1368 microversion: 2.1 time: 0.164148 Jul 11 11:29:10.138708 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 276/550] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:29:09 2022] GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:29:10.183528 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-be2637cb-91cb-4da0-b26f-0bfae08a2886 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:10.184141 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-be2637cb-91cb-4da0-b26f-0bfae08a2886 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] [instance: b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:10.190214 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-be2637cb-91cb-4da0-b26f-0bfae08a2886 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:10.190660 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-be2637cb-91cb-4da0-b26f-0bfae08a2886 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:10.191482 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-be2637cb-91cb-4da0-b26f-0bfae08a2886 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:10.191918 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-be2637cb-91cb-4da0-b26f-0bfae08a2886 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:10.338947 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-be2637cb-91cb-4da0-b26f-0bfae08a2886 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc29ac59eed483b8c6443c397505adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890e7e79ff744b6b9589f166cd7d8979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:10.348828 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-be2637cb-91cb-4da0-b26f-0bfae08a2886 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] 10.222.0.26 "GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0" status: 200 len: 1314 microversion: 2.1 time: 0.169333 Jul 11 11:29:10.360356 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 275/551] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:29:10 2022] GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:29:10.503220 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [req-0d760567-523d-4891-9156-b129de72dca3 req-3cd3623d-f931-4b61-b02f-91eb0f9e4b2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0", "name": "network-vif-plugged", "status": "completed", "tag": "c667a1ab-f4f0-43bf-aa75-4bd7508e68f9"}]} {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:29:10.514685 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [req-0d760567-523d-4891-9156-b129de72dca3 req-3cd3623d-f931-4b61-b02f-91eb0f9e4b2b service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:10.515312 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [req-0d760567-523d-4891-9156-b129de72dca3 req-3cd3623d-f931-4b61-b02f-91eb0f9e4b2b service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:10.527326 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.compute.server_external_events [req-0d760567-523d-4891-9156-b129de72dca3 req-3cd3623d-f931-4b61-b02f-91eb0f9e4b2b service nova] Creating event network-vif-plugged:c667a1ab-f4f0-43bf-aa75-4bd7508e68f9 for instance b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0 on hv-cinder-84842 Jul 11 11:29:10.533651 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [req-0d760567-523d-4891-9156-b129de72dca3 req-3cd3623d-f931-4b61-b02f-91eb0f9e4b2b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034796 Jul 11 11:29:10.534967 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 277/552] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 11:29:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:29:10.591959 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-ca9cf09d-3688-4bb6-b6b9-98df7e7a7948 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:10.593278 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-ca9cf09d-3688-4bb6-b6b9-98df7e7a7948 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:10.633110 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ca9cf09d-3688-4bb6-b6b9-98df7e7a7948 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:10.633829 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ca9cf09d-3688-4bb6-b6b9-98df7e7a7948 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:10.634858 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ca9cf09d-3688-4bb6-b6b9-98df7e7a7948 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:10.641292 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ca9cf09d-3688-4bb6-b6b9-98df7e7a7948 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:10.893934 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-ca9cf09d-3688-4bb6-b6b9-98df7e7a7948 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:10.909711 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-ca9cf09d-3688-4bb6-b6b9-98df7e7a7948 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:10.911706 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-ca9cf09d-3688-4bb6-b6b9-98df7e7a7948 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:10.913078 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-ca9cf09d-3688-4bb6-b6b9-98df7e7a7948 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1739 microversion: 2.20 time: 0.324918 Jul 11 11:29:10.913645 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 276/553] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:29:10 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1739 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:29:10.949136 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-f9945eba-5e7b-4d67-9056-b139a5011a85 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:10.949923 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-f9945eba-5e7b-4d67-9056-b139a5011a85 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:10.956923 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f9945eba-5e7b-4d67-9056-b139a5011a85 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:10.957369 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f9945eba-5e7b-4d67-9056-b139a5011a85 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:10.958140 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f9945eba-5e7b-4d67-9056-b139a5011a85 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:10.958750 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f9945eba-5e7b-4d67-9056-b139a5011a85 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:11.103545 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-a426f3f7-adfd-4ad0-b137-c1d8a6154f6f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:11.104833 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-a426f3f7-adfd-4ad0-b137-c1d8a6154f6f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:11.112858 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a426f3f7-adfd-4ad0-b137-c1d8a6154f6f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:11.114401 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a426f3f7-adfd-4ad0-b137-c1d8a6154f6f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:11.115610 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a426f3f7-adfd-4ad0-b137-c1d8a6154f6f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:11.116336 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a426f3f7-adfd-4ad0-b137-c1d8a6154f6f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:11.122434 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-f9945eba-5e7b-4d67-9056-b139a5011a85 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:11.131311 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-f9945eba-5e7b-4d67-9056-b139a5011a85 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1372 microversion: 2.1 time: 0.188647 Jul 11 11:29:11.140529 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 278/554] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:29:10 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1372 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:29:11.160921 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-ed5a7c03-1b93-415c-8eaa-03a022f0eef5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:11.162101 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-ed5a7c03-1b93-415c-8eaa-03a022f0eef5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:11.169682 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ed5a7c03-1b93-415c-8eaa-03a022f0eef5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:11.170573 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ed5a7c03-1b93-415c-8eaa-03a022f0eef5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:11.171561 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ed5a7c03-1b93-415c-8eaa-03a022f0eef5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:11.172327 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ed5a7c03-1b93-415c-8eaa-03a022f0eef5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:11.268250 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-a426f3f7-adfd-4ad0-b137-c1d8a6154f6f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:11.277450 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-a426f3f7-adfd-4ad0-b137-c1d8a6154f6f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1723 microversion: 2.1 time: 0.179329 Jul 11 11:29:11.287435 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 277/555] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:29:11 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:29:11.333878 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-ed5a7c03-1b93-415c-8eaa-03a022f0eef5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:11.341645 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-ed5a7c03-1b93-415c-8eaa-03a022f0eef5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e" status: 200 len: 1368 microversion: 2.1 time: 0.184726 Jul 11 11:29:11.342640 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 279/556] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:29:11 2022] GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e => generated 1368 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:29:11.366120 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-8994fae4-508d-45d9-9fd7-50ee7ad81ce2 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:11.367678 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-8994fae4-508d-45d9-9fd7-50ee7ad81ce2 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] [instance: b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:11.373836 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8994fae4-508d-45d9-9fd7-50ee7ad81ce2 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:11.374289 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8994fae4-508d-45d9-9fd7-50ee7ad81ce2 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:11.375053 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8994fae4-508d-45d9-9fd7-50ee7ad81ce2 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:11.375521 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8994fae4-508d-45d9-9fd7-50ee7ad81ce2 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:11.517172 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-8994fae4-508d-45d9-9fd7-50ee7ad81ce2 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc29ac59eed483b8c6443c397505adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890e7e79ff744b6b9589f166cd7d8979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:11.524722 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-8994fae4-508d-45d9-9fd7-50ee7ad81ce2 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] 10.222.0.26 "GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0" status: 200 len: 1314 microversion: 2.1 time: 0.162543 Jul 11 11:29:11.525287 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 278/557] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:29:11 2022] GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:29:11.932261 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-8e2c78b7-b037-4e6d-bcd9-24ec83bfde24 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:11.932856 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-8e2c78b7-b037-4e6d-bcd9-24ec83bfde24 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:11.938859 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8e2c78b7-b037-4e6d-bcd9-24ec83bfde24 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:11.939306 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8e2c78b7-b037-4e6d-bcd9-24ec83bfde24 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:11.940064 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8e2c78b7-b037-4e6d-bcd9-24ec83bfde24 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:11.940495 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8e2c78b7-b037-4e6d-bcd9-24ec83bfde24 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:12.074640 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-8e2c78b7-b037-4e6d-bcd9-24ec83bfde24 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:12.082600 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-8e2c78b7-b037-4e6d-bcd9-24ec83bfde24 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:12.084169 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-8e2c78b7-b037-4e6d-bcd9-24ec83bfde24 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:12.085315 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-8e2c78b7-b037-4e6d-bcd9-24ec83bfde24 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1739 microversion: 2.20 time: 0.157269 Jul 11 11:29:12.085878 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 280/558] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:29:11 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1739 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:29:12.147861 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-75410759-2441-4c96-b8b0-c580bb0d6387 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:12.149155 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-75410759-2441-4c96-b8b0-c580bb0d6387 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:12.160770 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-75410759-2441-4c96-b8b0-c580bb0d6387 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:12.161223 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-75410759-2441-4c96-b8b0-c580bb0d6387 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:12.161988 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-75410759-2441-4c96-b8b0-c580bb0d6387 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:12.162419 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-75410759-2441-4c96-b8b0-c580bb0d6387 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:12.295850 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-1282e1f5-4913-4fe1-a6ef-d61e247fe9c3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:12.296650 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-1282e1f5-4913-4fe1-a6ef-d61e247fe9c3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:12.301113 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-75410759-2441-4c96-b8b0-c580bb0d6387 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:12.302866 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1282e1f5-4913-4fe1-a6ef-d61e247fe9c3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:12.303346 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1282e1f5-4913-4fe1-a6ef-d61e247fe9c3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:12.305277 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1282e1f5-4913-4fe1-a6ef-d61e247fe9c3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:12.305277 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1282e1f5-4913-4fe1-a6ef-d61e247fe9c3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:12.310824 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-75410759-2441-4c96-b8b0-c580bb0d6387 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1372 microversion: 2.1 time: 0.166516 Jul 11 11:29:12.311447 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 279/559] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:29:12 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1372 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:29:12.358131 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-600f3b3f-ef75-4632-8ccb-39f6535514bb tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:12.358604 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-600f3b3f-ef75-4632-8ccb-39f6535514bb tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:12.364665 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-600f3b3f-ef75-4632-8ccb-39f6535514bb tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:12.365108 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-600f3b3f-ef75-4632-8ccb-39f6535514bb tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:12.365899 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-600f3b3f-ef75-4632-8ccb-39f6535514bb tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:12.366317 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-600f3b3f-ef75-4632-8ccb-39f6535514bb tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:12.438950 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-1282e1f5-4913-4fe1-a6ef-d61e247fe9c3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:12.447734 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-1282e1f5-4913-4fe1-a6ef-d61e247fe9c3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1723 microversion: 2.1 time: 0.156168 Jul 11 11:29:12.448304 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 281/560] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:29:12 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:29:12.506585 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-600f3b3f-ef75-4632-8ccb-39f6535514bb tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:12.521007 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-600f3b3f-ef75-4632-8ccb-39f6535514bb tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e" status: 200 len: 1368 microversion: 2.1 time: 0.166887 Jul 11 11:29:12.521578 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 280/561] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:29:12 2022] GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e => generated 1368 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:29:12.545488 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-795d4ebb-f75b-4ff0-8b60-2611a85e5668 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:12.546103 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-795d4ebb-f75b-4ff0-8b60-2611a85e5668 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] [instance: b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:12.552999 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-795d4ebb-f75b-4ff0-8b60-2611a85e5668 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:12.554191 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [req-744b5638-4c23-4867-be12-0a08eb72468e req-4cc76120-d53e-447c-8375-ef4371cebda4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e", "name": "network-vif-plugged", "status": "completed", "tag": "14c018a2-6bb9-4f49-bd4c-0dfd7f207193"}]} {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:29:12.555237 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-795d4ebb-f75b-4ff0-8b60-2611a85e5668 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:12.556209 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-795d4ebb-f75b-4ff0-8b60-2611a85e5668 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:12.556504 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-795d4ebb-f75b-4ff0-8b60-2611a85e5668 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:12.563135 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [req-744b5638-4c23-4867-be12-0a08eb72468e req-4cc76120-d53e-447c-8375-ef4371cebda4 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:12.563626 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [req-744b5638-4c23-4867-be12-0a08eb72468e req-4cc76120-d53e-447c-8375-ef4371cebda4 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:12.574764 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.compute.server_external_events [req-744b5638-4c23-4867-be12-0a08eb72468e req-4cc76120-d53e-447c-8375-ef4371cebda4 service nova] Creating event network-vif-plugged:14c018a2-6bb9-4f49-bd4c-0dfd7f207193 for instance 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e on hv-cinder-84842 Jul 11 11:29:12.580253 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [req-744b5638-4c23-4867-be12-0a08eb72468e req-4cc76120-d53e-447c-8375-ef4371cebda4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033621 Jul 11 11:29:12.580960 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 281/562] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 11:29:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:29:12.691161 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-795d4ebb-f75b-4ff0-8b60-2611a85e5668 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc29ac59eed483b8c6443c397505adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890e7e79ff744b6b9589f166cd7d8979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:12.698538 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-795d4ebb-f75b-4ff0-8b60-2611a85e5668 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] 10.222.0.26 "GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0" status: 200 len: 1499 microversion: 2.1 time: 0.157363 Jul 11 11:29:12.699092 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 282/563] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:29:12 2022] GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0 => generated 1499 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:29:13.104751 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-4bec8422-960d-41b6-9938-f5bef4acf80f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:13.105430 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-4bec8422-960d-41b6-9938-f5bef4acf80f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:13.111538 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4bec8422-960d-41b6-9938-f5bef4acf80f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:13.111988 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4bec8422-960d-41b6-9938-f5bef4acf80f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:13.112754 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4bec8422-960d-41b6-9938-f5bef4acf80f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:13.113282 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4bec8422-960d-41b6-9938-f5bef4acf80f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:13.259787 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-4bec8422-960d-41b6-9938-f5bef4acf80f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:13.268503 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-4bec8422-960d-41b6-9938-f5bef4acf80f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:13.270059 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-4bec8422-960d-41b6-9938-f5bef4acf80f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:13.271219 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-4bec8422-960d-41b6-9938-f5bef4acf80f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1721 microversion: 2.20 time: 0.171391 Jul 11 11:29:13.271821 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 282/564] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:29:13 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:29:13.327889 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-5af2b6d7-ef68-4bf9-b738-e8fbd183c3d9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:13.328766 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-5af2b6d7-ef68-4bf9-b738-e8fbd183c3d9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:13.336988 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5af2b6d7-ef68-4bf9-b738-e8fbd183c3d9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:13.337483 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5af2b6d7-ef68-4bf9-b738-e8fbd183c3d9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:13.338276 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5af2b6d7-ef68-4bf9-b738-e8fbd183c3d9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:13.338707 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5af2b6d7-ef68-4bf9-b738-e8fbd183c3d9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:13.466289 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-896ea235-690f-4225-9676-bac48d51e378 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:13.467171 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-896ea235-690f-4225-9676-bac48d51e378 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:13.473518 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-896ea235-690f-4225-9676-bac48d51e378 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:13.473877 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-896ea235-690f-4225-9676-bac48d51e378 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:13.474802 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-896ea235-690f-4225-9676-bac48d51e378 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:13.475447 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-896ea235-690f-4225-9676-bac48d51e378 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:13.516299 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-5af2b6d7-ef68-4bf9-b738-e8fbd183c3d9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:13.525685 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-5af2b6d7-ef68-4bf9-b738-e8fbd183c3d9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1372 microversion: 2.1 time: 0.201508 Jul 11 11:29:13.526434 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 283/565] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:29:13 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1372 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:29:13.539383 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-b0771f4b-f44e-47f3-9be4-83cfd7951dbe tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:13.539995 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-b0771f4b-f44e-47f3-9be4-83cfd7951dbe tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:13.546133 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b0771f4b-f44e-47f3-9be4-83cfd7951dbe tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:13.546642 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b0771f4b-f44e-47f3-9be4-83cfd7951dbe tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:13.547642 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b0771f4b-f44e-47f3-9be4-83cfd7951dbe tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:13.548095 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b0771f4b-f44e-47f3-9be4-83cfd7951dbe tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:13.613261 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-896ea235-690f-4225-9676-bac48d51e378 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:13.622611 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-896ea235-690f-4225-9676-bac48d51e378 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1723 microversion: 2.1 time: 0.160005 Jul 11 11:29:13.623362 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 283/566] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:29:13 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:29:13.678795 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-b0771f4b-f44e-47f3-9be4-83cfd7951dbe tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:13.687037 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-b0771f4b-f44e-47f3-9be4-83cfd7951dbe tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e" status: 200 len: 1368 microversion: 2.1 time: 0.151685 Jul 11 11:29:13.687643 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 284/567] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:29:13 2022] GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:29:14.290847 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-bd6379b5-3287-4376-a7e3-19f1539a5326 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:14.291585 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-bd6379b5-3287-4376-a7e3-19f1539a5326 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:14.298079 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-bd6379b5-3287-4376-a7e3-19f1539a5326 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:14.298531 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-bd6379b5-3287-4376-a7e3-19f1539a5326 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:14.299332 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-bd6379b5-3287-4376-a7e3-19f1539a5326 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:14.299771 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-bd6379b5-3287-4376-a7e3-19f1539a5326 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:14.429859 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-bd6379b5-3287-4376-a7e3-19f1539a5326 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:14.438301 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-bd6379b5-3287-4376-a7e3-19f1539a5326 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:14.439898 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-bd6379b5-3287-4376-a7e3-19f1539a5326 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:14.441120 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-bd6379b5-3287-4376-a7e3-19f1539a5326 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1721 microversion: 2.20 time: 0.154647 Jul 11 11:29:14.441731 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 284/568] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:29:14 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:29:14.542189 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-bd56751a-3459-4c9e-b9ed-96e45c52716a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:14.542816 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-bd56751a-3459-4c9e-b9ed-96e45c52716a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:14.549925 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bd56751a-3459-4c9e-b9ed-96e45c52716a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:14.550379 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bd56751a-3459-4c9e-b9ed-96e45c52716a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:14.551171 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bd56751a-3459-4c9e-b9ed-96e45c52716a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:14.551620 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bd56751a-3459-4c9e-b9ed-96e45c52716a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:14.594893 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [req-81531e0b-2d1a-4d1f-877e-73e9d53b2f6d req-a10311d3-c4c9-4e88-9c7d-8ff9fb19b2aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6", "name": "network-vif-plugged", "status": "completed", "tag": "21e04d85-904d-403f-aac1-fe7bfdc5fbb9"}]} {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:29:14.602869 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [req-81531e0b-2d1a-4d1f-877e-73e9d53b2f6d req-a10311d3-c4c9-4e88-9c7d-8ff9fb19b2aa service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:14.603341 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [req-81531e0b-2d1a-4d1f-877e-73e9d53b2f6d req-a10311d3-c4c9-4e88-9c7d-8ff9fb19b2aa service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:14.615129 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.compute.server_external_events [req-81531e0b-2d1a-4d1f-877e-73e9d53b2f6d req-a10311d3-c4c9-4e88-9c7d-8ff9fb19b2aa service nova] Creating event network-vif-plugged:21e04d85-904d-403f-aac1-fe7bfdc5fbb9 for instance 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 on hv-cinder-84842 Jul 11 11:29:14.620677 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [req-81531e0b-2d1a-4d1f-877e-73e9d53b2f6d req-a10311d3-c4c9-4e88-9c7d-8ff9fb19b2aa service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029303 Jul 11 11:29:14.621427 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 285/569] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 11:29:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:29:14.640242 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-0e4433e0-041a-46d6-a2ef-4b27d6212102 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:14.640942 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-0e4433e0-041a-46d6-a2ef-4b27d6212102 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:14.647131 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0e4433e0-041a-46d6-a2ef-4b27d6212102 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:14.647619 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0e4433e0-041a-46d6-a2ef-4b27d6212102 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:14.648389 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0e4433e0-041a-46d6-a2ef-4b27d6212102 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:14.648826 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0e4433e0-041a-46d6-a2ef-4b27d6212102 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:14.682544 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-bd56751a-3459-4c9e-b9ed-96e45c52716a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:14.689982 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-bd56751a-3459-4c9e-b9ed-96e45c52716a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1372 microversion: 2.1 time: 0.152148 Jul 11 11:29:14.690567 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 285/570] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:29:14 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1372 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:29:14.703923 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-b347e5e8-3746-4d1b-b97c-ec68d941cc49 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:14.704606 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-b347e5e8-3746-4d1b-b97c-ec68d941cc49 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:14.710459 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b347e5e8-3746-4d1b-b97c-ec68d941cc49 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:14.710911 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b347e5e8-3746-4d1b-b97c-ec68d941cc49 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:14.711703 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b347e5e8-3746-4d1b-b97c-ec68d941cc49 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:14.712132 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b347e5e8-3746-4d1b-b97c-ec68d941cc49 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:14.779468 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-0e4433e0-041a-46d6-a2ef-4b27d6212102 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:14.787313 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-0e4433e0-041a-46d6-a2ef-4b27d6212102 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1723 microversion: 2.1 time: 0.151130 Jul 11 11:29:14.787942 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 286/571] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:29:14 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:29:14.842513 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-b347e5e8-3746-4d1b-b97c-ec68d941cc49 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:14.844808 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=100 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:29:14.850574 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-b347e5e8-3746-4d1b-b97c-ec68d941cc49 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e" status: 200 len: 1368 microversion: 2.1 time: 0.150311 Jul 11 11:29:14.851140 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 286/572] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:29:14 2022] GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:29:15.459278 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-5c159e96-e1a4-41f9-b5b3-1f8463cc3ced tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:15.459881 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-5c159e96-e1a4-41f9-b5b3-1f8463cc3ced tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:15.466497 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5c159e96-e1a4-41f9-b5b3-1f8463cc3ced tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:15.466942 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5c159e96-e1a4-41f9-b5b3-1f8463cc3ced tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:15.467732 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5c159e96-e1a4-41f9-b5b3-1f8463cc3ced tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:15.468165 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5c159e96-e1a4-41f9-b5b3-1f8463cc3ced tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:15.603010 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-5c159e96-e1a4-41f9-b5b3-1f8463cc3ced tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:15.611079 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-5c159e96-e1a4-41f9-b5b3-1f8463cc3ced tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:15.612652 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-5c159e96-e1a4-41f9-b5b3-1f8463cc3ced tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:15.613760 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-5c159e96-e1a4-41f9-b5b3-1f8463cc3ced tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1721 microversion: 2.20 time: 0.158428 Jul 11 11:29:15.614311 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 287/573] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:29:15 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 11:29:15.707989 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-8ee0b07f-2ec5-439e-b005-50d95c7c4a27 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:15.710628 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-8ee0b07f-2ec5-439e-b005-50d95c7c4a27 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:15.716390 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8ee0b07f-2ec5-439e-b005-50d95c7c4a27 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:15.716857 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8ee0b07f-2ec5-439e-b005-50d95c7c4a27 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:15.717614 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8ee0b07f-2ec5-439e-b005-50d95c7c4a27 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:15.718147 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8ee0b07f-2ec5-439e-b005-50d95c7c4a27 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:15.805208 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-adb8f270-2680-4f65-8690-5568e347859a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:15.805818 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-adb8f270-2680-4f65-8690-5568e347859a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:15.812078 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-adb8f270-2680-4f65-8690-5568e347859a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:15.812526 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-adb8f270-2680-4f65-8690-5568e347859a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:15.813287 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-adb8f270-2680-4f65-8690-5568e347859a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:15.813721 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-adb8f270-2680-4f65-8690-5568e347859a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:15.846338 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-8ee0b07f-2ec5-439e-b005-50d95c7c4a27 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:15.854551 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-8ee0b07f-2ec5-439e-b005-50d95c7c4a27 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1372 microversion: 2.1 time: 0.151305 Jul 11 11:29:15.855236 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 287/574] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:29:15 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1372 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:29:15.876670 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-d147bd55-3d94-4f67-a0be-4dc0c7e1c267 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:15.877291 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-d147bd55-3d94-4f67-a0be-4dc0c7e1c267 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:15.883810 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d147bd55-3d94-4f67-a0be-4dc0c7e1c267 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:15.884345 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d147bd55-3d94-4f67-a0be-4dc0c7e1c267 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:15.885211 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d147bd55-3d94-4f67-a0be-4dc0c7e1c267 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:15.885656 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d147bd55-3d94-4f67-a0be-4dc0c7e1c267 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:15.957308 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-adb8f270-2680-4f65-8690-5568e347859a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:15.966697 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-adb8f270-2680-4f65-8690-5568e347859a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1700 microversion: 2.1 time: 0.165732 Jul 11 11:29:15.967436 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 288/575] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:29:15 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1700 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:29:15.983355 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-2cf7fe58-2069-4f36-a6dd-5a919a664829 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:29:15.989487 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2cf7fe58-2069-4f36-a6dd-5a919a664829 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:15.989939 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2cf7fe58-2069-4f36-a6dd-5a919a664829 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:15.994790 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=100 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:29:16.013634 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-2cf7fe58-2069-4f36-a6dd-5a919a664829 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Going to try to start instance {{(pid=118322) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 11 11:29:16.022495 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-d147bd55-3d94-4f67-a0be-4dc0c7e1c267 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:16.030583 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-d147bd55-3d94-4f67-a0be-4dc0c7e1c267 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e" status: 200 len: 1368 microversion: 2.1 time: 0.157871 Jul 11 11:29:16.031418 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 288/576] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:29:15 2022] GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:29:16.263259 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-2cf7fe58-2069-4f36-a6dd-5a919a664829 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "POST /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/action" status: 202 len: 0 microversion: 2.1 time: 0.283522 Jul 11 11:29:16.263890 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 289/577] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Jul 11 11:29:15 2022] POST /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/action => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 11 11:29:16.272008 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-40de0776-a549-444c-9f0c-0f58990dc11f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:16.272608 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-40de0776-a549-444c-9f0c-0f58990dc11f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:16.279087 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-40de0776-a549-444c-9f0c-0f58990dc11f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:16.279558 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-40de0776-a549-444c-9f0c-0f58990dc11f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:16.280338 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-40de0776-a549-444c-9f0c-0f58990dc11f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:16.280763 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-40de0776-a549-444c-9f0c-0f58990dc11f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:16.407984 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-40de0776-a549-444c-9f0c-0f58990dc11f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:16.416383 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-40de0776-a549-444c-9f0c-0f58990dc11f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1709 microversion: 2.1 time: 0.148345 Jul 11 11:29:16.416940 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 289/578] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:29:16 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1709 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:29:16.635789 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-95095b01-aa3f-4d32-b59b-ed3b3755bd49 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:16.636513 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-95095b01-aa3f-4d32-b59b-ed3b3755bd49 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:16.642707 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-95095b01-aa3f-4d32-b59b-ed3b3755bd49 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:16.643147 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-95095b01-aa3f-4d32-b59b-ed3b3755bd49 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:16.643936 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-95095b01-aa3f-4d32-b59b-ed3b3755bd49 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:16.644368 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-95095b01-aa3f-4d32-b59b-ed3b3755bd49 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:16.771650 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-95095b01-aa3f-4d32-b59b-ed3b3755bd49 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:16.779419 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-95095b01-aa3f-4d32-b59b-ed3b3755bd49 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:16.780901 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-95095b01-aa3f-4d32-b59b-ed3b3755bd49 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:16.782034 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-95095b01-aa3f-4d32-b59b-ed3b3755bd49 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1724 microversion: 2.20 time: 0.150959 Jul 11 11:29:16.782589 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 290/579] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:29:16 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:29:16.799438 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-710cdbd1-b81b-4f9f-b55c-b37f24df83b8 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2b87424a-e537-407d-bc04-6670abef009e"}} {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:29:16.800560 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-710cdbd1-b81b-4f9f-b55c-b37f24df83b8 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:16.807743 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-710cdbd1-b81b-4f9f-b55c-b37f24df83b8 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:16.808190 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-710cdbd1-b81b-4f9f-b55c-b37f24df83b8 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:16.808945 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-710cdbd1-b81b-4f9f-b55c-b37f24df83b8 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:16.809381 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-710cdbd1-b81b-4f9f-b55c-b37f24df83b8 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:16.871735 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-180b6e02-bd3f-475e-ae69-48f598e61b8e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:16.872342 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-180b6e02-bd3f-475e-ae69-48f598e61b8e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:16.878440 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-180b6e02-bd3f-475e-ae69-48f598e61b8e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:16.878886 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-180b6e02-bd3f-475e-ae69-48f598e61b8e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:16.879678 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-180b6e02-bd3f-475e-ae69-48f598e61b8e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:16.880112 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-180b6e02-bd3f-475e-ae69-48f598e61b8e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:17.027651 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-180b6e02-bd3f-475e-ae69-48f598e61b8e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:17.035345 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-180b6e02-bd3f-475e-ae69-48f598e61b8e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1372 microversion: 2.1 time: 0.167253 Jul 11 11:29:17.035914 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 291/580] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:29:16 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1372 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:29:17.051623 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-55115aa1-6120-42d7-a595-5fd1f9af50fc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:17.052240 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-55115aa1-6120-42d7-a595-5fd1f9af50fc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:17.059337 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-55115aa1-6120-42d7-a595-5fd1f9af50fc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:17.059787 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-55115aa1-6120-42d7-a595-5fd1f9af50fc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:17.060564 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-55115aa1-6120-42d7-a595-5fd1f9af50fc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:17.060999 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-55115aa1-6120-42d7-a595-5fd1f9af50fc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:17.200834 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-55115aa1-6120-42d7-a595-5fd1f9af50fc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:17.208302 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-55115aa1-6120-42d7-a595-5fd1f9af50fc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e" status: 200 len: 1558 microversion: 2.1 time: 0.161945 Jul 11 11:29:17.208931 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 292/581] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:29:17 2022] GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:29:17.232934 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-61bdf5c4-1c01-45b5-ba8c-c516c791d49e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:17.233500 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-61bdf5c4-1c01-45b5-ba8c-c516c791d49e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:17.239819 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-61bdf5c4-1c01-45b5-ba8c-c516c791d49e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:17.243080 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-61bdf5c4-1c01-45b5-ba8c-c516c791d49e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:17.243080 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-61bdf5c4-1c01-45b5-ba8c-c516c791d49e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:17.243080 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-61bdf5c4-1c01-45b5-ba8c-c516c791d49e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:17.319083 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-61bdf5c4-1c01-45b5-ba8c-c516c791d49e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092945 Jul 11 11:29:17.319782 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 293/582] 10.222.0.26 () {58 vars in 1274 bytes} [Mon Jul 11 11:29:17 2022] GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:29:17.373009 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [req-12f5e322-b47a-48be-8996-fb0bc620cb24 req-543c5f42-2be0-47e2-99f3-9c3ae40e2210 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b0ec960-6583-4639-9658-a850655eb703", "name": "network-vif-unplugged", "status": "completed", "tag": "fb396fac-9f6d-4448-a468-adea47f3003f"}]} {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:29:17.383499 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [req-12f5e322-b47a-48be-8996-fb0bc620cb24 req-543c5f42-2be0-47e2-99f3-9c3ae40e2210 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:17.383943 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [req-12f5e322-b47a-48be-8996-fb0bc620cb24 req-543c5f42-2be0-47e2-99f3-9c3ae40e2210 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:17.398726 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.compute.server_external_events [req-12f5e322-b47a-48be-8996-fb0bc620cb24 req-543c5f42-2be0-47e2-99f3-9c3ae40e2210 service nova] Unable to find a host for instance 4b0ec960-6583-4639-9658-a850655eb703. Dropping event network-vif-unplugged {{(pid=118322) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 11 11:29:17.399635 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [req-12f5e322-b47a-48be-8996-fb0bc620cb24 req-543c5f42-2be0-47e2-99f3-9c3ae40e2210 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033683 Jul 11 11:29:17.400219 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 294/583] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 11:29:17 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 35 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 11 11:29:17.434319 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-5ae426f6-e5a2-4af1-abd4-f2f713dae98b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:17.435080 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-5ae426f6-e5a2-4af1-abd4-f2f713dae98b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:17.441008 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5ae426f6-e5a2-4af1-abd4-f2f713dae98b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:17.441451 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5ae426f6-e5a2-4af1-abd4-f2f713dae98b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:17.442204 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5ae426f6-e5a2-4af1-abd4-f2f713dae98b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:17.442640 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5ae426f6-e5a2-4af1-abd4-f2f713dae98b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:17.686871 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-5ae426f6-e5a2-4af1-abd4-f2f713dae98b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:17.695816 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-5ae426f6-e5a2-4af1-abd4-f2f713dae98b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1709 microversion: 2.1 time: 0.265373 Jul 11 11:29:17.706020 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 295/584] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:29:17 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1709 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:29:18.053473 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-c161c164-0bd3-4c0c-92a5-571cc09bf1da tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:18.054120 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-c161c164-0bd3-4c0c-92a5-571cc09bf1da tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:18.060964 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c161c164-0bd3-4c0c-92a5-571cc09bf1da tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:18.061513 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c161c164-0bd3-4c0c-92a5-571cc09bf1da tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:18.062377 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c161c164-0bd3-4c0c-92a5-571cc09bf1da tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:18.062819 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c161c164-0bd3-4c0c-92a5-571cc09bf1da tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:18.102751 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-710cdbd1-b81b-4f9f-b55c-b37f24df83b8 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "POST /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.307181 Jul 11 11:29:18.106203 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 290/585] 10.222.0.26 () {62 vars in 1363 bytes} [Mon Jul 11 11:29:16 2022] POST /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703/os-volume_attachments => generated 188 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 11:29:18.225100 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-633920b9-8239-4353-a463-8872e4049082 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:29:18.225755 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-633920b9-8239-4353-a463-8872e4049082 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:18.228588 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-c161c164-0bd3-4c0c-92a5-571cc09bf1da tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:18.231804 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-633920b9-8239-4353-a463-8872e4049082 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:18.232248 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-633920b9-8239-4353-a463-8872e4049082 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:18.233014 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-633920b9-8239-4353-a463-8872e4049082 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:18.233445 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-633920b9-8239-4353-a463-8872e4049082 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:18.236038 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-c161c164-0bd3-4c0c-92a5-571cc09bf1da tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1566 microversion: 2.1 time: 0.187283 Jul 11 11:29:18.236957 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 296/586] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:29:18 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1566 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:29:18.253444 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-09df9c30-de4e-4438-9477-0280f1476e91 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:18.253937 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-09df9c30-de4e-4438-9477-0280f1476e91 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:18.260615 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-09df9c30-de4e-4438-9477-0280f1476e91 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:18.261065 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-09df9c30-de4e-4438-9477-0280f1476e91 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:18.261826 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-09df9c30-de4e-4438-9477-0280f1476e91 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:18.262257 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-09df9c30-de4e-4438-9477-0280f1476e91 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:18.373689 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-09df9c30-de4e-4438-9477-0280f1476e91 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.124546 Jul 11 11:29:18.374405 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 297/587] 10.222.0.26 () {58 vars in 1274 bytes} [Mon Jul 11 11:29:18 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6/os-interface => generated 284 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:29:18.465535 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-633920b9-8239-4353-a463-8872e4049082 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "POST /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703/action" status: 202 len: 0 microversion: 2.20 time: 0.244273 Jul 11 11:29:18.469386 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 291/588] 10.222.0.26 () {62 vars in 1318 bytes} [Mon Jul 11 11:29:18 2022] POST /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703/action => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 11 11:29:18.474855 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-42482b4a-80f1-4786-9ad1-8a06797b2a0b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:18.475857 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-42482b4a-80f1-4786-9ad1-8a06797b2a0b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:18.482061 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-42482b4a-80f1-4786-9ad1-8a06797b2a0b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:18.482607 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-42482b4a-80f1-4786-9ad1-8a06797b2a0b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:18.483479 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-42482b4a-80f1-4786-9ad1-8a06797b2a0b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:18.483974 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-42482b4a-80f1-4786-9ad1-8a06797b2a0b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:18.714386 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-2a0ee065-cb48-4b83-8f38-a1865ddf2b14 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:18.715416 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-2a0ee065-cb48-4b83-8f38-a1865ddf2b14 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:18.721487 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2a0ee065-cb48-4b83-8f38-a1865ddf2b14 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:18.721993 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2a0ee065-cb48-4b83-8f38-a1865ddf2b14 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:18.722761 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2a0ee065-cb48-4b83-8f38-a1865ddf2b14 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:18.723196 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2a0ee065-cb48-4b83-8f38-a1865ddf2b14 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:18.859859 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-2a0ee065-cb48-4b83-8f38-a1865ddf2b14 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:18.869884 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-2a0ee065-cb48-4b83-8f38-a1865ddf2b14 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1709 microversion: 2.1 time: 0.159828 Jul 11 11:29:18.878159 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 292/589] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:29:18 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1709 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:29:18.885562 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-42482b4a-80f1-4786-9ad1-8a06797b2a0b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:18.886029 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-42482b4a-80f1-4786-9ad1-8a06797b2a0b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:18.887240 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-42482b4a-80f1-4786-9ad1-8a06797b2a0b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:18.889051 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-42482b4a-80f1-4786-9ad1-8a06797b2a0b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1750 microversion: 2.20 time: 0.418263 Jul 11 11:29:18.889882 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 298/590] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:29:18 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1750 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:29:19.247395 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [req-5ab08fbb-a5ee-4e5c-a60b-44adc34e382d req-0dac4968-fb13-4f1c-8993-41d053715a4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e", "tag": "14c018a2-6bb9-4f49-bd4c-0dfd7f207193"}]} {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:29:19.257059 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [req-5ab08fbb-a5ee-4e5c-a60b-44adc34e382d req-0dac4968-fb13-4f1c-8993-41d053715a4e service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:19.262632 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [req-5ab08fbb-a5ee-4e5c-a60b-44adc34e382d req-0dac4968-fb13-4f1c-8993-41d053715a4e service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:19.273789 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.compute.server_external_events [req-5ab08fbb-a5ee-4e5c-a60b-44adc34e382d req-0dac4968-fb13-4f1c-8993-41d053715a4e service nova] Creating event network-changed:14c018a2-6bb9-4f49-bd4c-0dfd7f207193 for instance 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e on hv-cinder-84842 Jul 11 11:29:19.278813 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [req-5ab08fbb-a5ee-4e5c-a60b-44adc34e382d req-0dac4968-fb13-4f1c-8993-41d053715a4e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035408 Jul 11 11:29:19.279605 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 293/591] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 11:29:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:29:19.891548 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-5a0b429f-abe8-407e-8588-5bd0adc4f34b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:19.892153 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-5a0b429f-abe8-407e-8588-5bd0adc4f34b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:19.911549 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-c85a72ef-0c11-42e2-ad3a-f5b04bae429f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:19.912255 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-c85a72ef-0c11-42e2-ad3a-f5b04bae429f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:19.926265 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c85a72ef-0c11-42e2-ad3a-f5b04bae429f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:19.926717 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c85a72ef-0c11-42e2-ad3a-f5b04bae429f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:19.932188 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5a0b429f-abe8-407e-8588-5bd0adc4f34b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:19.932654 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5a0b429f-abe8-407e-8588-5bd0adc4f34b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:19.937738 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5a0b429f-abe8-407e-8588-5bd0adc4f34b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:19.938245 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5a0b429f-abe8-407e-8588-5bd0adc4f34b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:19.946197 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c85a72ef-0c11-42e2-ad3a-f5b04bae429f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:19.947972 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c85a72ef-0c11-42e2-ad3a-f5b04bae429f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:20.145803 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-c85a72ef-0c11-42e2-ad3a-f5b04bae429f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:20.158472 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-5a0b429f-abe8-407e-8588-5bd0adc4f34b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:20.167990 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-c85a72ef-0c11-42e2-ad3a-f5b04bae429f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:20.170713 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-5a0b429f-abe8-407e-8588-5bd0adc4f34b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1713 microversion: 2.1 time: 0.285463 Jul 11 11:29:20.171711 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-c85a72ef-0c11-42e2-ad3a-f5b04bae429f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:20.172886 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 299/592] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:29:19 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1713 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:29:20.174071 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-c85a72ef-0c11-42e2-ad3a-f5b04bae429f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1750 microversion: 2.20 time: 0.267928 Jul 11 11:29:20.176955 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 294/593] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:29:19 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1750 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:29:21.196705 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-66922bc9-9348-494f-b5ca-73b3d0f5ff3d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:21.197300 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-66922bc9-9348-494f-b5ca-73b3d0f5ff3d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:21.203805 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-66922bc9-9348-494f-b5ca-73b3d0f5ff3d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:21.204251 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-66922bc9-9348-494f-b5ca-73b3d0f5ff3d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:21.205020 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-66922bc9-9348-494f-b5ca-73b3d0f5ff3d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:21.205543 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-66922bc9-9348-494f-b5ca-73b3d0f5ff3d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:21.293144 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [req-0aa6c6f4-5752-4e00-9669-6545218a47d8 req-075c82e6-8eaa-4067-ae43-aeb63e8c951c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6", "tag": "21e04d85-904d-403f-aac1-fe7bfdc5fbb9"}]} {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:29:21.302970 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [req-0aa6c6f4-5752-4e00-9669-6545218a47d8 req-075c82e6-8eaa-4067-ae43-aeb63e8c951c service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:21.303731 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [req-0aa6c6f4-5752-4e00-9669-6545218a47d8 req-075c82e6-8eaa-4067-ae43-aeb63e8c951c service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:21.319111 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.compute.server_external_events [req-0aa6c6f4-5752-4e00-9669-6545218a47d8 req-075c82e6-8eaa-4067-ae43-aeb63e8c951c service nova] Creating event network-changed:21e04d85-904d-403f-aac1-fe7bfdc5fbb9 for instance 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 on hv-cinder-84842 Jul 11 11:29:21.324770 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [req-0aa6c6f4-5752-4e00-9669-6545218a47d8 req-075c82e6-8eaa-4067-ae43-aeb63e8c951c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035217 Jul 11 11:29:21.325372 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 295/594] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 11:29:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:29:21.358381 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-66922bc9-9348-494f-b5ca-73b3d0f5ff3d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:21.367852 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-66922bc9-9348-494f-b5ca-73b3d0f5ff3d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:21.369615 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-66922bc9-9348-494f-b5ca-73b3d0f5ff3d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:21.370796 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-66922bc9-9348-494f-b5ca-73b3d0f5ff3d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1752 microversion: 2.20 time: 0.178759 Jul 11 11:29:21.371374 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 300/595] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:29:21 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1752 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:29:22.390039 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-1fc2070e-9992-4e2f-a95c-5a4cdb643e55 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:22.390668 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-1fc2070e-9992-4e2f-a95c-5a4cdb643e55 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:22.396844 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1fc2070e-9992-4e2f-a95c-5a4cdb643e55 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:22.397293 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1fc2070e-9992-4e2f-a95c-5a4cdb643e55 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:22.398049 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1fc2070e-9992-4e2f-a95c-5a4cdb643e55 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:22.398484 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1fc2070e-9992-4e2f-a95c-5a4cdb643e55 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:22.529355 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-1fc2070e-9992-4e2f-a95c-5a4cdb643e55 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:22.538011 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-1fc2070e-9992-4e2f-a95c-5a4cdb643e55 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:22.539821 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-1fc2070e-9992-4e2f-a95c-5a4cdb643e55 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:22.540975 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-1fc2070e-9992-4e2f-a95c-5a4cdb643e55 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1752 microversion: 2.20 time: 0.155972 Jul 11 11:29:22.541535 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 296/596] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:29:22 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:29:23.560704 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-d85cff76-a3af-4504-bdd2-136c7a614a88 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:23.561630 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-d85cff76-a3af-4504-bdd2-136c7a614a88 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:23.565495 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_api:SELECT=100 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:29:23.572084 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d85cff76-a3af-4504-bdd2-136c7a614a88 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:23.572526 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d85cff76-a3af-4504-bdd2-136c7a614a88 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:23.573287 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d85cff76-a3af-4504-bdd2-136c7a614a88 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:23.573721 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d85cff76-a3af-4504-bdd2-136c7a614a88 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:23.709176 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-d85cff76-a3af-4504-bdd2-136c7a614a88 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:23.718444 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-d85cff76-a3af-4504-bdd2-136c7a614a88 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:23.720118 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-d85cff76-a3af-4504-bdd2-136c7a614a88 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:23.721462 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-d85cff76-a3af-4504-bdd2-136c7a614a88 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1752 microversion: 2.20 time: 0.165488 Jul 11 11:29:23.722014 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 301/597] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:29:23 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1752 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:29:24.740283 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-bf83fa2d-aeb9-49c0-8014-a148f4373f10 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:24.740890 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-bf83fa2d-aeb9-49c0-8014-a148f4373f10 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:24.748305 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bf83fa2d-aeb9-49c0-8014-a148f4373f10 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:24.748752 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bf83fa2d-aeb9-49c0-8014-a148f4373f10 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:24.749514 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bf83fa2d-aeb9-49c0-8014-a148f4373f10 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:24.749951 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bf83fa2d-aeb9-49c0-8014-a148f4373f10 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:24.881766 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-bf83fa2d-aeb9-49c0-8014-a148f4373f10 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:24.890848 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-bf83fa2d-aeb9-49c0-8014-a148f4373f10 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:24.893083 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-bf83fa2d-aeb9-49c0-8014-a148f4373f10 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:24.902547 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-bf83fa2d-aeb9-49c0-8014-a148f4373f10 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1752 microversion: 2.20 time: 0.158017 Jul 11 11:29:24.902547 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 297/598] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:29:24 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1752 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:29:25.913483 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-2d244335-e9d4-43f3-816f-a46305cbade7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:25.914633 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-2d244335-e9d4-43f3-816f-a46305cbade7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:25.921506 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2d244335-e9d4-43f3-816f-a46305cbade7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:25.921955 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2d244335-e9d4-43f3-816f-a46305cbade7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:25.927722 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2d244335-e9d4-43f3-816f-a46305cbade7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:25.927722 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2d244335-e9d4-43f3-816f-a46305cbade7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:26.058248 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-2d244335-e9d4-43f3-816f-a46305cbade7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:26.066639 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-2d244335-e9d4-43f3-816f-a46305cbade7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:26.068201 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-2d244335-e9d4-43f3-816f-a46305cbade7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:26.069354 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-2d244335-e9d4-43f3-816f-a46305cbade7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1752 microversion: 2.20 time: 0.159808 Jul 11 11:29:26.069909 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 302/599] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:29:25 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1752 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:29:27.088349 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-ad63fe93-f5ab-404f-8176-29ae44fada83 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:27.088955 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-ad63fe93-f5ab-404f-8176-29ae44fada83 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:27.095615 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ad63fe93-f5ab-404f-8176-29ae44fada83 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:27.096060 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ad63fe93-f5ab-404f-8176-29ae44fada83 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:27.096822 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ad63fe93-f5ab-404f-8176-29ae44fada83 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:27.097255 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ad63fe93-f5ab-404f-8176-29ae44fada83 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:27.228829 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-ad63fe93-f5ab-404f-8176-29ae44fada83 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:27.237039 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-ad63fe93-f5ab-404f-8176-29ae44fada83 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:27.238554 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-ad63fe93-f5ab-404f-8176-29ae44fada83 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:27.239717 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-ad63fe93-f5ab-404f-8176-29ae44fada83 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1752 microversion: 2.20 time: 0.155289 Jul 11 11:29:27.240312 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 298/600] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:29:27 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1752 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 11:29:28.258729 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-3f022989-0d61-44a6-9d1c-9641b4a6933b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:28.259376 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-3f022989-0d61-44a6-9d1c-9641b4a6933b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:28.265961 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3f022989-0d61-44a6-9d1c-9641b4a6933b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:28.266406 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3f022989-0d61-44a6-9d1c-9641b4a6933b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:28.267297 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3f022989-0d61-44a6-9d1c-9641b4a6933b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:28.267635 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3f022989-0d61-44a6-9d1c-9641b4a6933b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:28.397564 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-3f022989-0d61-44a6-9d1c-9641b4a6933b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:28.406533 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-3f022989-0d61-44a6-9d1c-9641b4a6933b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:28.408275 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-3f022989-0d61-44a6-9d1c-9641b4a6933b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:28.409443 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-3f022989-0d61-44a6-9d1c-9641b4a6933b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1752 microversion: 2.20 time: 0.155135 Jul 11 11:29:28.409997 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 303/601] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:29:28 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1752 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:29:29.429545 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-59d5147a-3416-4560-9a99-fb113ca3d585 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:29.430151 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-59d5147a-3416-4560-9a99-fb113ca3d585 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:29.438658 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-59d5147a-3416-4560-9a99-fb113ca3d585 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:29.439099 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-59d5147a-3416-4560-9a99-fb113ca3d585 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:29.439883 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-59d5147a-3416-4560-9a99-fb113ca3d585 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:29.440314 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-59d5147a-3416-4560-9a99-fb113ca3d585 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:29.585326 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-59d5147a-3416-4560-9a99-fb113ca3d585 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:29.593711 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-59d5147a-3416-4560-9a99-fb113ca3d585 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:29.595189 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-59d5147a-3416-4560-9a99-fb113ca3d585 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:29.596343 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-59d5147a-3416-4560-9a99-fb113ca3d585 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1752 microversion: 2.20 time: 0.171665 Jul 11 11:29:29.596921 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 299/602] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:29:29 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1752 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:29:30.613883 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-f35a99e3-29f5-44c8-ba8c-fbd21d87507c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:30.653292 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-f35a99e3-29f5-44c8-ba8c-fbd21d87507c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:30.653292 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f35a99e3-29f5-44c8-ba8c-fbd21d87507c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:30.653292 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f35a99e3-29f5-44c8-ba8c-fbd21d87507c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:30.653292 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f35a99e3-29f5-44c8-ba8c-fbd21d87507c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:30.654277 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f35a99e3-29f5-44c8-ba8c-fbd21d87507c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:30.772368 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-f35a99e3-29f5-44c8-ba8c-fbd21d87507c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:30.776959 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-f35a99e3-29f5-44c8-ba8c-fbd21d87507c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:30.778478 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-f35a99e3-29f5-44c8-ba8c-fbd21d87507c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:30.779662 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-f35a99e3-29f5-44c8-ba8c-fbd21d87507c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1752 microversion: 2.20 time: 0.169641 Jul 11 11:29:30.780221 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 304/603] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:29:30 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1752 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:29:31.798396 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-3ee730bb-f8b9-487b-8f92-210f372243eb tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:31.799003 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-3ee730bb-f8b9-487b-8f92-210f372243eb tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:31.806117 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3ee730bb-f8b9-487b-8f92-210f372243eb tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:31.806568 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3ee730bb-f8b9-487b-8f92-210f372243eb tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:31.807599 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3ee730bb-f8b9-487b-8f92-210f372243eb tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:31.808046 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3ee730bb-f8b9-487b-8f92-210f372243eb tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:31.937229 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-3ee730bb-f8b9-487b-8f92-210f372243eb tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:31.945573 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-3ee730bb-f8b9-487b-8f92-210f372243eb tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:31.947078 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-3ee730bb-f8b9-487b-8f92-210f372243eb tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:31.948266 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-3ee730bb-f8b9-487b-8f92-210f372243eb tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1752 microversion: 2.20 time: 0.153734 Jul 11 11:29:31.948828 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 300/604] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:29:31 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1752 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:29:32.972275 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-62485364-0ef6-4bc8-be4e-464d0aec43c1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:32.979784 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-62485364-0ef6-4bc8-be4e-464d0aec43c1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:32.986946 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-62485364-0ef6-4bc8-be4e-464d0aec43c1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:32.987489 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-62485364-0ef6-4bc8-be4e-464d0aec43c1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:32.988389 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-62485364-0ef6-4bc8-be4e-464d0aec43c1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:32.988817 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-62485364-0ef6-4bc8-be4e-464d0aec43c1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:33.133224 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-62485364-0ef6-4bc8-be4e-464d0aec43c1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:33.141555 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-62485364-0ef6-4bc8-be4e-464d0aec43c1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:33.143052 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-62485364-0ef6-4bc8-be4e-464d0aec43c1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:33.144233 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-62485364-0ef6-4bc8-be4e-464d0aec43c1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1752 microversion: 2.20 time: 0.177919 Jul 11 11:29:33.144790 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 305/605] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:29:32 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1752 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:29:34.162850 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-33afa4e4-92d6-4eaf-9550-254bc4f84988 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:34.163466 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-33afa4e4-92d6-4eaf-9550-254bc4f84988 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:34.165915 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_api:SELECT=78 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:29:34.170524 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-33afa4e4-92d6-4eaf-9550-254bc4f84988 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:34.170962 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-33afa4e4-92d6-4eaf-9550-254bc4f84988 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:34.171937 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-33afa4e4-92d6-4eaf-9550-254bc4f84988 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:34.172373 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-33afa4e4-92d6-4eaf-9550-254bc4f84988 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:34.174867 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:29:34.304284 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-33afa4e4-92d6-4eaf-9550-254bc4f84988 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:34.313066 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-33afa4e4-92d6-4eaf-9550-254bc4f84988 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:34.314568 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-33afa4e4-92d6-4eaf-9550-254bc4f84988 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:34.315815 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-33afa4e4-92d6-4eaf-9550-254bc4f84988 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1752 microversion: 2.20 time: 0.156868 Jul 11 11:29:34.316366 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 301/606] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:29:34 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1752 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:29:35.334589 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-6ed8628f-da67-441e-952e-1cdf1e3f78b5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:35.335164 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-6ed8628f-da67-441e-952e-1cdf1e3f78b5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:35.341711 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6ed8628f-da67-441e-952e-1cdf1e3f78b5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:35.342152 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6ed8628f-da67-441e-952e-1cdf1e3f78b5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:35.342917 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6ed8628f-da67-441e-952e-1cdf1e3f78b5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:35.343380 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6ed8628f-da67-441e-952e-1cdf1e3f78b5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:35.347419 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:29:35.476432 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-6ed8628f-da67-441e-952e-1cdf1e3f78b5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:35.484779 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-6ed8628f-da67-441e-952e-1cdf1e3f78b5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:35.486321 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-6ed8628f-da67-441e-952e-1cdf1e3f78b5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:35.487529 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-6ed8628f-da67-441e-952e-1cdf1e3f78b5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1752 microversion: 2.20 time: 0.156982 Jul 11 11:29:35.488081 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 306/607] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:29:35 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1752 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:29:36.505833 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-cba725b8-34f6-49b4-8315-a7070e2c23d7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:36.506477 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-cba725b8-34f6-49b4-8315-a7070e2c23d7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:36.514185 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-cba725b8-34f6-49b4-8315-a7070e2c23d7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:36.514639 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-cba725b8-34f6-49b4-8315-a7070e2c23d7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:36.515437 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-cba725b8-34f6-49b4-8315-a7070e2c23d7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:36.515879 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-cba725b8-34f6-49b4-8315-a7070e2c23d7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:36.640579 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-cba725b8-34f6-49b4-8315-a7070e2c23d7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:36.648839 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-cba725b8-34f6-49b4-8315-a7070e2c23d7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:36.650344 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-cba725b8-34f6-49b4-8315-a7070e2c23d7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:36.651519 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-cba725b8-34f6-49b4-8315-a7070e2c23d7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1752 microversion: 2.20 time: 0.149529 Jul 11 11:29:36.652083 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 302/608] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:29:36 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1752 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:29:37.669498 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-a213f5b2-d441-4518-a5e9-57f4965d29d6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:37.670103 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-a213f5b2-d441-4518-a5e9-57f4965d29d6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:37.677226 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a213f5b2-d441-4518-a5e9-57f4965d29d6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:37.677668 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a213f5b2-d441-4518-a5e9-57f4965d29d6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:37.687916 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a213f5b2-d441-4518-a5e9-57f4965d29d6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:37.687916 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a213f5b2-d441-4518-a5e9-57f4965d29d6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:38.019074 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-a213f5b2-d441-4518-a5e9-57f4965d29d6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:38.027419 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-a213f5b2-d441-4518-a5e9-57f4965d29d6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:38.036312 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-a213f5b2-d441-4518-a5e9-57f4965d29d6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:38.036312 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-a213f5b2-d441-4518-a5e9-57f4965d29d6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1752 microversion: 2.20 time: 0.364525 Jul 11 11:29:38.036312 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 307/609] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:29:37 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1752 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:29:39.048640 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-bb056029-d703-4051-a03e-9b0bcbc775a6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:39.049258 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-bb056029-d703-4051-a03e-9b0bcbc775a6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:39.055740 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bb056029-d703-4051-a03e-9b0bcbc775a6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:39.056179 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bb056029-d703-4051-a03e-9b0bcbc775a6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:39.056941 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bb056029-d703-4051-a03e-9b0bcbc775a6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:39.057375 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bb056029-d703-4051-a03e-9b0bcbc775a6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:39.187624 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-bb056029-d703-4051-a03e-9b0bcbc775a6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:39.196530 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-bb056029-d703-4051-a03e-9b0bcbc775a6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:39.198028 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-bb056029-d703-4051-a03e-9b0bcbc775a6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:39.199169 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-bb056029-d703-4051-a03e-9b0bcbc775a6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1752 microversion: 2.20 time: 0.154536 Jul 11 11:29:39.199756 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 303/610] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:29:39 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1752 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:29:40.217938 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-6c3d5b13-c385-423f-b946-2685b4eab6d9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:40.218613 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-6c3d5b13-c385-423f-b946-2685b4eab6d9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:40.225203 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6c3d5b13-c385-423f-b946-2685b4eab6d9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:40.225714 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6c3d5b13-c385-423f-b946-2685b4eab6d9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:40.227135 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6c3d5b13-c385-423f-b946-2685b4eab6d9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:40.227644 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6c3d5b13-c385-423f-b946-2685b4eab6d9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:40.351304 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-6c3d5b13-c385-423f-b946-2685b4eab6d9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:40.360146 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-6c3d5b13-c385-423f-b946-2685b4eab6d9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:40.361661 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-6c3d5b13-c385-423f-b946-2685b4eab6d9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:40.362792 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-6c3d5b13-c385-423f-b946-2685b4eab6d9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1752 microversion: 2.20 time: 0.149296 Jul 11 11:29:40.363558 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 308/611] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:29:40 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1752 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:29:41.383483 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-781b6af9-7035-4c46-9ecf-904152c3baf7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:41.384047 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-781b6af9-7035-4c46-9ecf-904152c3baf7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:41.392418 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-781b6af9-7035-4c46-9ecf-904152c3baf7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:41.392866 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-781b6af9-7035-4c46-9ecf-904152c3baf7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:41.393630 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-781b6af9-7035-4c46-9ecf-904152c3baf7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:41.394065 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-781b6af9-7035-4c46-9ecf-904152c3baf7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:41.523979 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-781b6af9-7035-4c46-9ecf-904152c3baf7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:41.532579 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-781b6af9-7035-4c46-9ecf-904152c3baf7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:41.534097 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-781b6af9-7035-4c46-9ecf-904152c3baf7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:41.535269 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-781b6af9-7035-4c46-9ecf-904152c3baf7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1752 microversion: 2.20 time: 0.158278 Jul 11 11:29:41.535845 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 304/612] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:29:41 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1752 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:29:42.553387 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-cea49809-cad4-41ec-9a29-1bf20d783a6c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:42.554053 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-cea49809-cad4-41ec-9a29-1bf20d783a6c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:42.561436 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cea49809-cad4-41ec-9a29-1bf20d783a6c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:42.561872 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cea49809-cad4-41ec-9a29-1bf20d783a6c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:42.562621 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cea49809-cad4-41ec-9a29-1bf20d783a6c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:42.563047 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cea49809-cad4-41ec-9a29-1bf20d783a6c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:42.692059 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-cea49809-cad4-41ec-9a29-1bf20d783a6c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:42.704716 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-cea49809-cad4-41ec-9a29-1bf20d783a6c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:42.706279 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-cea49809-cad4-41ec-9a29-1bf20d783a6c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:42.707478 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-cea49809-cad4-41ec-9a29-1bf20d783a6c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1752 microversion: 2.20 time: 0.157933 Jul 11 11:29:42.708035 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 309/613] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:29:42 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1752 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:29:43.725753 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-cb4e7b23-35f2-4b41-9c17-e151ce0a126e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:43.726391 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-cb4e7b23-35f2-4b41-9c17-e151ce0a126e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:43.732938 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-cb4e7b23-35f2-4b41-9c17-e151ce0a126e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:43.733386 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-cb4e7b23-35f2-4b41-9c17-e151ce0a126e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:43.734155 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-cb4e7b23-35f2-4b41-9c17-e151ce0a126e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:43.734590 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-cb4e7b23-35f2-4b41-9c17-e151ce0a126e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:43.860814 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-cb4e7b23-35f2-4b41-9c17-e151ce0a126e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:43.869646 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-cb4e7b23-35f2-4b41-9c17-e151ce0a126e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:43.873384 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-cb4e7b23-35f2-4b41-9c17-e151ce0a126e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:43.873384 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-cb4e7b23-35f2-4b41-9c17-e151ce0a126e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1752 microversion: 2.20 time: 0.150444 Jul 11 11:29:43.873384 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 305/614] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:29:43 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1752 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:29:44.891286 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-754f4070-8ad6-4577-88f0-e8362c7b2d6f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:44.891903 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-754f4070-8ad6-4577-88f0-e8362c7b2d6f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:44.898552 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-754f4070-8ad6-4577-88f0-e8362c7b2d6f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:44.899109 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-754f4070-8ad6-4577-88f0-e8362c7b2d6f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:44.899903 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-754f4070-8ad6-4577-88f0-e8362c7b2d6f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:44.900331 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-754f4070-8ad6-4577-88f0-e8362c7b2d6f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:45.024385 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-754f4070-8ad6-4577-88f0-e8362c7b2d6f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:45.032429 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-754f4070-8ad6-4577-88f0-e8362c7b2d6f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:45.033913 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-754f4070-8ad6-4577-88f0-e8362c7b2d6f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:45.035046 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-754f4070-8ad6-4577-88f0-e8362c7b2d6f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1752 microversion: 2.20 time: 0.147785 Jul 11 11:29:45.035627 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 310/615] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:29:44 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1752 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:29:46.055655 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-dc3900c3-951e-488c-b1bc-97ba34798512 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:46.056165 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-dc3900c3-951e-488c-b1bc-97ba34798512 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:46.064170 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-dc3900c3-951e-488c-b1bc-97ba34798512 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:46.064647 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-dc3900c3-951e-488c-b1bc-97ba34798512 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:46.065421 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-dc3900c3-951e-488c-b1bc-97ba34798512 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:46.065849 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-dc3900c3-951e-488c-b1bc-97ba34798512 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:46.422340 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-dc3900c3-951e-488c-b1bc-97ba34798512 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:46.431715 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-dc3900c3-951e-488c-b1bc-97ba34798512 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:46.433476 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-dc3900c3-951e-488c-b1bc-97ba34798512 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:46.434615 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-dc3900c3-951e-488c-b1bc-97ba34798512 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1752 microversion: 2.20 time: 0.384149 Jul 11 11:29:46.435181 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 306/616] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:29:46 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1752 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:29:47.457152 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-ef2372d2-da40-4f5f-9d18-f1aea0a8bd32 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:47.457777 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-ef2372d2-da40-4f5f-9d18-f1aea0a8bd32 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:47.464260 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ef2372d2-da40-4f5f-9d18-f1aea0a8bd32 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:47.464696 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ef2372d2-da40-4f5f-9d18-f1aea0a8bd32 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:47.465446 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ef2372d2-da40-4f5f-9d18-f1aea0a8bd32 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:47.465876 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ef2372d2-da40-4f5f-9d18-f1aea0a8bd32 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:47.591226 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-ef2372d2-da40-4f5f-9d18-f1aea0a8bd32 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:47.607240 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-ef2372d2-da40-4f5f-9d18-f1aea0a8bd32 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:47.608746 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-ef2372d2-da40-4f5f-9d18-f1aea0a8bd32 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:47.609939 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-ef2372d2-da40-4f5f-9d18-f1aea0a8bd32 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1752 microversion: 2.20 time: 0.156664 Jul 11 11:29:47.610545 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 311/617] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:29:47 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1752 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:29:48.628529 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-ac27b7ed-79ba-45c8-9c01-0f3ff377b2c6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:48.629140 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-ac27b7ed-79ba-45c8-9c01-0f3ff377b2c6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:48.636403 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ac27b7ed-79ba-45c8-9c01-0f3ff377b2c6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:48.636849 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ac27b7ed-79ba-45c8-9c01-0f3ff377b2c6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:48.637615 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ac27b7ed-79ba-45c8-9c01-0f3ff377b2c6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:48.638051 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ac27b7ed-79ba-45c8-9c01-0f3ff377b2c6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:48.762975 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-ac27b7ed-79ba-45c8-9c01-0f3ff377b2c6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:48.771244 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-ac27b7ed-79ba-45c8-9c01-0f3ff377b2c6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:48.772768 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-ac27b7ed-79ba-45c8-9c01-0f3ff377b2c6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:48.774541 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-ac27b7ed-79ba-45c8-9c01-0f3ff377b2c6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1752 microversion: 2.20 time: 0.149906 Jul 11 11:29:48.775102 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 307/618] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:29:48 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1752 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:29:49.793662 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-085f7d86-df52-4162-be05-381a431348fc tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:49.794288 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-085f7d86-df52-4162-be05-381a431348fc tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:49.800745 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-085f7d86-df52-4162-be05-381a431348fc tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:49.801237 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-085f7d86-df52-4162-be05-381a431348fc tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:49.801986 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-085f7d86-df52-4162-be05-381a431348fc tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:49.802417 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-085f7d86-df52-4162-be05-381a431348fc tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:49.947526 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-085f7d86-df52-4162-be05-381a431348fc tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:49.959623 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-085f7d86-df52-4162-be05-381a431348fc tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:49.961732 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-085f7d86-df52-4162-be05-381a431348fc tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:49.962876 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-085f7d86-df52-4162-be05-381a431348fc tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1752 microversion: 2.20 time: 0.174002 Jul 11 11:29:49.963461 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 312/619] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:29:49 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1752 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:29:50.980791 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-6433ba87-86fe-49cf-a8d4-9364ff18761e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:50.981394 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-6433ba87-86fe-49cf-a8d4-9364ff18761e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:50.987899 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6433ba87-86fe-49cf-a8d4-9364ff18761e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:50.988343 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6433ba87-86fe-49cf-a8d4-9364ff18761e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:50.989095 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6433ba87-86fe-49cf-a8d4-9364ff18761e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:50.989527 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6433ba87-86fe-49cf-a8d4-9364ff18761e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:51.119051 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-6433ba87-86fe-49cf-a8d4-9364ff18761e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:51.127813 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-6433ba87-86fe-49cf-a8d4-9364ff18761e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:51.129422 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-6433ba87-86fe-49cf-a8d4-9364ff18761e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:51.130709 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-6433ba87-86fe-49cf-a8d4-9364ff18761e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1752 microversion: 2.20 time: 0.153785 Jul 11 11:29:51.131336 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 308/620] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:29:50 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1752 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:29:52.149694 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-6e72ecf1-b7ee-44a0-9107-ffc74fe730a4 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:52.150323 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-6e72ecf1-b7ee-44a0-9107-ffc74fe730a4 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:52.156677 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6e72ecf1-b7ee-44a0-9107-ffc74fe730a4 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:52.157116 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6e72ecf1-b7ee-44a0-9107-ffc74fe730a4 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:52.157864 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6e72ecf1-b7ee-44a0-9107-ffc74fe730a4 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:52.158288 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6e72ecf1-b7ee-44a0-9107-ffc74fe730a4 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:52.287276 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-6e72ecf1-b7ee-44a0-9107-ffc74fe730a4 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:52.296570 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-6e72ecf1-b7ee-44a0-9107-ffc74fe730a4 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:52.298071 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-6e72ecf1-b7ee-44a0-9107-ffc74fe730a4 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:52.299278 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-6e72ecf1-b7ee-44a0-9107-ffc74fe730a4 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1752 microversion: 2.20 time: 0.153702 Jul 11 11:29:52.300041 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 313/621] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:29:52 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1752 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:29:53.317692 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-2a613d17-ee76-4a1b-9ad5-bcadb5b6cc53 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:53.318301 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-2a613d17-ee76-4a1b-9ad5-bcadb5b6cc53 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:53.324971 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2a613d17-ee76-4a1b-9ad5-bcadb5b6cc53 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:53.325361 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2a613d17-ee76-4a1b-9ad5-bcadb5b6cc53 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:53.326117 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2a613d17-ee76-4a1b-9ad5-bcadb5b6cc53 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:53.326554 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2a613d17-ee76-4a1b-9ad5-bcadb5b6cc53 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:53.456162 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-2a613d17-ee76-4a1b-9ad5-bcadb5b6cc53 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:53.464500 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-2a613d17-ee76-4a1b-9ad5-bcadb5b6cc53 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:53.466009 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-2a613d17-ee76-4a1b-9ad5-bcadb5b6cc53 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:53.467148 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-2a613d17-ee76-4a1b-9ad5-bcadb5b6cc53 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1752 microversion: 2.20 time: 0.153516 Jul 11 11:29:53.467748 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 309/622] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:29:53 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1752 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:29:54.485374 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-745d0233-61bc-4243-a59d-cab2609967ff tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:54.485978 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-745d0233-61bc-4243-a59d-cab2609967ff tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:54.488341 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_api:SELECT=26 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:29:54.493084 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-745d0233-61bc-4243-a59d-cab2609967ff tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:54.493527 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-745d0233-61bc-4243-a59d-cab2609967ff tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:54.494282 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-745d0233-61bc-4243-a59d-cab2609967ff tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:54.494714 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-745d0233-61bc-4243-a59d-cab2609967ff tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:54.623023 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-745d0233-61bc-4243-a59d-cab2609967ff tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:54.631229 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-745d0233-61bc-4243-a59d-cab2609967ff tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:54.632735 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-745d0233-61bc-4243-a59d-cab2609967ff tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:54.634359 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-745d0233-61bc-4243-a59d-cab2609967ff tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1752 microversion: 2.20 time: 0.152919 Jul 11 11:29:54.634903 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 314/623] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:29:54 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:29:55.652354 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-fc4b639a-0529-4878-bc6e-eeb2557cfe8e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:55.652986 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-fc4b639a-0529-4878-bc6e-eeb2557cfe8e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:55.659729 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fc4b639a-0529-4878-bc6e-eeb2557cfe8e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:55.660169 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fc4b639a-0529-4878-bc6e-eeb2557cfe8e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:55.660929 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fc4b639a-0529-4878-bc6e-eeb2557cfe8e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:55.661354 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fc4b639a-0529-4878-bc6e-eeb2557cfe8e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:55.761278 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-ea73c389-f870-4de6-bfc6-44247ae5808e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:55.761845 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-ea73c389-f870-4de6-bfc6-44247ae5808e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:55.768089 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ea73c389-f870-4de6-bfc6-44247ae5808e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:55.768556 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ea73c389-f870-4de6-bfc6-44247ae5808e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:55.769308 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ea73c389-f870-4de6-bfc6-44247ae5808e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:55.769737 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ea73c389-f870-4de6-bfc6-44247ae5808e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:55.790383 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-fc4b639a-0529-4878-bc6e-eeb2557cfe8e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:55.793048 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-ea73c389-f870-4de6-bfc6-44247ae5808e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e/ips" status: 200 len: 150 microversion: 2.1 time: 0.035594 Jul 11 11:29:55.793795 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 315/624] 10.222.0.26 () {58 vars in 1247 bytes} [Mon Jul 11 11:29:55 2022] GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:29:55.799634 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-fc4b639a-0529-4878-bc6e-eeb2557cfe8e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:55.801120 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-fc4b639a-0529-4878-bc6e-eeb2557cfe8e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:55.802257 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-fc4b639a-0529-4878-bc6e-eeb2557cfe8e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1752 microversion: 2.20 time: 0.154434 Jul 11 11:29:55.802803 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 310/625] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:29:55 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1752 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 11:29:55.803533 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-3073bbbb-fe10-487f-ba97-573d690759a3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "17b56d0a-9749-4a6b-a75e-451a2bae3737"}} {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:29:55.804645 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-3073bbbb-fe10-487f-ba97-573d690759a3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:55.810809 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3073bbbb-fe10-487f-ba97-573d690759a3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:55.811265 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3073bbbb-fe10-487f-ba97-573d690759a3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:55.812025 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3073bbbb-fe10-487f-ba97-573d690759a3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:55.812453 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3073bbbb-fe10-487f-ba97-573d690759a3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:56.820502 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-da96007b-6647-4f91-a5b9-e60cbdd9513b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:56.828508 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-da96007b-6647-4f91-a5b9-e60cbdd9513b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:56.828508 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-da96007b-6647-4f91-a5b9-e60cbdd9513b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:56.828508 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-da96007b-6647-4f91-a5b9-e60cbdd9513b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:56.828839 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-da96007b-6647-4f91-a5b9-e60cbdd9513b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:56.829275 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-da96007b-6647-4f91-a5b9-e60cbdd9513b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:56.956334 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-da96007b-6647-4f91-a5b9-e60cbdd9513b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:56.964475 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-da96007b-6647-4f91-a5b9-e60cbdd9513b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:56.965969 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-da96007b-6647-4f91-a5b9-e60cbdd9513b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:56.967109 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-da96007b-6647-4f91-a5b9-e60cbdd9513b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1752 microversion: 2.20 time: 0.150487 Jul 11 11:29:56.967824 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 311/626] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:29:56 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1752 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 11:29:57.986107 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-177ddd6f-25bc-48a7-be92-fa1d644cbeaa tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:57.986758 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-177ddd6f-25bc-48a7-be92-fa1d644cbeaa tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:57.993878 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-177ddd6f-25bc-48a7-be92-fa1d644cbeaa tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:57.994329 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-177ddd6f-25bc-48a7-be92-fa1d644cbeaa tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:57.995092 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-177ddd6f-25bc-48a7-be92-fa1d644cbeaa tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:57.995568 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-177ddd6f-25bc-48a7-be92-fa1d644cbeaa tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:58.135328 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-177ddd6f-25bc-48a7-be92-fa1d644cbeaa tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:58.143731 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-177ddd6f-25bc-48a7-be92-fa1d644cbeaa tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:58.145236 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-177ddd6f-25bc-48a7-be92-fa1d644cbeaa tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:58.146379 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-177ddd6f-25bc-48a7-be92-fa1d644cbeaa tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1752 microversion: 2.20 time: 0.164270 Jul 11 11:29:58.146941 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 312/627] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:29:57 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1752 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 11:29:59.164577 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-d0783ea3-65a5-4460-aa4c-8f4092da0ed2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:29:59.165242 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-d0783ea3-65a5-4460-aa4c-8f4092da0ed2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:29:59.171899 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d0783ea3-65a5-4460-aa4c-8f4092da0ed2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:59.172349 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d0783ea3-65a5-4460-aa4c-8f4092da0ed2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:59.173106 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d0783ea3-65a5-4460-aa4c-8f4092da0ed2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:29:59.173542 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d0783ea3-65a5-4460-aa4c-8f4092da0ed2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:29:59.298828 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-d0783ea3-65a5-4460-aa4c-8f4092da0ed2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:59.307089 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-d0783ea3-65a5-4460-aa4c-8f4092da0ed2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:59.308880 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-d0783ea3-65a5-4460-aa4c-8f4092da0ed2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:29:59.310022 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-d0783ea3-65a5-4460-aa4c-8f4092da0ed2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1752 microversion: 2.20 time: 0.149306 Jul 11 11:29:59.310582 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 313/628] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:29:59 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1752 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 11:30:00.329020 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-df797403-ed3d-446a-87b6-92c57e1946b0 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:30:00.330039 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-df797403-ed3d-446a-87b6-92c57e1946b0 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:30:00.338002 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-df797403-ed3d-446a-87b6-92c57e1946b0 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:30:00.338450 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-df797403-ed3d-446a-87b6-92c57e1946b0 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:30:00.339204 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-df797403-ed3d-446a-87b6-92c57e1946b0 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:30:00.339664 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-df797403-ed3d-446a-87b6-92c57e1946b0 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:30:00.480095 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-df797403-ed3d-446a-87b6-92c57e1946b0 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:30:00.488556 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-df797403-ed3d-446a-87b6-92c57e1946b0 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:30:00.490953 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-df797403-ed3d-446a-87b6-92c57e1946b0 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:30:00.492696 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-df797403-ed3d-446a-87b6-92c57e1946b0 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1752 microversion: 2.20 time: 0.167428 Jul 11 11:30:00.493259 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 314/629] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:30:00 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1752 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 11:30:01.405464 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-7a6c35a5-4187-43ec-9685-1c52eab25af9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:30:01.406227 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-7a6c35a5-4187-43ec-9685-1c52eab25af9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:30:01.412293 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7a6c35a5-4187-43ec-9685-1c52eab25af9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:30:01.412735 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7a6c35a5-4187-43ec-9685-1c52eab25af9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:30:01.413479 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7a6c35a5-4187-43ec-9685-1c52eab25af9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:30:01.413909 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7a6c35a5-4187-43ec-9685-1c52eab25af9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:30:05.808270 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_api:SELECT=5 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:30:05.829734 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=60 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:30:11.409673 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_api:SELECT=29 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:30:11.484944 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=87 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:30:58.971960 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 11:30:58.972563 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Mon Jul 11 11:30:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e/os-volume_attachments (ip 10.222.0.26) !!! Jul 11 11:31:01.888802 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 11:31:01.889481 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Mon Jul 11 11:31:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e/os-volume_attachments (ip 10.222.0.26) !!! Jul 11 11:31:13.501189 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.wsgi [None req-3073bbbb-fe10-487f-ba97-573d690759a3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] HTTP exception thrown: Invalid volume: volume 17b56d0a-9749-4a6b-a75e-451a2bae3737 is already attached to instances: 3ae01e39-7148-4e87-9ae0-a95832b38101 Jul 11 11:31:13.502970 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-3073bbbb-fe10-487f-ba97-573d690759a3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Request method failure captured: Jul 11 11:31:13.502970 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: request: POST /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e/os-volume_attachments HTTP/1.1 Jul 11 11:31:13.502970 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Accept: application/json Jul 11 11:31:13.502970 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Accept-Encoding: identity Jul 11 11:31:13.502970 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Connection: close Jul 11 11:31:13.502970 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Content-Length: 74 Jul 11 11:31:13.502970 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Content-Type: application/json Jul 11 11:31:13.502970 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Host: 10.222.0.26 Jul 11 11:31:13.502970 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Openstack-System-Scope: None Jul 11 11:31:13.502970 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: User-Agent: python-urllib3/1.26.9 Jul 11 11:31:13.502970 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Auth-Token: gAAAAABizAjKhZCKBRh_2i_ADibIvclpyQsJlC0Pm2ZTkb1jefgGS4P1r24evggFjxf1wK4Yv07Vbp7P1Zyv4wsuAQZPiSvMMxoEP8Q4ky7m10lr9iMNQTD4S9hixFXxSjWxJNmm7W7ummIraXw3SPwDOPKNnCr7rjbMh-sv9HcW6WLSiPnZrFU Jul 11 11:31:13.502970 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Domain-Id: None Jul 11 11:31:13.502970 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Domain-Name: None Jul 11 11:31:13.502970 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Identity-Status: Confirmed Jul 11 11:31:13.502970 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Is-Admin-Project: True Jul 11 11:31:13.502970 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Domain-Id: default Jul 11 11:31:13.502970 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Domain-Name: Default Jul 11 11:31:13.502970 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Id: 1328a510264f4374baabad7b5243d8c2 Jul 11 11:31:13.502970 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Name: tempest-AttachVolumeNegativeTest-1544092161 Jul 11 11:31:13.502970 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Role: member,reader Jul 11 11:31:13.502970 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Roles: member,reader Jul 11 11:31:13.504562 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1328a510264f4374baabad7b5243d8c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1328a510264f4374baabad7b5243d8c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1328a510264f4374baabad7b5243d8c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1328a510264f4374baabad7b5243d8c2"}]}] Jul 11 11:31:13.504562 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Tenant: tempest-AttachVolumeNegativeTest-1544092161 Jul 11 11:31:13.504562 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Tenant-Id: 1328a510264f4374baabad7b5243d8c2 Jul 11 11:31:13.504562 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1544092161 Jul 11 11:31:13.504562 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User: tempest-AttachVolumeNegativeTest-1544092161-project Jul 11 11:31:13.504562 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Domain-Id: default Jul 11 11:31:13.504562 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Domain-Name: Default Jul 11 11:31:13.504562 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Id: cbcc15c786fb43669ac34a4897735c1d Jul 11 11:31:13.504562 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Name: tempest-AttachVolumeNegativeTest-1544092161-project Jul 11 11:31:13.504562 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Jul 11 11:31:13.504562 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: {"volumeAttachment": {"volumeId": "17b56d0a-9749-4a6b-a75e-451a2bae3737"}} Jul 11 11:31:13.504562 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: method: > Jul 11 11:31:13.505354 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: exception: Invalid volume: volume 17b56d0a-9749-4a6b-a75e-451a2bae3737 is already attached to instances: 3ae01e39-7148-4e87-9ae0-a95832b38101 Jul 11 11:31:13.505354 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: action_args: {'server_id': '93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e', 'body': {'volumeAttachment': {'volumeId': '17b56d0a-9749-4a6b-a75e-451a2bae3737'}}} Jul 11 11:31:13.505354 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 11:31:13.505354 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:31:13.505354 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 11 11:31:13.505354 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 11 11:31:13.505354 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 11 11:31:13.505354 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 11 11:31:13.505354 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 11 11:31:13.505354 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 11 11:31:13.505354 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 11 11:31:13.505354 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 11 11:31:13.505354 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 11 11:31:13.505354 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 11 11:31:13.505354 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 17b56d0a-9749-4a6b-a75e-451a2bae3737 is already attached to instances: 3ae01e39-7148-4e87-9ae0-a95832b38101 Jul 11 11:31:13.505354 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:31:13.505354 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:31:13.505354 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:31:13.505354 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:31:13.506614 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:31:13.506614 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:31:13.506614 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 11:31:13.506614 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 11:31:13.506614 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 11:31:13.506614 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 11:31:13.506614 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 11 11:31:13.506614 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 11 11:31:13.506614 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 11 11:31:13.506614 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 11 11:31:13.506614 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 11 11:31:13.506614 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 11 11:31:13.506614 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 11 11:31:13.506614 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 11 11:31:13.506614 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 17b56d0a-9749-4a6b-a75e-451a2bae3737 is already attached to instances: 3ae01e39-7148-4e87-9ae0-a95832b38101 Jul 11 11:31:13.506614 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:31:13.506614 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:31:13.506614 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:31:13.506614 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:31:13.506614 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:31:13.511227 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:31:13.511227 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 11:31:13.511227 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 11:31:13.511227 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 17b56d0a-9749-4a6b-a75e-451a2bae3737 is already attached to instances: 3ae01e39-7148-4e87-9ae0-a95832b38101 Jul 11 11:31:13.511227 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:31:13.511227 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-3073bbbb-fe10-487f-ba97-573d690759a3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Returning 400 to user: Invalid volume: volume 17b56d0a-9749-4a6b-a75e-451a2bae3737 is already attached to instances: 3ae01e39-7148-4e87-9ae0-a95832b38101 {{(pid=118322) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 11:31:13.511227 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-3073bbbb-fe10-487f-ba97-573d690759a3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "POST /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 77.704766 Jul 11 11:31:13.511227 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 316/630] 10.222.0.26 () {60 vars in 1322 bytes} [Mon Jul 11 11:29:55 2022] POST /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e/os-volume_attachments => generated 174 bytes in 77706 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 11 11:31:13.615534 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-6205ddec-3ce7-4208-8d0f-37feb49b78ec tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:13.616151 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-6205ddec-3ce7-4208-8d0f-37feb49b78ec tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:13.622211 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6205ddec-3ce7-4208-8d0f-37feb49b78ec tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:13.622660 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6205ddec-3ce7-4208-8d0f-37feb49b78ec tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:13.623466 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6205ddec-3ce7-4208-8d0f-37feb49b78ec tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:13.623958 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6205ddec-3ce7-4208-8d0f-37feb49b78ec tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:13.693073 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.objects.instance [None req-7a6c35a5-4187-43ec-9685-1c52eab25af9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lazy-loading 'services' on Instance uuid 2a79e2f0-60e3-40b6-aac8-665c0d755ecb {{(pid=118321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 11:31:13.763863 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-6205ddec-3ce7-4208-8d0f-37feb49b78ec tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:13.772634 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-6205ddec-3ce7-4208-8d0f-37feb49b78ec tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:13.774243 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-6205ddec-3ce7-4208-8d0f-37feb49b78ec tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:13.776068 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-6205ddec-3ce7-4208-8d0f-37feb49b78ec tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1752 microversion: 2.20 time: 0.269218 Jul 11 11:31:13.776732 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 317/631] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:31:13 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1752 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:31:13.838318 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-01365bed-eac8-407c-a1a0-7069f3ed69a5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "94f6dced-da4c-418c-9c3f-755ff9c12484"}} {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:31:13.839656 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-01365bed-eac8-407c-a1a0-7069f3ed69a5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:13.845721 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-01365bed-eac8-407c-a1a0-7069f3ed69a5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:13.846162 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-01365bed-eac8-407c-a1a0-7069f3ed69a5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:13.846914 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-01365bed-eac8-407c-a1a0-7069f3ed69a5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:13.847369 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-01365bed-eac8-407c-a1a0-7069f3ed69a5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:13.967468 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-7a6c35a5-4187-43ec-9685-1c52eab25af9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "DELETE /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments/6fa2e2da-5e0c-407c-9e56-3f40f519805e" status: 202 len: 0 microversion: 2.1 time: 72.565747 Jul 11 11:31:13.968174 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 315/632] 10.222.0.26 () {58 vars in 1415 bytes} [Mon Jul 11 11:30:01 2022] DELETE /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments/6fa2e2da-5e0c-407c-9e56-3f40f519805e => generated 0 bytes in 72567 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 11 11:31:13.974983 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-f0ab093b-aefe-4166-886e-3b99d55cb6d9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:13.975681 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-f0ab093b-aefe-4166-886e-3b99d55cb6d9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:13.982064 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f0ab093b-aefe-4166-886e-3b99d55cb6d9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:13.982517 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f0ab093b-aefe-4166-886e-3b99d55cb6d9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:13.983324 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f0ab093b-aefe-4166-886e-3b99d55cb6d9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:13.983762 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f0ab093b-aefe-4166-886e-3b99d55cb6d9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:14.009470 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-f0ab093b-aefe-4166-886e-3b99d55cb6d9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e] Going to try to terminate instance {{(pid=118321) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 11:31:14.309013 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-f0ab093b-aefe-4166-886e-3b99d55cb6d9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "DELETE /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e" status: 204 len: 0 microversion: 2.1 time: 0.339337 Jul 11 11:31:14.309605 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 316/633] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 11 11:31:13 2022] DELETE /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 11 11:31:14.315339 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-f45c72c1-703d-4a43-9524-6a4190b18c01 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:14.315911 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-f45c72c1-703d-4a43-9524-6a4190b18c01 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:14.321805 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f45c72c1-703d-4a43-9524-6a4190b18c01 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:14.322243 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f45c72c1-703d-4a43-9524-6a4190b18c01 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:14.322988 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f45c72c1-703d-4a43-9524-6a4190b18c01 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:14.323455 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f45c72c1-703d-4a43-9524-6a4190b18c01 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:14.476887 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.objects.instance [None req-f45c72c1-703d-4a43-9524-6a4190b18c01 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lazy-loading 'services' on Instance uuid 2a79e2f0-60e3-40b6-aac8-665c0d755ecb {{(pid=118321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 11:31:14.529615 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.wsgi [None req-f45c72c1-703d-4a43-9524-6a4190b18c01 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-30fa2a03-5d7d-4b7f-a27e-a8f94026bf4e) Jul 11 11:31:14.531960 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-f45c72c1-703d-4a43-9524-6a4190b18c01 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Request method failure captured: Jul 11 11:31:14.531960 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: request: DELETE /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments/6fa2e2da-5e0c-407c-9e56-3f40f519805e HTTP/1.1 Jul 11 11:31:14.531960 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Accept: application/json Jul 11 11:31:14.531960 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Accept-Encoding: identity Jul 11 11:31:14.531960 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Connection: close Jul 11 11:31:14.531960 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Content-Length: 0 Jul 11 11:31:14.531960 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Content-Type: application/json Jul 11 11:31:14.531960 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Host: 10.222.0.26 Jul 11 11:31:14.531960 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Openstack-System-Scope: None Jul 11 11:31:14.531960 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: User-Agent: python-urllib3/1.26.9 Jul 11 11:31:14.531960 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Auth-Token: gAAAAABizAjLO4PGFFyBld15DDnMmjOMiyTfdUbsyF5cUuFMKWxHvKhrCVTk7XeaeLJ6AedivEPaw_nguZ4-p4LDjB7T9a0W-yQx3Oeh_u82CdhrQ3J4zLhwezdPpzDSPXg3rjqJkU6X-m1m244kVxKJfdBOeXkvji1jVYDzL1HD6pHDIVJaMlQ Jul 11 11:31:14.531960 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Domain-Id: None Jul 11 11:31:14.531960 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Domain-Name: None Jul 11 11:31:14.531960 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Identity-Status: Confirmed Jul 11 11:31:14.531960 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Is-Admin-Project: True Jul 11 11:31:14.531960 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Domain-Id: default Jul 11 11:31:14.531960 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Domain-Name: Default Jul 11 11:31:14.531960 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Id: 5779b0ffa2244901a92adbee65b10421 Jul 11 11:31:14.531960 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Name: tempest-AttachVolumeTestJSON-1070974935 Jul 11 11:31:14.531960 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Role: member,reader Jul 11 11:31:14.531960 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Roles: member,reader Jul 11 11:31:14.533467 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5779b0ffa2244901a92adbee65b10421"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5779b0ffa2244901a92adbee65b10421"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5779b0ffa2244901a92adbee65b10421"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5779b0ffa2244901a92adbee65b10421"}]}] Jul 11 11:31:14.533467 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Tenant: tempest-AttachVolumeTestJSON-1070974935 Jul 11 11:31:14.533467 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Tenant-Id: 5779b0ffa2244901a92adbee65b10421 Jul 11 11:31:14.533467 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1070974935 Jul 11 11:31:14.533467 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User: tempest-AttachVolumeTestJSON-1070974935-project Jul 11 11:31:14.533467 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Domain-Id: default Jul 11 11:31:14.533467 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Domain-Name: Default Jul 11 11:31:14.533467 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Id: 15ff2cacb5c1450482597a2f5fa3c8a9 Jul 11 11:31:14.533467 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Name: tempest-AttachVolumeTestJSON-1070974935-project Jul 11 11:31:14.533467 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: method: > Jul 11 11:31:14.534254 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-30fa2a03-5d7d-4b7f-a27e-a8f94026bf4e) Jul 11 11:31:14.534254 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: action_args: {'server_id': '2a79e2f0-60e3-40b6-aac8-665c0d755ecb', 'id': '6fa2e2da-5e0c-407c-9e56-3f40f519805e'} Jul 11 11:31:14.534254 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 11:31:14.534254 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:31:14.534254 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 11 11:31:14.534254 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 11 11:31:14.534254 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 11 11:31:14.534254 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 11 11:31:14.534254 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 11 11:31:14.534254 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 11 11:31:14.534254 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 11 11:31:14.534254 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 11 11:31:14.534254 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 11 11:31:14.534254 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 11 11:31:14.534254 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 11 11:31:14.534254 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 11 11:31:14.534254 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 11:31:14.535533 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 11:31:14.535533 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 11:31:14.535533 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 11:31:14.535533 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-30fa2a03-5d7d-4b7f-a27e-a8f94026bf4e) Jul 11 11:31:14.535533 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:31:14.535533 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:31:14.535533 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:31:14.535533 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:31:14.535533 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 11 11:31:14.535533 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 11 11:31:14.535533 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 11 11:31:14.535533 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 11 11:31:14.535533 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 11 11:31:14.535533 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 11 11:31:14.535533 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 11 11:31:14.535533 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 11 11:31:14.535533 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 11 11:31:14.535533 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 11 11:31:14.535533 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 11 11:31:14.536971 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 11 11:31:14.536971 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 11 11:31:14.536971 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 11 11:31:14.536971 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 11 11:31:14.536971 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 11 11:31:14.536971 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 11 11:31:14.536971 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 11 11:31:14.536971 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 11:31:14.536971 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 11:31:14.536971 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 11:31:14.536971 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 11:31:14.536971 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-30fa2a03-5d7d-4b7f-a27e-a8f94026bf4e) Jul 11 11:31:14.536971 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:31:14.536971 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:31:14.536971 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:31:14.536971 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:31:14.536971 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 11 11:31:14.538169 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 11 11:31:14.538169 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 11 11:31:14.538169 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 11 11:31:14.538169 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 11 11:31:14.538169 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 11 11:31:14.538169 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 11 11:31:14.538169 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 11 11:31:14.538169 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 11 11:31:14.538169 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 11 11:31:14.538169 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 11 11:31:14.538169 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 11 11:31:14.538169 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-30fa2a03-5d7d-4b7f-a27e-a8f94026bf4e) Jul 11 11:31:14.538169 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:31:14.538169 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:31:14.538169 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:31:14.538169 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:31:14.538169 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:31:14.538169 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:31:14.540386 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 11:31:14.540386 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 11:31:14.540386 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 11:31:14.540386 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 11:31:14.540386 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 11 11:31:14.540386 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 11 11:31:14.540386 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-30fa2a03-5d7d-4b7f-a27e-a8f94026bf4e) Jul 11 11:31:14.540386 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:31:14.540386 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:31:14.540386 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:31:14.540386 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:31:14.540386 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:31:14.540386 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:31:14.540386 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 11:31:14.540386 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 11:31:14.540386 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-30fa2a03-5d7d-4b7f-a27e-a8f94026bf4e) Jul 11 11:31:14.540386 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:31:14.541379 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-f45c72c1-703d-4a43-9524-6a4190b18c01 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-30fa2a03-5d7d-4b7f-a27e-a8f94026bf4e) {{(pid=118321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 11:31:14.541379 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-f45c72c1-703d-4a43-9524-6a4190b18c01 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "DELETE /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments/6fa2e2da-5e0c-407c-9e56-3f40f519805e" status: 400 len: 269 microversion: 2.1 time: 0.222641 Jul 11 11:31:14.541379 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 317/634] 10.222.0.26 () {58 vars in 1415 bytes} [Mon Jul 11 11:31:14 2022] DELETE /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments/6fa2e2da-5e0c-407c-9e56-3f40f519805e => generated 269 bytes in 224 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 11 11:31:14.541379 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-3b4ce0a1-da34-4e6e-ab20-ead91c3fef11 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:14.541752 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-3b4ce0a1-da34-4e6e-ab20-ead91c3fef11 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:14.546171 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3b4ce0a1-da34-4e6e-ab20-ead91c3fef11 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:14.546635 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3b4ce0a1-da34-4e6e-ab20-ead91c3fef11 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:14.547415 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3b4ce0a1-da34-4e6e-ab20-ead91c3fef11 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:14.547853 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3b4ce0a1-da34-4e6e-ab20-ead91c3fef11 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:14.627689 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-01365bed-eac8-407c-a1a0-7069f3ed69a5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "POST /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.849611 Jul 11 11:31:14.628584 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 318/635] 10.222.0.26 () {60 vars in 1322 bytes} [Mon Jul 11 11:31:13 2022] POST /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6/os-volume_attachments => generated 194 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:31:14.634066 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-4cd0822c-ed43-4d9f-8719-d20bf344fb8d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:14.634654 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-4cd0822c-ed43-4d9f-8719-d20bf344fb8d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:14.640860 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4cd0822c-ed43-4d9f-8719-d20bf344fb8d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:14.641304 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4cd0822c-ed43-4d9f-8719-d20bf344fb8d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:14.642067 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4cd0822c-ed43-4d9f-8719-d20bf344fb8d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:14.642506 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4cd0822c-ed43-4d9f-8719-d20bf344fb8d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:14.668575 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-4cd0822c-ed43-4d9f-8719-d20bf344fb8d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Going to try to terminate instance {{(pid=118322) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 11:31:14.682488 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-3b4ce0a1-da34-4e6e-ab20-ead91c3fef11 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:14.691362 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-3b4ce0a1-da34-4e6e-ab20-ead91c3fef11 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:14.692907 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-3b4ce0a1-da34-4e6e-ab20-ead91c3fef11 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:14.694087 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-3b4ce0a1-da34-4e6e-ab20-ead91c3fef11 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1752 microversion: 2.20 time: 0.158984 Jul 11 11:31:14.694653 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 318/636] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:31:14 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1752 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:31:14.705822 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-c37f3b70-7bb3-40a2-9ce1-17f0b0bf201f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:14.705822 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-c37f3b70-7bb3-40a2-9ce1-17f0b0bf201f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:14.706115 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c37f3b70-7bb3-40a2-9ce1-17f0b0bf201f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:14.706594 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c37f3b70-7bb3-40a2-9ce1-17f0b0bf201f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:14.707406 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c37f3b70-7bb3-40a2-9ce1-17f0b0bf201f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:14.707838 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c37f3b70-7bb3-40a2-9ce1-17f0b0bf201f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:14.840699 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-c37f3b70-7bb3-40a2-9ce1-17f0b0bf201f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:14.848258 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-c37f3b70-7bb3-40a2-9ce1-17f0b0bf201f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e" status: 200 len: 1683 microversion: 2.1 time: 0.152628 Jul 11 11:31:14.848816 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 319/637] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:31:14 2022] GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:31:14.853197 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-876547dd-4e45-4b01-a892-9429a949804e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:14.854204 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-876547dd-4e45-4b01-a892-9429a949804e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:14.859795 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-876547dd-4e45-4b01-a892-9429a949804e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:14.860246 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-876547dd-4e45-4b01-a892-9429a949804e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:14.861005 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-876547dd-4e45-4b01-a892-9429a949804e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:14.861439 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-876547dd-4e45-4b01-a892-9429a949804e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:14.896184 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-876547dd-4e45-4b01-a892-9429a949804e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046330 Jul 11 11:31:14.896749 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 320/638] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:31:14 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:31:14.960640 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-4cd0822c-ed43-4d9f-8719-d20bf344fb8d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "DELETE /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 204 len: 0 microversion: 2.1 time: 0.330532 Jul 11 11:31:14.961154 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 319/639] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 11 11:31:14 2022] DELETE /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 11 11:31:14.968996 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-32fedd76-01a5-46ef-80b1-b97ff5e8c2a8 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:14.972613 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-32fedd76-01a5-46ef-80b1-b97ff5e8c2a8 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:14.976142 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-32fedd76-01a5-46ef-80b1-b97ff5e8c2a8 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:14.976585 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-32fedd76-01a5-46ef-80b1-b97ff5e8c2a8 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:14.977396 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-32fedd76-01a5-46ef-80b1-b97ff5e8c2a8 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:14.977827 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-32fedd76-01a5-46ef-80b1-b97ff5e8c2a8 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:15.106157 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-32fedd76-01a5-46ef-80b1-b97ff5e8c2a8 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:15.114099 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-32fedd76-01a5-46ef-80b1-b97ff5e8c2a8 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.148855 Jul 11 11:31:15.114647 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 321/640] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:31:14 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:31:15.714063 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-22de210d-b21f-4fd3-adb7-06a076fa4999 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:15.714875 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-22de210d-b21f-4fd3-adb7-06a076fa4999 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:15.721393 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-22de210d-b21f-4fd3-adb7-06a076fa4999 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:15.721842 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-22de210d-b21f-4fd3-adb7-06a076fa4999 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:15.722607 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-22de210d-b21f-4fd3-adb7-06a076fa4999 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:15.723045 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-22de210d-b21f-4fd3-adb7-06a076fa4999 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:15.862332 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-22de210d-b21f-4fd3-adb7-06a076fa4999 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:15.865872 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-a9cb55f4-9521-448a-83a4-52582fc6f4c4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:15.866376 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-a9cb55f4-9521-448a-83a4-52582fc6f4c4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:15.876141 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-22de210d-b21f-4fd3-adb7-06a076fa4999 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:15.877363 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a9cb55f4-9521-448a-83a4-52582fc6f4c4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:15.877910 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-22de210d-b21f-4fd3-adb7-06a076fa4999 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:15.878320 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a9cb55f4-9521-448a-83a4-52582fc6f4c4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:15.879080 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-22de210d-b21f-4fd3-adb7-06a076fa4999 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1752 microversion: 2.20 time: 0.169371 Jul 11 11:31:15.883429 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 320/641] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:31:15 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1752 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:31:15.884551 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a9cb55f4-9521-448a-83a4-52582fc6f4c4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:15.885017 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a9cb55f4-9521-448a-83a4-52582fc6f4c4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:15.911053 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-cccc418a-8502-42b8-915f-9bb874ae263d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:15.912190 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-cccc418a-8502-42b8-915f-9bb874ae263d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:15.919976 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cccc418a-8502-42b8-915f-9bb874ae263d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:15.920799 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cccc418a-8502-42b8-915f-9bb874ae263d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:15.921951 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cccc418a-8502-42b8-915f-9bb874ae263d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:15.922392 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cccc418a-8502-42b8-915f-9bb874ae263d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:15.959236 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-cccc418a-8502-42b8-915f-9bb874ae263d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054875 Jul 11 11:31:15.959739 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 321/642] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:31:15 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:31:16.131909 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-93e4ad4d-4d28-48c5-ba55-50737bea993e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:16.132518 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-93e4ad4d-4d28-48c5-ba55-50737bea993e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:16.138459 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-93e4ad4d-4d28-48c5-ba55-50737bea993e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:16.138906 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-93e4ad4d-4d28-48c5-ba55-50737bea993e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:16.139704 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-93e4ad4d-4d28-48c5-ba55-50737bea993e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:16.140143 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-93e4ad4d-4d28-48c5-ba55-50737bea993e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:16.142712 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-a9cb55f4-9521-448a-83a4-52582fc6f4c4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:16.159168 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-a9cb55f4-9521-448a-83a4-52582fc6f4c4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e" status: 200 len: 1683 microversion: 2.1 time: 0.297137 Jul 11 11:31:16.159968 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 322/643] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:31:15 2022] GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e => generated 1683 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:31:16.275985 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-93e4ad4d-4d28-48c5-ba55-50737bea993e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:16.283817 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-93e4ad4d-4d28-48c5-ba55-50737bea993e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.155744 Jul 11 11:31:16.284377 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 322/644] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:31:16 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:31:16.659842 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [req-f7049644-944e-4f74-9914-5eeec802b018 req-f6cc0a4e-fb04-4419-b6a6-b605b4a25277 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e", "name": "network-vif-deleted", "tag": "14c018a2-6bb9-4f49-bd4c-0dfd7f207193"}]} {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:31:16.668498 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [req-f7049644-944e-4f74-9914-5eeec802b018 req-f6cc0a4e-fb04-4419-b6a6-b605b4a25277 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:16.671187 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [req-f7049644-944e-4f74-9914-5eeec802b018 req-f6cc0a4e-fb04-4419-b6a6-b605b4a25277 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:16.680827 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.compute.server_external_events [req-f7049644-944e-4f74-9914-5eeec802b018 req-f6cc0a4e-fb04-4419-b6a6-b605b4a25277 service nova] Creating event network-vif-deleted:14c018a2-6bb9-4f49-bd4c-0dfd7f207193 for instance 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e on hv-cinder-84842 Jul 11 11:31:16.686075 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [req-f7049644-944e-4f74-9914-5eeec802b018 req-f6cc0a4e-fb04-4419-b6a6-b605b4a25277 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029707 Jul 11 11:31:16.687139 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 323/645] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 11:31:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:31:16.898264 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-8f08a124-8b1c-4eca-9dff-0d83e14c2601 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:16.898872 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-8f08a124-8b1c-4eca-9dff-0d83e14c2601 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:16.905478 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8f08a124-8b1c-4eca-9dff-0d83e14c2601 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:16.905929 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8f08a124-8b1c-4eca-9dff-0d83e14c2601 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:16.906728 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8f08a124-8b1c-4eca-9dff-0d83e14c2601 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:16.907216 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8f08a124-8b1c-4eca-9dff-0d83e14c2601 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:16.977608 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-578d66d4-82cd-4de7-8f3f-bedcf1ff8e0f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:16.982271 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-578d66d4-82cd-4de7-8f3f-bedcf1ff8e0f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:17.004239 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-578d66d4-82cd-4de7-8f3f-bedcf1ff8e0f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:17.004775 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-578d66d4-82cd-4de7-8f3f-bedcf1ff8e0f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:17.005737 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-578d66d4-82cd-4de7-8f3f-bedcf1ff8e0f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:17.006319 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-578d66d4-82cd-4de7-8f3f-bedcf1ff8e0f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:17.041553 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-578d66d4-82cd-4de7-8f3f-bedcf1ff8e0f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074892 Jul 11 11:31:17.042499 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 324/646] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:31:16 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:31:17.064247 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-8f08a124-8b1c-4eca-9dff-0d83e14c2601 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:17.080779 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-8f08a124-8b1c-4eca-9dff-0d83e14c2601 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:17.082352 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-8f08a124-8b1c-4eca-9dff-0d83e14c2601 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:17.083544 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-8f08a124-8b1c-4eca-9dff-0d83e14c2601 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1752 microversion: 2.20 time: 0.189461 Jul 11 11:31:17.084101 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 323/647] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:31:16 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1752 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 11:31:17.177024 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-f024a388-8b17-43d2-8fdb-e78c09b36f9f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:17.177634 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-f024a388-8b17-43d2-8fdb-e78c09b36f9f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:17.185205 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f024a388-8b17-43d2-8fdb-e78c09b36f9f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:17.185652 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f024a388-8b17-43d2-8fdb-e78c09b36f9f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:17.186689 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f024a388-8b17-43d2-8fdb-e78c09b36f9f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:17.187124 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f024a388-8b17-43d2-8fdb-e78c09b36f9f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:17.219550 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f024a388-8b17-43d2-8fdb-e78c09b36f9f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:17.219996 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f024a388-8b17-43d2-8fdb-e78c09b36f9f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:17.220446 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.objects.instance [None req-f024a388-8b17-43d2-8fdb-e78c09b36f9f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lazy-loading 'fault' on Instance uuid 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e {{(pid=118321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 11:31:17.265635 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-f024a388-8b17-43d2-8fdb-e78c09b36f9f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:17.273492 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-f024a388-8b17-43d2-8fdb-e78c09b36f9f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e" status: 200 len: 1332 microversion: 2.1 time: 0.100451 Jul 11 11:31:17.274953 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 325/648] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:31:17 2022] GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e => generated 1332 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:31:17.301264 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-9b0f51b4-2ab2-4bce-8138-9e0533bc3cf3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:17.301855 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-9b0f51b4-2ab2-4bce-8138-9e0533bc3cf3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:17.307800 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9b0f51b4-2ab2-4bce-8138-9e0533bc3cf3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:17.308245 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9b0f51b4-2ab2-4bce-8138-9e0533bc3cf3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:17.309002 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9b0f51b4-2ab2-4bce-8138-9e0533bc3cf3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:17.309444 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9b0f51b4-2ab2-4bce-8138-9e0533bc3cf3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:17.471242 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-9b0f51b4-2ab2-4bce-8138-9e0533bc3cf3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:17.471242 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-9b0f51b4-2ab2-4bce-8138-9e0533bc3cf3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.164162 Jul 11 11:31:17.471242 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 324/649] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:31:17 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:31:18.059720 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-08c57e1a-6505-4b1e-ab6f-8f24b76131a5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:18.059720 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-08c57e1a-6505-4b1e-ab6f-8f24b76131a5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:18.064111 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-08c57e1a-6505-4b1e-ab6f-8f24b76131a5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:18.064579 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-08c57e1a-6505-4b1e-ab6f-8f24b76131a5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:18.065409 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-08c57e1a-6505-4b1e-ab6f-8f24b76131a5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:18.065839 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-08c57e1a-6505-4b1e-ab6f-8f24b76131a5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:18.096989 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-08c57e1a-6505-4b1e-ab6f-8f24b76131a5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047791 Jul 11 11:31:18.097578 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 326/650] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:31:18 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:31:18.102947 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-2e44179a-8853-4859-91bd-e32566e4ef06 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:18.103645 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-2e44179a-8853-4859-91bd-e32566e4ef06 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:18.110129 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2e44179a-8853-4859-91bd-e32566e4ef06 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:18.110573 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2e44179a-8853-4859-91bd-e32566e4ef06 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:18.111364 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2e44179a-8853-4859-91bd-e32566e4ef06 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:18.111799 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2e44179a-8853-4859-91bd-e32566e4ef06 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:18.236567 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-2e44179a-8853-4859-91bd-e32566e4ef06 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:18.244970 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-2e44179a-8853-4859-91bd-e32566e4ef06 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:18.246468 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-2e44179a-8853-4859-91bd-e32566e4ef06 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:18.247669 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-2e44179a-8853-4859-91bd-e32566e4ef06 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1752 microversion: 2.20 time: 0.149151 Jul 11 11:31:18.248232 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 325/651] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:31:18 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1752 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 11:31:18.292325 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-e0aeda71-17ff-47f7-bda0-17c53af8a604 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:18.292866 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-e0aeda71-17ff-47f7-bda0-17c53af8a604 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:18.298946 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e0aeda71-17ff-47f7-bda0-17c53af8a604 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:18.299421 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e0aeda71-17ff-47f7-bda0-17c53af8a604 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:18.300173 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e0aeda71-17ff-47f7-bda0-17c53af8a604 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:18.300619 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e0aeda71-17ff-47f7-bda0-17c53af8a604 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:18.314036 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.wsgi [None req-e0aeda71-17ff-47f7-bda0-17c53af8a604 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] HTTP exception thrown: Instance 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e could not be found. Jul 11 11:31:18.315700 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-e0aeda71-17ff-47f7-bda0-17c53af8a604 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Request method failure captured: Jul 11 11:31:18.315700 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: request: GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e HTTP/1.1 Jul 11 11:31:18.315700 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Accept: application/json Jul 11 11:31:18.315700 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Accept-Encoding: identity Jul 11 11:31:18.315700 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Connection: close Jul 11 11:31:18.315700 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Content-Length: 0 Jul 11 11:31:18.315700 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Content-Type: application/json Jul 11 11:31:18.315700 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Host: 10.222.0.26 Jul 11 11:31:18.315700 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Openstack-System-Scope: None Jul 11 11:31:18.315700 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: User-Agent: python-urllib3/1.26.9 Jul 11 11:31:18.315700 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Auth-Token: gAAAAABizAjKhZCKBRh_2i_ADibIvclpyQsJlC0Pm2ZTkb1jefgGS4P1r24evggFjxf1wK4Yv07Vbp7P1Zyv4wsuAQZPiSvMMxoEP8Q4ky7m10lr9iMNQTD4S9hixFXxSjWxJNmm7W7ummIraXw3SPwDOPKNnCr7rjbMh-sv9HcW6WLSiPnZrFU Jul 11 11:31:18.315700 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Domain-Id: None Jul 11 11:31:18.315700 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Domain-Name: None Jul 11 11:31:18.315700 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Identity-Status: Confirmed Jul 11 11:31:18.315700 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Is-Admin-Project: True Jul 11 11:31:18.315700 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Domain-Id: default Jul 11 11:31:18.315700 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Domain-Name: Default Jul 11 11:31:18.315700 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Id: 1328a510264f4374baabad7b5243d8c2 Jul 11 11:31:18.315700 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Name: tempest-AttachVolumeNegativeTest-1544092161 Jul 11 11:31:18.315700 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Role: member,reader Jul 11 11:31:18.315700 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Roles: member,reader Jul 11 11:31:18.317152 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1328a510264f4374baabad7b5243d8c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1328a510264f4374baabad7b5243d8c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1328a510264f4374baabad7b5243d8c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1328a510264f4374baabad7b5243d8c2"}]}] Jul 11 11:31:18.317152 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Tenant: tempest-AttachVolumeNegativeTest-1544092161 Jul 11 11:31:18.317152 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Tenant-Id: 1328a510264f4374baabad7b5243d8c2 Jul 11 11:31:18.317152 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1544092161 Jul 11 11:31:18.317152 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User: tempest-AttachVolumeNegativeTest-1544092161-project Jul 11 11:31:18.317152 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Domain-Id: default Jul 11 11:31:18.317152 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Domain-Name: Default Jul 11 11:31:18.317152 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Id: cbcc15c786fb43669ac34a4897735c1d Jul 11 11:31:18.317152 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Name: tempest-AttachVolumeNegativeTest-1544092161-project Jul 11 11:31:18.317152 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: method: > Jul 11 11:31:18.317152 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: exception: Instance 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e could not be found. Jul 11 11:31:18.317152 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: action_args: {'id': '93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e'} Jul 11 11:31:18.318109 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 11:31:18.318109 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:31:18.318109 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 11:31:18.318109 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 11:31:18.318109 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 11:31:18.318109 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 11:31:18.318109 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 11:31:18.318109 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 11:31:18.318109 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 11:31:18.318109 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 11:31:18.318109 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e could not be found. Jul 11 11:31:18.318109 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:31:18.318109 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:31:18.318109 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:31:18.318109 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:31:18.318109 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:31:18.318109 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:31:18.318109 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 11:31:18.318109 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 11:31:18.318109 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 11:31:18.319598 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 11:31:18.319598 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 11:31:18.319598 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 11:31:18.319598 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 11:31:18.319598 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 11:31:18.319598 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 11:31:18.319598 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 11:31:18.319598 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e could not be found. Jul 11 11:31:18.319598 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:31:18.319598 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:31:18.319598 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:31:18.319598 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:31:18.319598 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:31:18.319598 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:31:18.319598 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 11:31:18.319598 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 11:31:18.319598 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e could not be found. Jul 11 11:31:18.319598 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:31:18.320975 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-e0aeda71-17ff-47f7-bda0-17c53af8a604 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Returning 404 to user: Instance 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e could not be found. {{(pid=118321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 11:31:18.320975 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-e0aeda71-17ff-47f7-bda0-17c53af8a604 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e" status: 404 len: 111 microversion: 2.1 time: 0.028888 Jul 11 11:31:18.320975 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 327/652] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:31:18 2022] GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 11:31:18.326253 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-3daab1cf-9b51-43d5-a7e7-b3626d9c9a08 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '.version_select at 0x7fb0101e6ee0>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:18.439915 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-3daab1cf-9b51-43d5-a7e7-b3626d9c9a08 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1069181504" status: 202 len: 0 microversion: 2.1 time: 0.117298 Jul 11 11:31:18.440428 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 326/653] 10.222.0.26 () {58 vars in 1220 bytes} [Mon Jul 11 11:31:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1069181504 => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 11:31:18.478054 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-9111f631-79d7-4d69-b95f-7637cdf13f0a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:18.478660 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-9111f631-79d7-4d69-b95f-7637cdf13f0a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:18.484708 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9111f631-79d7-4d69-b95f-7637cdf13f0a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:18.485155 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9111f631-79d7-4d69-b95f-7637cdf13f0a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:18.485908 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9111f631-79d7-4d69-b95f-7637cdf13f0a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:18.486335 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9111f631-79d7-4d69-b95f-7637cdf13f0a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:18.646702 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-9111f631-79d7-4d69-b95f-7637cdf13f0a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:18.654833 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-9111f631-79d7-4d69-b95f-7637cdf13f0a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.180583 Jul 11 11:31:18.667890 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 328/654] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:31:18 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:31:19.117335 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-adaf8899-29ea-4129-b457-fecc3029e1fe tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:19.118905 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-adaf8899-29ea-4129-b457-fecc3029e1fe tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:19.125798 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-adaf8899-29ea-4129-b457-fecc3029e1fe tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:19.126248 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-adaf8899-29ea-4129-b457-fecc3029e1fe tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:19.127015 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-adaf8899-29ea-4129-b457-fecc3029e1fe tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:19.127480 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-adaf8899-29ea-4129-b457-fecc3029e1fe tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:19.155064 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-adaf8899-29ea-4129-b457-fecc3029e1fe tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050047 Jul 11 11:31:19.155651 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 327/655] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:31:19 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:31:19.265586 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-d0b44be4-6bad-4ed5-b3db-dda8c1d00751 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:19.266205 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-d0b44be4-6bad-4ed5-b3db-dda8c1d00751 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:19.272819 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d0b44be4-6bad-4ed5-b3db-dda8c1d00751 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:19.273263 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d0b44be4-6bad-4ed5-b3db-dda8c1d00751 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:19.274016 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d0b44be4-6bad-4ed5-b3db-dda8c1d00751 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:19.274960 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d0b44be4-6bad-4ed5-b3db-dda8c1d00751 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:19.367353 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-b158a8d9-ceea-4552-93de-5cdc956f982e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:19.367855 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-b158a8d9-ceea-4552-93de-5cdc956f982e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:19.374016 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b158a8d9-ceea-4552-93de-5cdc956f982e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:19.374466 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b158a8d9-ceea-4552-93de-5cdc956f982e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:19.375231 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b158a8d9-ceea-4552-93de-5cdc956f982e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:19.375703 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b158a8d9-ceea-4552-93de-5cdc956f982e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:19.414099 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-d0b44be4-6bad-4ed5-b3db-dda8c1d00751 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:19.422961 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-d0b44be4-6bad-4ed5-b3db-dda8c1d00751 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:19.424484 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-d0b44be4-6bad-4ed5-b3db-dda8c1d00751 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:19.425668 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-d0b44be4-6bad-4ed5-b3db-dda8c1d00751 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1752 microversion: 2.20 time: 0.164145 Jul 11 11:31:19.426213 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 329/656] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:31:19 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1752 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:31:19.499701 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.objects.instance [None req-b158a8d9-ceea-4552-93de-5cdc956f982e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lazy-loading 'services' on Instance uuid 3ae01e39-7148-4e87-9ae0-a95832b38101 {{(pid=118322) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 11:31:19.671394 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-0288c1a0-9717-4a31-b35c-52a8ec6af565 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:19.672027 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-0288c1a0-9717-4a31-b35c-52a8ec6af565 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:19.678244 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0288c1a0-9717-4a31-b35c-52a8ec6af565 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:19.678698 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0288c1a0-9717-4a31-b35c-52a8ec6af565 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:19.679485 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0288c1a0-9717-4a31-b35c-52a8ec6af565 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:19.679922 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0288c1a0-9717-4a31-b35c-52a8ec6af565 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:19.698205 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:31:19.760663 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-b158a8d9-ceea-4552-93de-5cdc956f982e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments/17b56d0a-9749-4a6b-a75e-451a2bae3737" status: 202 len: 0 microversion: 2.1 time: 0.397047 Jul 11 11:31:19.761544 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 328/657] 10.222.0.26 () {58 vars in 1415 bytes} [Mon Jul 11 11:31:19 2022] DELETE /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments/17b56d0a-9749-4a6b-a75e-451a2bae3737 => generated 0 bytes in 399 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 11 11:31:19.769987 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-80369161-c8ca-4e9a-8abd-724235e54742 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:19.771062 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-80369161-c8ca-4e9a-8abd-724235e54742 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:19.777607 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-80369161-c8ca-4e9a-8abd-724235e54742 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:19.778057 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-80369161-c8ca-4e9a-8abd-724235e54742 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:19.778826 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-80369161-c8ca-4e9a-8abd-724235e54742 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:19.779894 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-80369161-c8ca-4e9a-8abd-724235e54742 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:19.813116 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-0288c1a0-9717-4a31-b35c-52a8ec6af565 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:19.819935 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-80369161-c8ca-4e9a-8abd-724235e54742 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054040 Jul 11 11:31:19.820611 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 329/658] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:31:19 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:31:19.820997 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-0288c1a0-9717-4a31-b35c-52a8ec6af565 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.153336 Jul 11 11:31:19.821558 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 330/659] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:31:19 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:31:20.166949 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-75baf5ab-a3bb-4ac7-9981-ca092ed7e2e8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:20.167898 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-75baf5ab-a3bb-4ac7-9981-ca092ed7e2e8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:20.174185 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-75baf5ab-a3bb-4ac7-9981-ca092ed7e2e8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:20.174627 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-75baf5ab-a3bb-4ac7-9981-ca092ed7e2e8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:20.175406 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-75baf5ab-a3bb-4ac7-9981-ca092ed7e2e8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:20.175838 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-75baf5ab-a3bb-4ac7-9981-ca092ed7e2e8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:20.191944 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:31:20.204080 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-75baf5ab-a3bb-4ac7-9981-ca092ed7e2e8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041544 Jul 11 11:31:20.204908 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 330/660] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:31:20 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:31:20.444593 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-83f69a8a-d167-4966-9e4d-39fbe7f0ebb2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:20.445235 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-83f69a8a-d167-4966-9e4d-39fbe7f0ebb2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:20.452343 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-83f69a8a-d167-4966-9e4d-39fbe7f0ebb2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:20.452842 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-83f69a8a-d167-4966-9e4d-39fbe7f0ebb2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:20.453602 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-83f69a8a-d167-4966-9e4d-39fbe7f0ebb2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:20.454038 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-83f69a8a-d167-4966-9e4d-39fbe7f0ebb2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:20.577967 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-83f69a8a-d167-4966-9e4d-39fbe7f0ebb2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:20.586211 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-83f69a8a-d167-4966-9e4d-39fbe7f0ebb2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:20.588327 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-83f69a8a-d167-4966-9e4d-39fbe7f0ebb2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:20.589474 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-83f69a8a-d167-4966-9e4d-39fbe7f0ebb2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1752 microversion: 2.20 time: 0.148787 Jul 11 11:31:20.590044 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 331/661] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:31:20 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1752 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:31:20.832162 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-fccc7a49-34a3-4f3d-b48c-d550a84fb9ef tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:20.833012 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-fccc7a49-34a3-4f3d-b48c-d550a84fb9ef tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:20.838534 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-8b8cd533-7c3e-41fe-9a7f-b90a24509ea4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:20.839164 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-8b8cd533-7c3e-41fe-9a7f-b90a24509ea4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:20.839709 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fccc7a49-34a3-4f3d-b48c-d550a84fb9ef tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:20.840166 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fccc7a49-34a3-4f3d-b48c-d550a84fb9ef tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:20.840933 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fccc7a49-34a3-4f3d-b48c-d550a84fb9ef tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:20.841371 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fccc7a49-34a3-4f3d-b48c-d550a84fb9ef tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:20.845201 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8b8cd533-7c3e-41fe-9a7f-b90a24509ea4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:20.845651 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8b8cd533-7c3e-41fe-9a7f-b90a24509ea4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:20.846414 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8b8cd533-7c3e-41fe-9a7f-b90a24509ea4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:20.846841 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8b8cd533-7c3e-41fe-9a7f-b90a24509ea4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:20.871244 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-fccc7a49-34a3-4f3d-b48c-d550a84fb9ef tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043111 Jul 11 11:31:20.871854 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 331/662] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:31:20 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:31:20.974703 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-8b8cd533-7c3e-41fe-9a7f-b90a24509ea4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:20.982808 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-8b8cd533-7c3e-41fe-9a7f-b90a24509ea4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.147988 Jul 11 11:31:20.983395 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 332/663] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:31:20 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:31:21.216284 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-6f4f64f8-f77d-4827-b0db-804bd92c9581 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:21.218317 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-6f4f64f8-f77d-4827-b0db-804bd92c9581 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:21.225692 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6f4f64f8-f77d-4827-b0db-804bd92c9581 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:21.226137 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6f4f64f8-f77d-4827-b0db-804bd92c9581 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:21.226909 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6f4f64f8-f77d-4827-b0db-804bd92c9581 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:21.227874 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6f4f64f8-f77d-4827-b0db-804bd92c9581 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:21.256505 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-6f4f64f8-f77d-4827-b0db-804bd92c9581 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044076 Jul 11 11:31:21.257057 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 332/664] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:31:21 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:31:21.608019 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-937a835c-1150-49a9-9bcf-b91d2375f944 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:21.608539 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-937a835c-1150-49a9-9bcf-b91d2375f944 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:21.614882 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-937a835c-1150-49a9-9bcf-b91d2375f944 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:21.615355 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-937a835c-1150-49a9-9bcf-b91d2375f944 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:21.616103 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-937a835c-1150-49a9-9bcf-b91d2375f944 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:21.616528 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-937a835c-1150-49a9-9bcf-b91d2375f944 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:21.744946 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-937a835c-1150-49a9-9bcf-b91d2375f944 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:21.753389 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-937a835c-1150-49a9-9bcf-b91d2375f944 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:21.754936 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-937a835c-1150-49a9-9bcf-b91d2375f944 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:21.756109 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-937a835c-1150-49a9-9bcf-b91d2375f944 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.153058 Jul 11 11:31:21.756668 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 333/665] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:31:21 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:31:21.882803 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-06cec142-6efd-4e1c-add4-12aa13ba37c5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:21.884189 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-06cec142-6efd-4e1c-add4-12aa13ba37c5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:21.890597 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-06cec142-6efd-4e1c-add4-12aa13ba37c5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:21.891046 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-06cec142-6efd-4e1c-add4-12aa13ba37c5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:21.891840 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-06cec142-6efd-4e1c-add4-12aa13ba37c5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:21.892274 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-06cec142-6efd-4e1c-add4-12aa13ba37c5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:21.922124 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-06cec142-6efd-4e1c-add4-12aa13ba37c5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042201 Jul 11 11:31:21.922124 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 333/666] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:31:21 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:31:22.003349 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-527eb65a-2e29-400f-92b8-4651eb477582 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:22.003967 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-527eb65a-2e29-400f-92b8-4651eb477582 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:22.010772 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-527eb65a-2e29-400f-92b8-4651eb477582 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:22.011223 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-527eb65a-2e29-400f-92b8-4651eb477582 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:22.012012 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-527eb65a-2e29-400f-92b8-4651eb477582 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:22.012452 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-527eb65a-2e29-400f-92b8-4651eb477582 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:22.138093 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-527eb65a-2e29-400f-92b8-4651eb477582 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:22.145799 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-527eb65a-2e29-400f-92b8-4651eb477582 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.147386 Jul 11 11:31:22.146366 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 334/667] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:31:21 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:31:22.268015 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-8890c94d-6f70-4ab9-92f7-2616e54e5e6e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:22.268938 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-8890c94d-6f70-4ab9-92f7-2616e54e5e6e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:22.275429 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8890c94d-6f70-4ab9-92f7-2616e54e5e6e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:22.275884 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8890c94d-6f70-4ab9-92f7-2616e54e5e6e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:22.276650 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8890c94d-6f70-4ab9-92f7-2616e54e5e6e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:22.277091 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8890c94d-6f70-4ab9-92f7-2616e54e5e6e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:22.304868 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-8890c94d-6f70-4ab9-92f7-2616e54e5e6e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040750 Jul 11 11:31:22.305911 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 334/668] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:31:22 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:31:22.775076 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-e8735be8-5bf8-4d07-8dbf-8018bb7cc728 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:22.775711 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-e8735be8-5bf8-4d07-8dbf-8018bb7cc728 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:22.781583 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e8735be8-5bf8-4d07-8dbf-8018bb7cc728 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:22.782030 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e8735be8-5bf8-4d07-8dbf-8018bb7cc728 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:22.782791 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e8735be8-5bf8-4d07-8dbf-8018bb7cc728 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:22.783215 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e8735be8-5bf8-4d07-8dbf-8018bb7cc728 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:22.911304 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-e8735be8-5bf8-4d07-8dbf-8018bb7cc728 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:22.919666 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-e8735be8-5bf8-4d07-8dbf-8018bb7cc728 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:22.921182 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-e8735be8-5bf8-4d07-8dbf-8018bb7cc728 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:22.922317 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-e8735be8-5bf8-4d07-8dbf-8018bb7cc728 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.151768 Jul 11 11:31:22.922911 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 335/669] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:31:22 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:31:22.932751 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-e98bda88-ea62-4601-9932-e2ca277f2531 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:22.934022 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-e98bda88-ea62-4601-9932-e2ca277f2531 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:22.940482 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e98bda88-ea62-4601-9932-e2ca277f2531 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:22.940941 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e98bda88-ea62-4601-9932-e2ca277f2531 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:22.941668 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e98bda88-ea62-4601-9932-e2ca277f2531 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:22.942095 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e98bda88-ea62-4601-9932-e2ca277f2531 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:22.972691 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-e98bda88-ea62-4601-9932-e2ca277f2531 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043842 Jul 11 11:31:22.973240 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 335/670] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:31:22 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:31:23.163188 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-59816041-512f-4fd1-b85c-3f5f690cd993 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:23.163825 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-59816041-512f-4fd1-b85c-3f5f690cd993 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:23.170793 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-59816041-512f-4fd1-b85c-3f5f690cd993 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:23.171239 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-59816041-512f-4fd1-b85c-3f5f690cd993 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:23.172018 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-59816041-512f-4fd1-b85c-3f5f690cd993 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:23.172450 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-59816041-512f-4fd1-b85c-3f5f690cd993 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:23.304114 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-59816041-512f-4fd1-b85c-3f5f690cd993 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:23.314402 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-59816041-512f-4fd1-b85c-3f5f690cd993 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.154966 Jul 11 11:31:23.315133 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 336/671] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:31:23 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:31:23.317155 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-8241f783-d50f-42fd-a6e6-431eae7c04a2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:23.318091 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-8241f783-d50f-42fd-a6e6-431eae7c04a2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:23.329796 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8241f783-d50f-42fd-a6e6-431eae7c04a2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:23.330251 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8241f783-d50f-42fd-a6e6-431eae7c04a2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:23.331029 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8241f783-d50f-42fd-a6e6-431eae7c04a2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:23.331513 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8241f783-d50f-42fd-a6e6-431eae7c04a2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:23.359389 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-8241f783-d50f-42fd-a6e6-431eae7c04a2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046159 Jul 11 11:31:23.359936 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 336/672] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:31:23 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:31:23.640625 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 11:31:23.640798 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Mon Jul 11 11:31:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 11:31:23.940193 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-6fa2c608-9223-4d09-8b64-333775b8f3f3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:23.945926 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-6fa2c608-9223-4d09-8b64-333775b8f3f3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:23.947608 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6fa2c608-9223-4d09-8b64-333775b8f3f3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:23.948051 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6fa2c608-9223-4d09-8b64-333775b8f3f3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:23.948842 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6fa2c608-9223-4d09-8b64-333775b8f3f3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:23.949488 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6fa2c608-9223-4d09-8b64-333775b8f3f3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:23.983324 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-607605b4-8d92-4f90-a628-1adb2046ada5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:23.984260 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-607605b4-8d92-4f90-a628-1adb2046ada5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:23.990444 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-607605b4-8d92-4f90-a628-1adb2046ada5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:23.990896 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-607605b4-8d92-4f90-a628-1adb2046ada5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:23.991694 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-607605b4-8d92-4f90-a628-1adb2046ada5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:23.992135 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-607605b4-8d92-4f90-a628-1adb2046ada5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:24.028980 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-607605b4-8d92-4f90-a628-1adb2046ada5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049495 Jul 11 11:31:24.029545 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 337/673] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:31:23 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:31:24.087433 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-6fa2c608-9223-4d09-8b64-333775b8f3f3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:24.096220 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-6fa2c608-9223-4d09-8b64-333775b8f3f3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:24.097722 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-6fa2c608-9223-4d09-8b64-333775b8f3f3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:24.098870 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-6fa2c608-9223-4d09-8b64-333775b8f3f3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.162964 Jul 11 11:31:24.099459 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 337/674] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:31:23 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:31:24.332037 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-36e54648-d6b5-4594-89cd-be0108464dee tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:24.332560 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-36e54648-d6b5-4594-89cd-be0108464dee tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:24.339560 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-36e54648-d6b5-4594-89cd-be0108464dee tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:24.340012 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-36e54648-d6b5-4594-89cd-be0108464dee tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:24.340764 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-36e54648-d6b5-4594-89cd-be0108464dee tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:24.341195 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-36e54648-d6b5-4594-89cd-be0108464dee tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:24.369871 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-5c66dec1-f42b-45de-b08e-df0625b9fd96 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:24.370850 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-5c66dec1-f42b-45de-b08e-df0625b9fd96 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:24.377436 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5c66dec1-f42b-45de-b08e-df0625b9fd96 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:24.377806 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5c66dec1-f42b-45de-b08e-df0625b9fd96 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:24.386815 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5c66dec1-f42b-45de-b08e-df0625b9fd96 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:24.386815 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5c66dec1-f42b-45de-b08e-df0625b9fd96 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:24.411839 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-5c66dec1-f42b-45de-b08e-df0625b9fd96 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045728 Jul 11 11:31:24.412391 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 338/675] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:31:24 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:31:24.473794 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-36e54648-d6b5-4594-89cd-be0108464dee tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:24.481495 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-36e54648-d6b5-4594-89cd-be0108464dee tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.153359 Jul 11 11:31:24.482088 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 338/676] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:31:24 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:31:25.040319 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-c71eb3f3-6f6a-4286-9cb4-61df5fe42497 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:25.041243 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-c71eb3f3-6f6a-4286-9cb4-61df5fe42497 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:25.076167 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c71eb3f3-6f6a-4286-9cb4-61df5fe42497 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:25.076611 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c71eb3f3-6f6a-4286-9cb4-61df5fe42497 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:25.077375 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c71eb3f3-6f6a-4286-9cb4-61df5fe42497 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:25.077806 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c71eb3f3-6f6a-4286-9cb4-61df5fe42497 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:25.107614 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-c71eb3f3-6f6a-4286-9cb4-61df5fe42497 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071132 Jul 11 11:31:25.108232 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 339/677] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:31:25 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:31:25.117398 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-e87a788f-083b-4378-8ae8-d2b1c2e807dc tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:25.118013 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-e87a788f-083b-4378-8ae8-d2b1c2e807dc tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:25.124186 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e87a788f-083b-4378-8ae8-d2b1c2e807dc tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:25.124632 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e87a788f-083b-4378-8ae8-d2b1c2e807dc tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:25.125388 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e87a788f-083b-4378-8ae8-d2b1c2e807dc tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:25.125822 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e87a788f-083b-4378-8ae8-d2b1c2e807dc tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:25.249992 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-e87a788f-083b-4378-8ae8-d2b1c2e807dc tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:25.258181 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-e87a788f-083b-4378-8ae8-d2b1c2e807dc tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:25.260245 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-e87a788f-083b-4378-8ae8-d2b1c2e807dc tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:25.261382 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-e87a788f-083b-4378-8ae8-d2b1c2e807dc tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.147837 Jul 11 11:31:25.261931 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 339/678] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:31:25 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:31:25.423355 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-9d4b45c0-d5ba-44cd-91c8-3ade256bb008 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:25.424284 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-9d4b45c0-d5ba-44cd-91c8-3ade256bb008 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:25.434274 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9d4b45c0-d5ba-44cd-91c8-3ade256bb008 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:25.434737 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9d4b45c0-d5ba-44cd-91c8-3ade256bb008 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:25.435532 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9d4b45c0-d5ba-44cd-91c8-3ade256bb008 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:25.435967 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9d4b45c0-d5ba-44cd-91c8-3ade256bb008 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:25.467684 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-9d4b45c0-d5ba-44cd-91c8-3ade256bb008 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048166 Jul 11 11:31:25.468243 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 340/679] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:31:25 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:31:25.498342 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-9629b9c1-0a4d-4152-a099-4d0437a37149 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:25.498945 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-9629b9c1-0a4d-4152-a099-4d0437a37149 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:25.505515 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9629b9c1-0a4d-4152-a099-4d0437a37149 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:25.505956 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9629b9c1-0a4d-4152-a099-4d0437a37149 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:25.506738 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9629b9c1-0a4d-4152-a099-4d0437a37149 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:25.507172 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9629b9c1-0a4d-4152-a099-4d0437a37149 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:25.639107 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-9629b9c1-0a4d-4152-a099-4d0437a37149 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:25.647086 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-9629b9c1-0a4d-4152-a099-4d0437a37149 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.152461 Jul 11 11:31:25.647610 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 340/680] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:31:25 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:31:26.119886 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-327b11a1-61a1-4d75-b110-b284ac9ecacf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:26.120957 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-327b11a1-61a1-4d75-b110-b284ac9ecacf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:26.126985 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-327b11a1-61a1-4d75-b110-b284ac9ecacf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:26.127460 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-327b11a1-61a1-4d75-b110-b284ac9ecacf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:26.128215 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-327b11a1-61a1-4d75-b110-b284ac9ecacf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:26.128649 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-327b11a1-61a1-4d75-b110-b284ac9ecacf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:26.156986 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-327b11a1-61a1-4d75-b110-b284ac9ecacf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041737 Jul 11 11:31:26.157538 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 341/681] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:31:26 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:31:26.279036 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-d33e6f76-19ed-48ba-8759-7c0cf3667037 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:26.279668 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-d33e6f76-19ed-48ba-8759-7c0cf3667037 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:26.285716 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d33e6f76-19ed-48ba-8759-7c0cf3667037 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:26.286158 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d33e6f76-19ed-48ba-8759-7c0cf3667037 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:26.286917 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d33e6f76-19ed-48ba-8759-7c0cf3667037 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:26.287382 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d33e6f76-19ed-48ba-8759-7c0cf3667037 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:26.414178 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-d33e6f76-19ed-48ba-8759-7c0cf3667037 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:26.423170 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-d33e6f76-19ed-48ba-8759-7c0cf3667037 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:26.424687 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-d33e6f76-19ed-48ba-8759-7c0cf3667037 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:26.425833 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-d33e6f76-19ed-48ba-8759-7c0cf3667037 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.150692 Jul 11 11:31:26.426389 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 341/682] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:31:26 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:31:26.479068 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-3942d422-999e-4f4b-afea-daeb52bb1059 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:26.480019 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-3942d422-999e-4f4b-afea-daeb52bb1059 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:26.486371 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3942d422-999e-4f4b-afea-daeb52bb1059 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:26.486816 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3942d422-999e-4f4b-afea-daeb52bb1059 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:26.487601 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3942d422-999e-4f4b-afea-daeb52bb1059 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:26.488030 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3942d422-999e-4f4b-afea-daeb52bb1059 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:26.516609 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-3942d422-999e-4f4b-afea-daeb52bb1059 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041523 Jul 11 11:31:26.517154 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 342/683] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:31:26 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:31:26.664613 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-0be6f512-e718-42fe-bd97-9731c0342a69 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:26.665727 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-0be6f512-e718-42fe-bd97-9731c0342a69 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:26.672184 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0be6f512-e718-42fe-bd97-9731c0342a69 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:26.672633 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0be6f512-e718-42fe-bd97-9731c0342a69 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:26.673390 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0be6f512-e718-42fe-bd97-9731c0342a69 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:26.673824 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0be6f512-e718-42fe-bd97-9731c0342a69 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:26.800186 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-0be6f512-e718-42fe-bd97-9731c0342a69 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:26.808417 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-0be6f512-e718-42fe-bd97-9731c0342a69 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.147665 Jul 11 11:31:26.808985 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 342/684] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:31:26 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:31:27.168478 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-00c029db-af01-4fc3-bca4-08e7cecd099c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:27.169384 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-00c029db-af01-4fc3-bca4-08e7cecd099c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:27.175457 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-00c029db-af01-4fc3-bca4-08e7cecd099c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:27.175901 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-00c029db-af01-4fc3-bca4-08e7cecd099c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:27.176645 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-00c029db-af01-4fc3-bca4-08e7cecd099c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:27.177069 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-00c029db-af01-4fc3-bca4-08e7cecd099c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:27.205264 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-00c029db-af01-4fc3-bca4-08e7cecd099c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040707 Jul 11 11:31:27.205799 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 343/685] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:31:27 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:31:27.443934 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-4bc38575-9c41-40f3-b3c8-5d1199c42d60 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:27.444558 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-4bc38575-9c41-40f3-b3c8-5d1199c42d60 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:27.451126 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4bc38575-9c41-40f3-b3c8-5d1199c42d60 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:27.451610 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4bc38575-9c41-40f3-b3c8-5d1199c42d60 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:27.452367 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4bc38575-9c41-40f3-b3c8-5d1199c42d60 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:27.452803 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4bc38575-9c41-40f3-b3c8-5d1199c42d60 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:27.529201 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-f185e6d4-e149-49f5-9989-821ab5fd6ae9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:27.530148 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-f185e6d4-e149-49f5-9989-821ab5fd6ae9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:27.536718 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f185e6d4-e149-49f5-9989-821ab5fd6ae9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:27.537276 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f185e6d4-e149-49f5-9989-821ab5fd6ae9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:27.538332 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f185e6d4-e149-49f5-9989-821ab5fd6ae9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:27.538585 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f185e6d4-e149-49f5-9989-821ab5fd6ae9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:27.570181 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-f185e6d4-e149-49f5-9989-821ab5fd6ae9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045856 Jul 11 11:31:27.570738 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 344/686] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:31:27 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:31:27.584318 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-4bc38575-9c41-40f3-b3c8-5d1199c42d60 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:27.593354 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-4bc38575-9c41-40f3-b3c8-5d1199c42d60 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:27.594876 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-4bc38575-9c41-40f3-b3c8-5d1199c42d60 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:27.596125 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-4bc38575-9c41-40f3-b3c8-5d1199c42d60 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.156101 Jul 11 11:31:27.596688 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 343/687] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:31:27 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:31:27.825536 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-17f82726-30cc-4679-9477-55948ffe2cf2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:27.826155 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-17f82726-30cc-4679-9477-55948ffe2cf2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:27.832167 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-17f82726-30cc-4679-9477-55948ffe2cf2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:27.832618 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-17f82726-30cc-4679-9477-55948ffe2cf2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:27.833378 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-17f82726-30cc-4679-9477-55948ffe2cf2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:27.833818 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-17f82726-30cc-4679-9477-55948ffe2cf2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:27.960349 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-17f82726-30cc-4679-9477-55948ffe2cf2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:27.969218 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-17f82726-30cc-4679-9477-55948ffe2cf2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.147541 Jul 11 11:31:27.969862 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 345/688] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:31:27 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:31:28.217141 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-03ee8bd3-dfd9-429b-ad47-eb3e1adee65d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:28.218102 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-03ee8bd3-dfd9-429b-ad47-eb3e1adee65d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:28.224579 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-03ee8bd3-dfd9-429b-ad47-eb3e1adee65d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:28.225016 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-03ee8bd3-dfd9-429b-ad47-eb3e1adee65d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:28.225758 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-03ee8bd3-dfd9-429b-ad47-eb3e1adee65d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:28.226191 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-03ee8bd3-dfd9-429b-ad47-eb3e1adee65d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:28.254258 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-03ee8bd3-dfd9-429b-ad47-eb3e1adee65d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041020 Jul 11 11:31:28.254786 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 344/689] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:31:28 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:31:28.581543 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-c662f19c-e56c-4a67-a7e4-38a3f03474dd tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:28.582538 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-c662f19c-e56c-4a67-a7e4-38a3f03474dd tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:28.588993 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c662f19c-e56c-4a67-a7e4-38a3f03474dd tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:28.589437 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c662f19c-e56c-4a67-a7e4-38a3f03474dd tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:28.590192 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c662f19c-e56c-4a67-a7e4-38a3f03474dd tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:28.590621 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c662f19c-e56c-4a67-a7e4-38a3f03474dd tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:28.614592 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-ffad1676-036e-44f3-bbe8-cd625c33bd01 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:28.615239 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-ffad1676-036e-44f3-bbe8-cd625c33bd01 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:28.620286 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-c662f19c-e56c-4a67-a7e4-38a3f03474dd tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042662 Jul 11 11:31:28.621098 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 346/690] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:31:28 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:31:28.621747 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ffad1676-036e-44f3-bbe8-cd625c33bd01 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:28.622200 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ffad1676-036e-44f3-bbe8-cd625c33bd01 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:28.622964 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ffad1676-036e-44f3-bbe8-cd625c33bd01 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:28.623439 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ffad1676-036e-44f3-bbe8-cd625c33bd01 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:28.752898 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-ffad1676-036e-44f3-bbe8-cd625c33bd01 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:28.761176 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-ffad1676-036e-44f3-bbe8-cd625c33bd01 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:28.762719 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-ffad1676-036e-44f3-bbe8-cd625c33bd01 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:28.763892 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-ffad1676-036e-44f3-bbe8-cd625c33bd01 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.153238 Jul 11 11:31:28.764460 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 345/691] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:31:28 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:31:28.986013 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-f3ad3e22-0b81-457f-95b3-abbd4a7bebd8 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:28.986659 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-f3ad3e22-0b81-457f-95b3-abbd4a7bebd8 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:28.992853 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f3ad3e22-0b81-457f-95b3-abbd4a7bebd8 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:28.993949 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f3ad3e22-0b81-457f-95b3-abbd4a7bebd8 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:28.994696 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f3ad3e22-0b81-457f-95b3-abbd4a7bebd8 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:28.995186 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f3ad3e22-0b81-457f-95b3-abbd4a7bebd8 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:29.003581 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=100 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:31:29.130321 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-f3ad3e22-0b81-457f-95b3-abbd4a7bebd8 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:29.138115 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-f3ad3e22-0b81-457f-95b3-abbd4a7bebd8 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.155934 Jul 11 11:31:29.138677 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 347/692] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:31:28 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:31:29.265916 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-dd283d93-64ad-4800-b925-1a93e9a249c9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:29.266751 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-dd283d93-64ad-4800-b925-1a93e9a249c9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:29.273103 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-dd283d93-64ad-4800-b925-1a93e9a249c9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:29.273545 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-dd283d93-64ad-4800-b925-1a93e9a249c9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:29.274785 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-dd283d93-64ad-4800-b925-1a93e9a249c9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:29.275213 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-dd283d93-64ad-4800-b925-1a93e9a249c9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:29.304473 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-dd283d93-64ad-4800-b925-1a93e9a249c9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042512 Jul 11 11:31:29.305024 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 346/693] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:31:29 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:31:29.631147 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-3361f56a-40ac-4719-bb07-4a68054aa682 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:29.632098 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-3361f56a-40ac-4719-bb07-4a68054aa682 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:29.638483 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3361f56a-40ac-4719-bb07-4a68054aa682 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:29.638935 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3361f56a-40ac-4719-bb07-4a68054aa682 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:29.639729 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3361f56a-40ac-4719-bb07-4a68054aa682 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:29.640171 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3361f56a-40ac-4719-bb07-4a68054aa682 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:29.668851 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-3361f56a-40ac-4719-bb07-4a68054aa682 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041591 Jul 11 11:31:29.669400 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 348/694] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:31:29 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:31:29.781234 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-0e9a103f-bcbe-483b-9c26-24e343fef97f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:29.781834 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-0e9a103f-bcbe-483b-9c26-24e343fef97f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:29.787779 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0e9a103f-bcbe-483b-9c26-24e343fef97f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:29.788221 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0e9a103f-bcbe-483b-9c26-24e343fef97f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:29.788969 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0e9a103f-bcbe-483b-9c26-24e343fef97f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:29.789398 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0e9a103f-bcbe-483b-9c26-24e343fef97f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:29.794035 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=100 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:31:29.920742 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-0e9a103f-bcbe-483b-9c26-24e343fef97f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:29.929129 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-0e9a103f-bcbe-483b-9c26-24e343fef97f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:29.931130 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-0e9a103f-bcbe-483b-9c26-24e343fef97f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:29.932346 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-0e9a103f-bcbe-483b-9c26-24e343fef97f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.155003 Jul 11 11:31:29.932908 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 347/695] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:31:29 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:31:30.154694 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-3b3c2ecf-33eb-4016-b708-a9b97706d5c4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:30.155388 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-3b3c2ecf-33eb-4016-b708-a9b97706d5c4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:30.161343 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3b3c2ecf-33eb-4016-b708-a9b97706d5c4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:30.161788 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3b3c2ecf-33eb-4016-b708-a9b97706d5c4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:30.162543 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3b3c2ecf-33eb-4016-b708-a9b97706d5c4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:30.163004 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3b3c2ecf-33eb-4016-b708-a9b97706d5c4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:30.291660 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-3b3c2ecf-33eb-4016-b708-a9b97706d5c4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:30.299470 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-3b3c2ecf-33eb-4016-b708-a9b97706d5c4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.148536 Jul 11 11:31:30.300033 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 349/696] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:31:30 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:31:30.316635 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-147ccf73-aea6-4d71-8689-c1f781b5e43f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:30.317556 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-147ccf73-aea6-4d71-8689-c1f781b5e43f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:30.324253 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-147ccf73-aea6-4d71-8689-c1f781b5e43f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:30.324698 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-147ccf73-aea6-4d71-8689-c1f781b5e43f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:30.325750 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-147ccf73-aea6-4d71-8689-c1f781b5e43f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:30.326180 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-147ccf73-aea6-4d71-8689-c1f781b5e43f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:30.364755 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-147ccf73-aea6-4d71-8689-c1f781b5e43f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052054 Jul 11 11:31:30.365314 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 348/697] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:31:30 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:31:30.679947 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-4c2d4af1-fd1a-4361-8acb-fdf059af80df tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:30.680914 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-4c2d4af1-fd1a-4361-8acb-fdf059af80df tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:30.687903 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4c2d4af1-fd1a-4361-8acb-fdf059af80df tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:30.691328 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4c2d4af1-fd1a-4361-8acb-fdf059af80df tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:30.691328 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4c2d4af1-fd1a-4361-8acb-fdf059af80df tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:30.691328 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4c2d4af1-fd1a-4361-8acb-fdf059af80df tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:30.720396 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-4c2d4af1-fd1a-4361-8acb-fdf059af80df tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044333 Jul 11 11:31:30.720960 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 350/698] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:31:30 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:31:30.950977 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-4662f328-114f-466e-b67a-7b346c8252c6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:30.951531 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-4662f328-114f-466e-b67a-7b346c8252c6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:30.957429 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4662f328-114f-466e-b67a-7b346c8252c6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:30.957868 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4662f328-114f-466e-b67a-7b346c8252c6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:30.958615 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4662f328-114f-466e-b67a-7b346c8252c6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:30.959041 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4662f328-114f-466e-b67a-7b346c8252c6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:31.086372 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-4662f328-114f-466e-b67a-7b346c8252c6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:31.095340 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-4662f328-114f-466e-b67a-7b346c8252c6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:31.096821 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-4662f328-114f-466e-b67a-7b346c8252c6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:31.097947 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-4662f328-114f-466e-b67a-7b346c8252c6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.150897 Jul 11 11:31:31.098501 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 349/699] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:31:30 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:31:31.318593 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-2e331c81-1246-41aa-8740-7a2e63e04141 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:31.319202 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-2e331c81-1246-41aa-8740-7a2e63e04141 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:31.325920 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2e331c81-1246-41aa-8740-7a2e63e04141 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:31.326371 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2e331c81-1246-41aa-8740-7a2e63e04141 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:31.327156 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2e331c81-1246-41aa-8740-7a2e63e04141 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:31.327631 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2e331c81-1246-41aa-8740-7a2e63e04141 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:31.376945 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-72cbf206-cea9-46c8-8bef-a959020afc9b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:31.377871 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-72cbf206-cea9-46c8-8bef-a959020afc9b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:31.384774 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-72cbf206-cea9-46c8-8bef-a959020afc9b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:31.385213 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-72cbf206-cea9-46c8-8bef-a959020afc9b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:31.385965 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-72cbf206-cea9-46c8-8bef-a959020afc9b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:31.386395 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-72cbf206-cea9-46c8-8bef-a959020afc9b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:31.414221 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-72cbf206-cea9-46c8-8bef-a959020afc9b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041268 Jul 11 11:31:31.414799 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 350/700] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:31:31 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:31:31.454499 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-2e331c81-1246-41aa-8740-7a2e63e04141 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:31.462352 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-2e331c81-1246-41aa-8740-7a2e63e04141 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.147478 Jul 11 11:31:31.462861 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 351/701] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:31:31 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:31:31.732351 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-9a974e6c-2c34-4700-8665-a3154c295e1c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:31.733288 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-9a974e6c-2c34-4700-8665-a3154c295e1c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:31.739268 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9a974e6c-2c34-4700-8665-a3154c295e1c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:31.739727 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9a974e6c-2c34-4700-8665-a3154c295e1c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:31.740476 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9a974e6c-2c34-4700-8665-a3154c295e1c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:31.740904 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9a974e6c-2c34-4700-8665-a3154c295e1c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:31.769682 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-9a974e6c-2c34-4700-8665-a3154c295e1c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041152 Jul 11 11:31:31.770847 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 351/702] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:31:31 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:31:32.115992 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-fea25255-8df0-46a3-9adf-23e5fd63078b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:32.116594 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-fea25255-8df0-46a3-9adf-23e5fd63078b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:32.123510 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fea25255-8df0-46a3-9adf-23e5fd63078b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:32.123950 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fea25255-8df0-46a3-9adf-23e5fd63078b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:32.124696 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fea25255-8df0-46a3-9adf-23e5fd63078b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:32.125122 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fea25255-8df0-46a3-9adf-23e5fd63078b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:32.254360 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-fea25255-8df0-46a3-9adf-23e5fd63078b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:32.263212 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-fea25255-8df0-46a3-9adf-23e5fd63078b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:32.264726 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-fea25255-8df0-46a3-9adf-23e5fd63078b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:32.265865 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-fea25255-8df0-46a3-9adf-23e5fd63078b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.153711 Jul 11 11:31:32.266419 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 352/703] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:31:32 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:31:32.425513 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-8d5d9234-23d5-4c30-9b4d-a3eba7f4310a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:32.426485 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-8d5d9234-23d5-4c30-9b4d-a3eba7f4310a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:32.433443 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8d5d9234-23d5-4c30-9b4d-a3eba7f4310a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:32.433887 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8d5d9234-23d5-4c30-9b4d-a3eba7f4310a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:32.434629 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8d5d9234-23d5-4c30-9b4d-a3eba7f4310a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:32.435057 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8d5d9234-23d5-4c30-9b4d-a3eba7f4310a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:32.463809 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-8d5d9234-23d5-4c30-9b4d-a3eba7f4310a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042186 Jul 11 11:31:32.464340 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 352/704] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:31:32 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:31:32.479383 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-0f03e67d-ce5b-489a-ae5c-57e23b2cc0b3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:32.479991 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-0f03e67d-ce5b-489a-ae5c-57e23b2cc0b3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:32.485840 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0f03e67d-ce5b-489a-ae5c-57e23b2cc0b3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:32.486285 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0f03e67d-ce5b-489a-ae5c-57e23b2cc0b3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:32.487036 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0f03e67d-ce5b-489a-ae5c-57e23b2cc0b3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:32.487577 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0f03e67d-ce5b-489a-ae5c-57e23b2cc0b3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:32.612092 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-0f03e67d-ce5b-489a-ae5c-57e23b2cc0b3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:32.620429 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-0f03e67d-ce5b-489a-ae5c-57e23b2cc0b3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.145329 Jul 11 11:31:32.620988 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 353/705] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:31:32 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:31:32.781635 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-4ab42cd2-b971-41a1-b7cd-0e174c53ee49 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:32.782603 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-4ab42cd2-b971-41a1-b7cd-0e174c53ee49 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:32.789159 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4ab42cd2-b971-41a1-b7cd-0e174c53ee49 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:32.789693 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4ab42cd2-b971-41a1-b7cd-0e174c53ee49 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:32.791022 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4ab42cd2-b971-41a1-b7cd-0e174c53ee49 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:32.791485 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4ab42cd2-b971-41a1-b7cd-0e174c53ee49 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:32.820434 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-4ab42cd2-b971-41a1-b7cd-0e174c53ee49 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042927 Jul 11 11:31:32.821242 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 353/706] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:31:32 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:31:33.284160 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-cd6a6dc1-32fa-49ef-b54f-7ee9c92b73c7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:33.284772 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-cd6a6dc1-32fa-49ef-b54f-7ee9c92b73c7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:33.291776 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-cd6a6dc1-32fa-49ef-b54f-7ee9c92b73c7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:33.292228 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-cd6a6dc1-32fa-49ef-b54f-7ee9c92b73c7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:33.292992 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-cd6a6dc1-32fa-49ef-b54f-7ee9c92b73c7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:33.293427 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-cd6a6dc1-32fa-49ef-b54f-7ee9c92b73c7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:33.420305 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-cd6a6dc1-32fa-49ef-b54f-7ee9c92b73c7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:33.428610 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-cd6a6dc1-32fa-49ef-b54f-7ee9c92b73c7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:33.430117 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-cd6a6dc1-32fa-49ef-b54f-7ee9c92b73c7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:33.431910 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-cd6a6dc1-32fa-49ef-b54f-7ee9c92b73c7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.151556 Jul 11 11:31:33.432476 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 354/707] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:31:33 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 11:31:33.475038 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-01a468e0-b92f-4ce4-bcd6-2bd2ae99a255 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:33.475984 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-01a468e0-b92f-4ce4-bcd6-2bd2ae99a255 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:33.482905 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-01a468e0-b92f-4ce4-bcd6-2bd2ae99a255 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:33.483381 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-01a468e0-b92f-4ce4-bcd6-2bd2ae99a255 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:33.484134 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-01a468e0-b92f-4ce4-bcd6-2bd2ae99a255 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:33.484565 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-01a468e0-b92f-4ce4-bcd6-2bd2ae99a255 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:33.512936 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-01a468e0-b92f-4ce4-bcd6-2bd2ae99a255 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041721 Jul 11 11:31:33.513479 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 354/708] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:31:33 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:31:33.636267 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-f75d0fb5-2c6e-4d76-8865-87fa1d10bd24 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:33.636811 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-f75d0fb5-2c6e-4d76-8865-87fa1d10bd24 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:33.642751 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f75d0fb5-2c6e-4d76-8865-87fa1d10bd24 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:33.643202 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f75d0fb5-2c6e-4d76-8865-87fa1d10bd24 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:33.643996 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f75d0fb5-2c6e-4d76-8865-87fa1d10bd24 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:33.644433 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f75d0fb5-2c6e-4d76-8865-87fa1d10bd24 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:33.771166 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-f75d0fb5-2c6e-4d76-8865-87fa1d10bd24 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:33.779615 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-f75d0fb5-2c6e-4d76-8865-87fa1d10bd24 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.147269 Jul 11 11:31:33.780189 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 355/709] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:31:33 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:31:33.832180 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-196c1aac-783b-4f0e-88ac-65c534759b20 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:33.833111 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-196c1aac-783b-4f0e-88ac-65c534759b20 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:33.840635 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-196c1aac-783b-4f0e-88ac-65c534759b20 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:33.841091 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-196c1aac-783b-4f0e-88ac-65c534759b20 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:33.841859 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-196c1aac-783b-4f0e-88ac-65c534759b20 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:33.842297 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-196c1aac-783b-4f0e-88ac-65c534759b20 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:33.873061 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-196c1aac-783b-4f0e-88ac-65c534759b20 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044692 Jul 11 11:31:33.873626 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 355/710] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:31:33 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:31:34.449344 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-d4ca8ce7-eb98-47d1-bb7c-b3e62809f81a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:34.449956 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-d4ca8ce7-eb98-47d1-bb7c-b3e62809f81a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:34.457264 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d4ca8ce7-eb98-47d1-bb7c-b3e62809f81a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:34.457700 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d4ca8ce7-eb98-47d1-bb7c-b3e62809f81a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:34.458454 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d4ca8ce7-eb98-47d1-bb7c-b3e62809f81a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:34.458980 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d4ca8ce7-eb98-47d1-bb7c-b3e62809f81a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:34.524469 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-039937ea-e1d7-4e60-aad2-cdfda11f1577 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:34.525397 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-039937ea-e1d7-4e60-aad2-cdfda11f1577 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:34.531798 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-039937ea-e1d7-4e60-aad2-cdfda11f1577 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:34.532251 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-039937ea-e1d7-4e60-aad2-cdfda11f1577 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:34.533018 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-039937ea-e1d7-4e60-aad2-cdfda11f1577 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:34.533456 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-039937ea-e1d7-4e60-aad2-cdfda11f1577 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:34.562890 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-039937ea-e1d7-4e60-aad2-cdfda11f1577 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042388 Jul 11 11:31:34.563485 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 356/711] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:31:34 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:31:34.584136 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-d4ca8ce7-eb98-47d1-bb7c-b3e62809f81a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:34.592338 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-d4ca8ce7-eb98-47d1-bb7c-b3e62809f81a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:34.593815 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-d4ca8ce7-eb98-47d1-bb7c-b3e62809f81a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:34.594947 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-d4ca8ce7-eb98-47d1-bb7c-b3e62809f81a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.149491 Jul 11 11:31:34.595527 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 356/712] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:31:34 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:31:34.797164 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-bbbfaa9c-b1dd-4639-9303-f7c6d60285bf tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:34.797687 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-bbbfaa9c-b1dd-4639-9303-f7c6d60285bf tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:34.803744 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-bbbfaa9c-b1dd-4639-9303-f7c6d60285bf tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:34.804179 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-bbbfaa9c-b1dd-4639-9303-f7c6d60285bf tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:34.804934 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-bbbfaa9c-b1dd-4639-9303-f7c6d60285bf tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:34.805362 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-bbbfaa9c-b1dd-4639-9303-f7c6d60285bf tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:34.884415 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-0941b53c-47b1-49e3-9f1e-99999a336a3b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:34.885320 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-0941b53c-47b1-49e3-9f1e-99999a336a3b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:34.895747 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0941b53c-47b1-49e3-9f1e-99999a336a3b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:34.896291 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0941b53c-47b1-49e3-9f1e-99999a336a3b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:34.897358 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0941b53c-47b1-49e3-9f1e-99999a336a3b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:34.897850 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0941b53c-47b1-49e3-9f1e-99999a336a3b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:34.929455 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-0941b53c-47b1-49e3-9f1e-99999a336a3b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048816 Jul 11 11:31:34.934578 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 357/713] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:31:34 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:31:34.941353 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-bbbfaa9c-b1dd-4639-9303-f7c6d60285bf tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:34.949323 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-bbbfaa9c-b1dd-4639-9303-f7c6d60285bf tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.156162 Jul 11 11:31:34.949879 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 357/714] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:31:34 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:31:35.574850 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-0d68d767-e8a8-4dd1-9222-076c83eb06e6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:35.575786 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-0d68d767-e8a8-4dd1-9222-076c83eb06e6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:35.582124 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0d68d767-e8a8-4dd1-9222-076c83eb06e6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:35.582569 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0d68d767-e8a8-4dd1-9222-076c83eb06e6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:35.583343 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0d68d767-e8a8-4dd1-9222-076c83eb06e6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:35.583775 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0d68d767-e8a8-4dd1-9222-076c83eb06e6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:35.612981 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-00d13447-3fb3-4b85-b3a9-0fa863894f2e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:35.613489 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-0d68d767-e8a8-4dd1-9222-076c83eb06e6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042949 Jul 11 11:31:35.613623 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-00d13447-3fb3-4b85-b3a9-0fa863894f2e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:35.613873 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 358/715] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:31:35 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:31:35.620206 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-00d13447-3fb3-4b85-b3a9-0fa863894f2e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:35.620664 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-00d13447-3fb3-4b85-b3a9-0fa863894f2e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:35.621428 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-00d13447-3fb3-4b85-b3a9-0fa863894f2e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:35.621865 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-00d13447-3fb3-4b85-b3a9-0fa863894f2e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:35.748281 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-00d13447-3fb3-4b85-b3a9-0fa863894f2e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:35.757002 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-00d13447-3fb3-4b85-b3a9-0fa863894f2e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:35.758514 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-00d13447-3fb3-4b85-b3a9-0fa863894f2e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:35.759699 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-00d13447-3fb3-4b85-b3a9-0fa863894f2e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.150596 Jul 11 11:31:35.760259 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 358/716] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:31:35 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 11:31:35.941587 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-2fd077af-fc69-413d-b7b3-4cc3d3e0b5ff tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:35.942500 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-2fd077af-fc69-413d-b7b3-4cc3d3e0b5ff tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:35.948563 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2fd077af-fc69-413d-b7b3-4cc3d3e0b5ff tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:35.948941 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2fd077af-fc69-413d-b7b3-4cc3d3e0b5ff tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:35.949718 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2fd077af-fc69-413d-b7b3-4cc3d3e0b5ff tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:35.950097 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2fd077af-fc69-413d-b7b3-4cc3d3e0b5ff tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:35.966144 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-283c6e4f-bdc8-4718-85e9-02455ec25de6 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:35.966990 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-283c6e4f-bdc8-4718-85e9-02455ec25de6 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:35.968893 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:31:35.973610 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-283c6e4f-bdc8-4718-85e9-02455ec25de6 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:35.974052 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-283c6e4f-bdc8-4718-85e9-02455ec25de6 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:35.974829 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-283c6e4f-bdc8-4718-85e9-02455ec25de6 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:35.975272 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-283c6e4f-bdc8-4718-85e9-02455ec25de6 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:35.981341 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-2fd077af-fc69-413d-b7b3-4cc3d3e0b5ff tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043624 Jul 11 11:31:35.990256 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 359/717] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:31:35 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:31:36.153823 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-283c6e4f-bdc8-4718-85e9-02455ec25de6 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:36.161790 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-283c6e4f-bdc8-4718-85e9-02455ec25de6 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.199917 Jul 11 11:31:36.162707 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 359/718] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:31:35 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:31:36.625167 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-374bddd6-a833-46a7-998d-e9edb3af2c3b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:36.626043 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-374bddd6-a833-46a7-998d-e9edb3af2c3b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:36.632536 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-374bddd6-a833-46a7-998d-e9edb3af2c3b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:36.632984 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-374bddd6-a833-46a7-998d-e9edb3af2c3b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:36.634395 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-374bddd6-a833-46a7-998d-e9edb3af2c3b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:36.634834 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-374bddd6-a833-46a7-998d-e9edb3af2c3b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:36.662403 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-374bddd6-a833-46a7-998d-e9edb3af2c3b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041237 Jul 11 11:31:36.662947 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 360/719] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:31:36 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:31:36.781689 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-ebdb2fcd-57d7-4dd3-950d-ea1054078586 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:36.782294 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-ebdb2fcd-57d7-4dd3-950d-ea1054078586 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:36.788792 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ebdb2fcd-57d7-4dd3-950d-ea1054078586 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:36.789243 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ebdb2fcd-57d7-4dd3-950d-ea1054078586 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:36.790017 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ebdb2fcd-57d7-4dd3-950d-ea1054078586 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:36.790449 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ebdb2fcd-57d7-4dd3-950d-ea1054078586 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:36.918068 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-ebdb2fcd-57d7-4dd3-950d-ea1054078586 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:36.926208 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-ebdb2fcd-57d7-4dd3-950d-ea1054078586 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:36.927742 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-ebdb2fcd-57d7-4dd3-950d-ea1054078586 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:36.928887 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-ebdb2fcd-57d7-4dd3-950d-ea1054078586 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.151127 Jul 11 11:31:36.929441 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 360/720] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:31:36 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:31:37.000243 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-98557a02-966e-41f0-9c38-881945bb86dc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:37.001148 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-98557a02-966e-41f0-9c38-881945bb86dc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:37.004089 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:31:37.007460 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-98557a02-966e-41f0-9c38-881945bb86dc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:37.012944 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-98557a02-966e-41f0-9c38-881945bb86dc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:37.012944 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-98557a02-966e-41f0-9c38-881945bb86dc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:37.012944 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-98557a02-966e-41f0-9c38-881945bb86dc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:37.038549 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-98557a02-966e-41f0-9c38-881945bb86dc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042210 Jul 11 11:31:37.039291 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 361/721] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:31:36 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:31:37.178497 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-f6be5d45-4cee-4887-992d-727518f36f02 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:37.179040 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-f6be5d45-4cee-4887-992d-727518f36f02 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:37.185577 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f6be5d45-4cee-4887-992d-727518f36f02 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:37.186023 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f6be5d45-4cee-4887-992d-727518f36f02 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:37.186777 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f6be5d45-4cee-4887-992d-727518f36f02 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:37.187488 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f6be5d45-4cee-4887-992d-727518f36f02 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:37.313825 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-f6be5d45-4cee-4887-992d-727518f36f02 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:37.321848 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-f6be5d45-4cee-4887-992d-727518f36f02 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.147242 Jul 11 11:31:37.322420 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 361/722] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:31:37 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:31:37.674192 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-a379e5db-cd65-4aa5-b890-526ff7fbf0e8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:37.675102 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-a379e5db-cd65-4aa5-b890-526ff7fbf0e8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:37.681614 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a379e5db-cd65-4aa5-b890-526ff7fbf0e8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:37.682058 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a379e5db-cd65-4aa5-b890-526ff7fbf0e8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:37.682819 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a379e5db-cd65-4aa5-b890-526ff7fbf0e8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:37.683271 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a379e5db-cd65-4aa5-b890-526ff7fbf0e8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:37.711465 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-a379e5db-cd65-4aa5-b890-526ff7fbf0e8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041484 Jul 11 11:31:37.712599 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 362/723] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:31:37 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:31:37.948254 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-d09dcd84-7f5d-4f4e-9a70-9566664a709a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:37.948857 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-d09dcd84-7f5d-4f4e-9a70-9566664a709a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:37.955301 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d09dcd84-7f5d-4f4e-9a70-9566664a709a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:37.955747 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d09dcd84-7f5d-4f4e-9a70-9566664a709a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:37.956493 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d09dcd84-7f5d-4f4e-9a70-9566664a709a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:37.956924 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d09dcd84-7f5d-4f4e-9a70-9566664a709a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:38.057661 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-147fa66d-2eb6-4579-bc34-ac2d7691b598 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:38.058585 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-147fa66d-2eb6-4579-bc34-ac2d7691b598 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:38.066842 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-147fa66d-2eb6-4579-bc34-ac2d7691b598 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:38.067309 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-147fa66d-2eb6-4579-bc34-ac2d7691b598 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:38.068088 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-147fa66d-2eb6-4579-bc34-ac2d7691b598 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:38.070322 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-147fa66d-2eb6-4579-bc34-ac2d7691b598 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:38.094823 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-d09dcd84-7f5d-4f4e-9a70-9566664a709a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:38.096726 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=100 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:31:38.101651 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-147fa66d-2eb6-4579-bc34-ac2d7691b598 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048931 Jul 11 11:31:38.102217 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 363/724] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:31:38 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:31:38.104318 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-d09dcd84-7f5d-4f4e-9a70-9566664a709a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:38.105870 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-d09dcd84-7f5d-4f4e-9a70-9566664a709a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:38.114424 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-d09dcd84-7f5d-4f4e-9a70-9566664a709a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.163272 Jul 11 11:31:38.114424 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 362/725] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:31:37 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:31:38.338540 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-2c73c163-e90f-4930-a9c6-0493ec033311 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:38.339145 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-2c73c163-e90f-4930-a9c6-0493ec033311 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:38.345407 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2c73c163-e90f-4930-a9c6-0493ec033311 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:38.345786 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2c73c163-e90f-4930-a9c6-0493ec033311 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:38.346528 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2c73c163-e90f-4930-a9c6-0493ec033311 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:38.346952 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2c73c163-e90f-4930-a9c6-0493ec033311 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:38.479657 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-2c73c163-e90f-4930-a9c6-0493ec033311 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:38.482916 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-2c73c163-e90f-4930-a9c6-0493ec033311 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.148175 Jul 11 11:31:38.483520 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 364/726] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:31:38 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:31:38.724042 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-2f0b727c-a88f-4d86-888c-c49808181c03 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:38.724973 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-2f0b727c-a88f-4d86-888c-c49808181c03 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:38.731655 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2f0b727c-a88f-4d86-888c-c49808181c03 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:38.732108 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2f0b727c-a88f-4d86-888c-c49808181c03 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:38.732869 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2f0b727c-a88f-4d86-888c-c49808181c03 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:38.733304 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2f0b727c-a88f-4d86-888c-c49808181c03 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:38.757536 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=100 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:31:38.761880 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-2f0b727c-a88f-4d86-888c-c49808181c03 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041829 Jul 11 11:31:38.762431 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 363/727] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:31:38 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:31:39.112485 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-8a48cefd-90d8-4b15-872c-4f975dee57fd tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:39.113408 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-8a48cefd-90d8-4b15-872c-4f975dee57fd tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:39.119948 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8a48cefd-90d8-4b15-872c-4f975dee57fd tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:39.120397 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8a48cefd-90d8-4b15-872c-4f975dee57fd tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:39.121165 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8a48cefd-90d8-4b15-872c-4f975dee57fd tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:39.121790 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8a48cefd-90d8-4b15-872c-4f975dee57fd tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:39.125528 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-df8ac822-bc14-4249-96ab-41afc89d243d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:39.126296 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-df8ac822-bc14-4249-96ab-41afc89d243d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:39.135666 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-df8ac822-bc14-4249-96ab-41afc89d243d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:39.136260 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-df8ac822-bc14-4249-96ab-41afc89d243d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:39.137228 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-df8ac822-bc14-4249-96ab-41afc89d243d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:39.137628 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-df8ac822-bc14-4249-96ab-41afc89d243d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:39.154893 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-8a48cefd-90d8-4b15-872c-4f975dee57fd tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046309 Jul 11 11:31:39.155498 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 365/728] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:31:39 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:31:39.268748 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-df8ac822-bc14-4249-96ab-41afc89d243d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:39.277812 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-df8ac822-bc14-4249-96ab-41afc89d243d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:39.279323 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-df8ac822-bc14-4249-96ab-41afc89d243d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:39.280466 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-df8ac822-bc14-4249-96ab-41afc89d243d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.158930 Jul 11 11:31:39.281024 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 364/729] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:31:39 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 11:31:39.499607 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-3f274757-c280-46c9-b9df-c7a912ad2181 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:39.500214 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-3f274757-c280-46c9-b9df-c7a912ad2181 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:39.506074 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3f274757-c280-46c9-b9df-c7a912ad2181 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:39.506519 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3f274757-c280-46c9-b9df-c7a912ad2181 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:39.507293 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3f274757-c280-46c9-b9df-c7a912ad2181 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:39.507729 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3f274757-c280-46c9-b9df-c7a912ad2181 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:39.636309 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-3f274757-c280-46c9-b9df-c7a912ad2181 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:39.644162 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-3f274757-c280-46c9-b9df-c7a912ad2181 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.148321 Jul 11 11:31:39.644721 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 366/730] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:31:39 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:31:39.773308 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-8e4ba49b-1684-40f0-b265-fd1f6a99797a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:39.774238 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-8e4ba49b-1684-40f0-b265-fd1f6a99797a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:39.780253 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8e4ba49b-1684-40f0-b265-fd1f6a99797a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:39.780704 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8e4ba49b-1684-40f0-b265-fd1f6a99797a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:39.781460 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8e4ba49b-1684-40f0-b265-fd1f6a99797a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:39.781898 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8e4ba49b-1684-40f0-b265-fd1f6a99797a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:39.810735 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-8e4ba49b-1684-40f0-b265-fd1f6a99797a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041183 Jul 11 11:31:39.811325 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 365/731] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:31:39 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:31:40.166569 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-0000154d-dada-4ccb-a4c6-619509ea3c4c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:40.167507 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-0000154d-dada-4ccb-a4c6-619509ea3c4c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:40.173894 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0000154d-dada-4ccb-a4c6-619509ea3c4c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:40.174335 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0000154d-dada-4ccb-a4c6-619509ea3c4c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:40.175114 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0000154d-dada-4ccb-a4c6-619509ea3c4c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:40.175569 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0000154d-dada-4ccb-a4c6-619509ea3c4c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:40.204700 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-0000154d-dada-4ccb-a4c6-619509ea3c4c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042586 Jul 11 11:31:40.205265 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 367/732] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:31:40 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:31:40.297798 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-97a3ffb0-3051-44b5-9c46-34afd1f00ab2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:40.298415 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-97a3ffb0-3051-44b5-9c46-34afd1f00ab2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:40.304961 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-97a3ffb0-3051-44b5-9c46-34afd1f00ab2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:40.305441 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-97a3ffb0-3051-44b5-9c46-34afd1f00ab2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:40.306202 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-97a3ffb0-3051-44b5-9c46-34afd1f00ab2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:40.306640 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-97a3ffb0-3051-44b5-9c46-34afd1f00ab2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:40.436747 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-97a3ffb0-3051-44b5-9c46-34afd1f00ab2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:40.445325 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-97a3ffb0-3051-44b5-9c46-34afd1f00ab2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:40.446845 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-97a3ffb0-3051-44b5-9c46-34afd1f00ab2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:40.448044 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-97a3ffb0-3051-44b5-9c46-34afd1f00ab2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.154195 Jul 11 11:31:40.448596 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 366/733] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:31:40 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:31:40.660755 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-fccb7ed9-621b-4ad0-ba2f-83874a9a5f26 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:40.661362 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-fccb7ed9-621b-4ad0-ba2f-83874a9a5f26 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:40.667960 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fccb7ed9-621b-4ad0-ba2f-83874a9a5f26 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:40.668403 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fccb7ed9-621b-4ad0-ba2f-83874a9a5f26 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:40.669155 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fccb7ed9-621b-4ad0-ba2f-83874a9a5f26 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:40.669585 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fccb7ed9-621b-4ad0-ba2f-83874a9a5f26 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:40.799452 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-fccb7ed9-621b-4ad0-ba2f-83874a9a5f26 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:40.807828 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-fccb7ed9-621b-4ad0-ba2f-83874a9a5f26 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.150877 Jul 11 11:31:40.808392 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 368/734] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:31:40 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:31:40.821974 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-41b7913a-bd21-4f05-b2e6-c14484175624 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:40.822887 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-41b7913a-bd21-4f05-b2e6-c14484175624 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:40.828792 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-41b7913a-bd21-4f05-b2e6-c14484175624 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:40.829234 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-41b7913a-bd21-4f05-b2e6-c14484175624 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:40.829980 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-41b7913a-bd21-4f05-b2e6-c14484175624 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:40.830409 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-41b7913a-bd21-4f05-b2e6-c14484175624 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:40.858210 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-41b7913a-bd21-4f05-b2e6-c14484175624 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040189 Jul 11 11:31:40.858771 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 367/735] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:31:40 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:31:41.216793 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-7f71cea6-aa58-4984-a32b-58bc43635014 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:41.217746 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-7f71cea6-aa58-4984-a32b-58bc43635014 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:41.224807 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7f71cea6-aa58-4984-a32b-58bc43635014 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:41.225279 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7f71cea6-aa58-4984-a32b-58bc43635014 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:41.226043 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7f71cea6-aa58-4984-a32b-58bc43635014 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:41.226476 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7f71cea6-aa58-4984-a32b-58bc43635014 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:41.255621 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-7f71cea6-aa58-4984-a32b-58bc43635014 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042641 Jul 11 11:31:41.256177 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 369/736] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:31:41 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:31:41.466227 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-0ec50baf-f4d5-4c73-a372-137af68ba3ef tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:41.466836 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-0ec50baf-f4d5-4c73-a372-137af68ba3ef tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:41.473201 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0ec50baf-f4d5-4c73-a372-137af68ba3ef tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:41.473847 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0ec50baf-f4d5-4c73-a372-137af68ba3ef tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:41.474587 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0ec50baf-f4d5-4c73-a372-137af68ba3ef tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:41.474970 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0ec50baf-f4d5-4c73-a372-137af68ba3ef tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:41.599307 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-0ec50baf-f4d5-4c73-a372-137af68ba3ef tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:41.607653 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-0ec50baf-f4d5-4c73-a372-137af68ba3ef tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:41.609148 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-0ec50baf-f4d5-4c73-a372-137af68ba3ef tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:41.610287 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-0ec50baf-f4d5-4c73-a372-137af68ba3ef tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.148534 Jul 11 11:31:41.610841 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 368/737] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:31:41 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:31:41.824794 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-83b4437c-f002-4bcc-922b-ffe7da10e6a8 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:41.825326 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-83b4437c-f002-4bcc-922b-ffe7da10e6a8 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:41.831424 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-83b4437c-f002-4bcc-922b-ffe7da10e6a8 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:41.831864 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-83b4437c-f002-4bcc-922b-ffe7da10e6a8 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:41.832610 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-83b4437c-f002-4bcc-922b-ffe7da10e6a8 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:41.833036 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-83b4437c-f002-4bcc-922b-ffe7da10e6a8 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:41.869694 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-11e545fc-7dee-4885-bee8-ce14e8dd47f2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:41.870793 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-11e545fc-7dee-4885-bee8-ce14e8dd47f2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:41.876944 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-11e545fc-7dee-4885-bee8-ce14e8dd47f2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:41.877471 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-11e545fc-7dee-4885-bee8-ce14e8dd47f2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:41.878275 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-11e545fc-7dee-4885-bee8-ce14e8dd47f2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:41.878714 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-11e545fc-7dee-4885-bee8-ce14e8dd47f2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:41.909958 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-11e545fc-7dee-4885-bee8-ce14e8dd47f2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044118 Jul 11 11:31:41.910534 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 369/738] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:31:41 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:31:41.962310 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-83b4437c-f002-4bcc-922b-ffe7da10e6a8 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:41.970389 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-83b4437c-f002-4bcc-922b-ffe7da10e6a8 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.149427 Jul 11 11:31:41.970947 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 370/739] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:31:41 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:31:42.267119 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-bf9e4bec-5ba9-4292-87e0-0049efdd6c66 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:42.268068 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-bf9e4bec-5ba9-4292-87e0-0049efdd6c66 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:42.273997 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-bf9e4bec-5ba9-4292-87e0-0049efdd6c66 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:42.275085 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-bf9e4bec-5ba9-4292-87e0-0049efdd6c66 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:42.275886 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-bf9e4bec-5ba9-4292-87e0-0049efdd6c66 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:42.276319 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-bf9e4bec-5ba9-4292-87e0-0049efdd6c66 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:42.305242 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-bf9e4bec-5ba9-4292-87e0-0049efdd6c66 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041932 Jul 11 11:31:42.305890 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 370/740] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:31:42 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:31:42.627881 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-653ea145-b418-45b5-bd77-d4cfd98646a4 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:42.628417 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-653ea145-b418-45b5-bd77-d4cfd98646a4 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:42.635520 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-653ea145-b418-45b5-bd77-d4cfd98646a4 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:42.635965 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-653ea145-b418-45b5-bd77-d4cfd98646a4 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:42.636715 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-653ea145-b418-45b5-bd77-d4cfd98646a4 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:42.637146 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-653ea145-b418-45b5-bd77-d4cfd98646a4 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:42.762183 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-653ea145-b418-45b5-bd77-d4cfd98646a4 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:42.770884 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-653ea145-b418-45b5-bd77-d4cfd98646a4 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:42.773675 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-653ea145-b418-45b5-bd77-d4cfd98646a4 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:42.773675 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-653ea145-b418-45b5-bd77-d4cfd98646a4 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.149520 Jul 11 11:31:42.774220 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 371/741] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:31:42 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:31:42.922060 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-baa14637-d24b-4a0c-8847-9b5c7e21cae8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:42.928468 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-baa14637-d24b-4a0c-8847-9b5c7e21cae8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:42.929406 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-baa14637-d24b-4a0c-8847-9b5c7e21cae8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:42.929858 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-baa14637-d24b-4a0c-8847-9b5c7e21cae8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:42.931286 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-baa14637-d24b-4a0c-8847-9b5c7e21cae8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:42.931726 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-baa14637-d24b-4a0c-8847-9b5c7e21cae8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:42.959917 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-baa14637-d24b-4a0c-8847-9b5c7e21cae8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041841 Jul 11 11:31:42.960466 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 371/742] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:31:42 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:31:42.988086 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-2ff0dcce-a3a5-4163-abdd-40e7c707cadd tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:42.988690 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-2ff0dcce-a3a5-4163-abdd-40e7c707cadd tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:42.995284 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2ff0dcce-a3a5-4163-abdd-40e7c707cadd tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:42.995732 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2ff0dcce-a3a5-4163-abdd-40e7c707cadd tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:42.996482 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2ff0dcce-a3a5-4163-abdd-40e7c707cadd tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:42.996916 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2ff0dcce-a3a5-4163-abdd-40e7c707cadd tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:43.132564 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-2ff0dcce-a3a5-4163-abdd-40e7c707cadd tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:43.140469 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-2ff0dcce-a3a5-4163-abdd-40e7c707cadd tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.156386 Jul 11 11:31:43.141030 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 372/743] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:31:42 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:31:43.317293 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-075a0f30-a77e-4c9a-a3fb-3a5dd3ba9fb7 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:43.318132 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-075a0f30-a77e-4c9a-a3fb-3a5dd3ba9fb7 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:43.324065 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-075a0f30-a77e-4c9a-a3fb-3a5dd3ba9fb7 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:43.324511 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-075a0f30-a77e-4c9a-a3fb-3a5dd3ba9fb7 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:43.325262 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-075a0f30-a77e-4c9a-a3fb-3a5dd3ba9fb7 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:43.325694 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-075a0f30-a77e-4c9a-a3fb-3a5dd3ba9fb7 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:43.354847 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-075a0f30-a77e-4c9a-a3fb-3a5dd3ba9fb7 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041542 Jul 11 11:31:43.355436 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 372/744] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:31:43 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:31:43.792270 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-9916d1d6-42fc-4bf7-9d87-392051131022 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:43.792882 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-9916d1d6-42fc-4bf7-9d87-392051131022 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:43.799396 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9916d1d6-42fc-4bf7-9d87-392051131022 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:43.799848 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9916d1d6-42fc-4bf7-9d87-392051131022 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:43.800603 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9916d1d6-42fc-4bf7-9d87-392051131022 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:43.801039 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9916d1d6-42fc-4bf7-9d87-392051131022 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:43.968485 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-9916d1d6-42fc-4bf7-9d87-392051131022 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:43.974064 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-50fbffa1-3393-4933-a2ed-4852ded4d0c5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:43.974991 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-50fbffa1-3393-4933-a2ed-4852ded4d0c5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:43.978076 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-9916d1d6-42fc-4bf7-9d87-392051131022 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:43.979636 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-9916d1d6-42fc-4bf7-9d87-392051131022 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:43.980789 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-9916d1d6-42fc-4bf7-9d87-392051131022 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.192904 Jul 11 11:31:43.981340 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 373/745] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:31:43 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:31:43.983175 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-50fbffa1-3393-4933-a2ed-4852ded4d0c5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:43.984283 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-50fbffa1-3393-4933-a2ed-4852ded4d0c5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:43.985830 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-50fbffa1-3393-4933-a2ed-4852ded4d0c5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:43.986729 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-50fbffa1-3393-4933-a2ed-4852ded4d0c5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:44.016465 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-50fbffa1-3393-4933-a2ed-4852ded4d0c5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047685 Jul 11 11:31:44.017040 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 373/746] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:31:43 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:31:44.157559 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-4048d1e7-ff1a-43f3-ae49-8596d3cbabfe tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:44.158140 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-4048d1e7-ff1a-43f3-ae49-8596d3cbabfe tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:44.164115 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4048d1e7-ff1a-43f3-ae49-8596d3cbabfe tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:44.164558 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4048d1e7-ff1a-43f3-ae49-8596d3cbabfe tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:44.165936 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4048d1e7-ff1a-43f3-ae49-8596d3cbabfe tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:44.166365 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4048d1e7-ff1a-43f3-ae49-8596d3cbabfe tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:44.293726 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-4048d1e7-ff1a-43f3-ae49-8596d3cbabfe tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:44.301639 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-4048d1e7-ff1a-43f3-ae49-8596d3cbabfe tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.148005 Jul 11 11:31:44.302220 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 374/747] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:31:44 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:31:44.366354 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-d56c888b-2452-4f3d-9b6c-8c17d6f8daaa tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:44.367203 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-d56c888b-2452-4f3d-9b6c-8c17d6f8daaa tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:44.373086 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d56c888b-2452-4f3d-9b6c-8c17d6f8daaa tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:44.373530 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d56c888b-2452-4f3d-9b6c-8c17d6f8daaa tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:44.374280 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d56c888b-2452-4f3d-9b6c-8c17d6f8daaa tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:44.374713 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d56c888b-2452-4f3d-9b6c-8c17d6f8daaa tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:44.407202 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-d56c888b-2452-4f3d-9b6c-8c17d6f8daaa tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044755 Jul 11 11:31:44.407817 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 374/748] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:31:44 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:31:44.999067 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-1828834f-55a6-4011-b364-0c7dcd66220b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:44.999703 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-1828834f-55a6-4011-b364-0c7dcd66220b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:45.006215 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1828834f-55a6-4011-b364-0c7dcd66220b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:45.006660 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1828834f-55a6-4011-b364-0c7dcd66220b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:45.007485 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1828834f-55a6-4011-b364-0c7dcd66220b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:45.007916 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1828834f-55a6-4011-b364-0c7dcd66220b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:45.028590 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-a243900b-88ff-4208-80f1-e3a812ec5d99 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:45.029514 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-a243900b-88ff-4208-80f1-e3a812ec5d99 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:45.036252 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a243900b-88ff-4208-80f1-e3a812ec5d99 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:45.036724 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a243900b-88ff-4208-80f1-e3a812ec5d99 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:45.037500 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a243900b-88ff-4208-80f1-e3a812ec5d99 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:45.037928 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a243900b-88ff-4208-80f1-e3a812ec5d99 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:45.071764 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-a243900b-88ff-4208-80f1-e3a812ec5d99 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047637 Jul 11 11:31:45.072330 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 375/749] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:31:45 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:31:45.135766 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-1828834f-55a6-4011-b364-0c7dcd66220b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:45.143991 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-1828834f-55a6-4011-b364-0c7dcd66220b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:45.145494 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-1828834f-55a6-4011-b364-0c7dcd66220b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:45.146623 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-1828834f-55a6-4011-b364-0c7dcd66220b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.151459 Jul 11 11:31:45.147178 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 375/750] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:31:44 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:31:45.318922 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-130f268b-b4cf-4ff9-867a-63a3e21a7c58 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:45.319569 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-130f268b-b4cf-4ff9-867a-63a3e21a7c58 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:45.326269 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-130f268b-b4cf-4ff9-867a-63a3e21a7c58 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:45.326713 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-130f268b-b4cf-4ff9-867a-63a3e21a7c58 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:45.327488 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-130f268b-b4cf-4ff9-867a-63a3e21a7c58 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:45.327918 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-130f268b-b4cf-4ff9-867a-63a3e21a7c58 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:45.418291 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-8b21dac3-6e6f-42a2-bb54-9e06773b8986 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:45.419346 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-8b21dac3-6e6f-42a2-bb54-9e06773b8986 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:45.425526 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8b21dac3-6e6f-42a2-bb54-9e06773b8986 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:45.429925 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8b21dac3-6e6f-42a2-bb54-9e06773b8986 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:45.429925 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8b21dac3-6e6f-42a2-bb54-9e06773b8986 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:45.429925 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8b21dac3-6e6f-42a2-bb54-9e06773b8986 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:45.458790 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-8b21dac3-6e6f-42a2-bb54-9e06773b8986 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044555 Jul 11 11:31:45.464345 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-130f268b-b4cf-4ff9-867a-63a3e21a7c58 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:45.464509 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 376/751] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:31:45 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:31:45.467369 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-130f268b-b4cf-4ff9-867a-63a3e21a7c58 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.152576 Jul 11 11:31:45.468086 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 376/752] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:31:45 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:31:46.083361 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-a72032fb-a58c-4a45-a950-3194bb6cba03 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:46.084280 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-a72032fb-a58c-4a45-a950-3194bb6cba03 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:46.091276 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a72032fb-a58c-4a45-a950-3194bb6cba03 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:46.091753 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a72032fb-a58c-4a45-a950-3194bb6cba03 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:46.092573 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a72032fb-a58c-4a45-a950-3194bb6cba03 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:46.092946 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a72032fb-a58c-4a45-a950-3194bb6cba03 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:46.131626 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-a72032fb-a58c-4a45-a950-3194bb6cba03 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052113 Jul 11 11:31:46.132202 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 377/753] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:31:46 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:31:46.165153 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-868c270f-e1e4-4d1f-a176-324d4b8be92f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:46.166362 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-868c270f-e1e4-4d1f-a176-324d4b8be92f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:46.173708 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-868c270f-e1e4-4d1f-a176-324d4b8be92f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:46.174398 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-868c270f-e1e4-4d1f-a176-324d4b8be92f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:46.175281 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-868c270f-e1e4-4d1f-a176-324d4b8be92f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:46.175949 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-868c270f-e1e4-4d1f-a176-324d4b8be92f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:46.304772 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-868c270f-e1e4-4d1f-a176-324d4b8be92f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:46.313332 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-868c270f-e1e4-4d1f-a176-324d4b8be92f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:46.314866 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-868c270f-e1e4-4d1f-a176-324d4b8be92f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:46.316040 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-868c270f-e1e4-4d1f-a176-324d4b8be92f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.154793 Jul 11 11:31:46.316605 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 377/754] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:31:46 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:31:46.470463 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-f4214912-010c-4985-8a01-5b8e475cf25d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:46.471509 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-f4214912-010c-4985-8a01-5b8e475cf25d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:46.477504 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f4214912-010c-4985-8a01-5b8e475cf25d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:46.477944 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f4214912-010c-4985-8a01-5b8e475cf25d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:46.478703 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f4214912-010c-4985-8a01-5b8e475cf25d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:46.479144 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f4214912-010c-4985-8a01-5b8e475cf25d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:46.484091 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-cf136c3d-4013-4087-a551-5863598c64b5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:46.484731 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-cf136c3d-4013-4087-a551-5863598c64b5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:46.490852 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cf136c3d-4013-4087-a551-5863598c64b5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:46.491335 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cf136c3d-4013-4087-a551-5863598c64b5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:46.492259 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cf136c3d-4013-4087-a551-5863598c64b5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:46.492700 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cf136c3d-4013-4087-a551-5863598c64b5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:46.510872 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-f4214912-010c-4985-8a01-5b8e475cf25d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044300 Jul 11 11:31:46.511638 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 378/755] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:31:46 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:31:46.625957 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-cf136c3d-4013-4087-a551-5863598c64b5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:46.634320 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-cf136c3d-4013-4087-a551-5863598c64b5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.153532 Jul 11 11:31:46.634878 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 378/756] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:31:46 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:31:47.142998 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-964706a8-3bd3-46bd-bfcf-469eac655d0f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:47.143934 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-964706a8-3bd3-46bd-bfcf-469eac655d0f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:47.150848 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-964706a8-3bd3-46bd-bfcf-469eac655d0f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:47.151314 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-964706a8-3bd3-46bd-bfcf-469eac655d0f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:47.152070 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-964706a8-3bd3-46bd-bfcf-469eac655d0f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:47.152498 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-964706a8-3bd3-46bd-bfcf-469eac655d0f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:47.180258 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-964706a8-3bd3-46bd-bfcf-469eac655d0f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041189 Jul 11 11:31:47.180809 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 379/757] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:31:47 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:31:47.333815 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-8da25107-fad3-4af8-a328-5245bb9c2ed1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:47.334374 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-8da25107-fad3-4af8-a328-5245bb9c2ed1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:47.341404 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8da25107-fad3-4af8-a328-5245bb9c2ed1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:47.341854 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8da25107-fad3-4af8-a328-5245bb9c2ed1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:47.342617 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8da25107-fad3-4af8-a328-5245bb9c2ed1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:47.343052 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8da25107-fad3-4af8-a328-5245bb9c2ed1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:47.477635 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-8da25107-fad3-4af8-a328-5245bb9c2ed1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:47.485970 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-8da25107-fad3-4af8-a328-5245bb9c2ed1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:47.487518 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-8da25107-fad3-4af8-a328-5245bb9c2ed1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:47.488698 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-8da25107-fad3-4af8-a328-5245bb9c2ed1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.158835 Jul 11 11:31:47.489259 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 379/758] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:31:47 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:31:47.521945 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-9ec19711-5f44-4d09-ba2f-307878139fac tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:47.522887 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-9ec19711-5f44-4d09-ba2f-307878139fac tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:47.528786 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9ec19711-5f44-4d09-ba2f-307878139fac tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:47.529235 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9ec19711-5f44-4d09-ba2f-307878139fac tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:47.529998 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9ec19711-5f44-4d09-ba2f-307878139fac tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:47.530430 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9ec19711-5f44-4d09-ba2f-307878139fac tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:47.546415 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=100 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:31:47.559690 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-9ec19711-5f44-4d09-ba2f-307878139fac tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041535 Jul 11 11:31:47.560279 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 380/759] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:31:47 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:31:47.650873 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-33e16574-4bb4-4ef2-a60b-e0db57702943 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:47.655442 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-33e16574-4bb4-4ef2-a60b-e0db57702943 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:47.657579 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-33e16574-4bb4-4ef2-a60b-e0db57702943 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:47.658027 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-33e16574-4bb4-4ef2-a60b-e0db57702943 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:47.658785 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-33e16574-4bb4-4ef2-a60b-e0db57702943 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:47.659223 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-33e16574-4bb4-4ef2-a60b-e0db57702943 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:47.676321 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=100 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:31:47.784536 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-33e16574-4bb4-4ef2-a60b-e0db57702943 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:47.794276 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-33e16574-4bb4-4ef2-a60b-e0db57702943 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.146762 Jul 11 11:31:47.795628 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 380/760] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:31:47 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:31:48.192289 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-7b9319b3-c1cd-4e7e-8952-35a38562a5de tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:48.193255 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-7b9319b3-c1cd-4e7e-8952-35a38562a5de tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:48.200202 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7b9319b3-c1cd-4e7e-8952-35a38562a5de tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:48.200650 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7b9319b3-c1cd-4e7e-8952-35a38562a5de tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:48.201414 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7b9319b3-c1cd-4e7e-8952-35a38562a5de tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:48.201844 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7b9319b3-c1cd-4e7e-8952-35a38562a5de tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:48.230954 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-7b9319b3-c1cd-4e7e-8952-35a38562a5de tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042623 Jul 11 11:31:48.231551 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 381/761] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:31:48 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:31:48.507372 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-ac1134f0-731f-4731-8a35-81ac93d56b5b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:48.507989 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-ac1134f0-731f-4731-8a35-81ac93d56b5b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:48.514535 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ac1134f0-731f-4731-8a35-81ac93d56b5b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:48.515009 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ac1134f0-731f-4731-8a35-81ac93d56b5b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:48.515821 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ac1134f0-731f-4731-8a35-81ac93d56b5b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:48.516267 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ac1134f0-731f-4731-8a35-81ac93d56b5b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:48.572151 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-6ccacd34-4b14-42da-918b-03d9af4a4575 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:48.573078 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-6ccacd34-4b14-42da-918b-03d9af4a4575 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:48.580651 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6ccacd34-4b14-42da-918b-03d9af4a4575 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:48.581178 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6ccacd34-4b14-42da-918b-03d9af4a4575 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:48.582708 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6ccacd34-4b14-42da-918b-03d9af4a4575 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:48.583150 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6ccacd34-4b14-42da-918b-03d9af4a4575 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:48.613049 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-6ccacd34-4b14-42da-918b-03d9af4a4575 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045400 Jul 11 11:31:48.613802 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 382/762] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:31:48 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:31:48.649294 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-ac1134f0-731f-4731-8a35-81ac93d56b5b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:48.658357 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-ac1134f0-731f-4731-8a35-81ac93d56b5b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:48.659902 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-ac1134f0-731f-4731-8a35-81ac93d56b5b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:48.661043 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-ac1134f0-731f-4731-8a35-81ac93d56b5b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.157583 Jul 11 11:31:48.661597 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 381/763] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:31:48 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 11:31:48.811694 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-2686bd6a-3559-48d5-98f9-75fbbd1a5b08 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:48.812565 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-2686bd6a-3559-48d5-98f9-75fbbd1a5b08 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:48.818443 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2686bd6a-3559-48d5-98f9-75fbbd1a5b08 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:48.818886 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2686bd6a-3559-48d5-98f9-75fbbd1a5b08 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:48.819671 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2686bd6a-3559-48d5-98f9-75fbbd1a5b08 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:48.820105 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2686bd6a-3559-48d5-98f9-75fbbd1a5b08 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:48.947221 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-2686bd6a-3559-48d5-98f9-75fbbd1a5b08 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:48.955012 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-2686bd6a-3559-48d5-98f9-75fbbd1a5b08 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.147145 Jul 11 11:31:48.955615 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 383/764] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:31:48 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:31:49.242748 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-ce36cf4b-ef0d-4373-af9e-2a3bef9c85a9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:49.244264 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-ce36cf4b-ef0d-4373-af9e-2a3bef9c85a9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:49.250363 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ce36cf4b-ef0d-4373-af9e-2a3bef9c85a9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:49.250816 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ce36cf4b-ef0d-4373-af9e-2a3bef9c85a9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:49.251654 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ce36cf4b-ef0d-4373-af9e-2a3bef9c85a9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:49.252098 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ce36cf4b-ef0d-4373-af9e-2a3bef9c85a9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:49.280593 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-ce36cf4b-ef0d-4373-af9e-2a3bef9c85a9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041847 Jul 11 11:31:49.281180 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 382/765] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:31:49 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:31:49.625167 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-e4353849-2f0b-4c98-bce1-274d581eed50 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:49.626005 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-e4353849-2f0b-4c98-bce1-274d581eed50 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:49.632434 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e4353849-2f0b-4c98-bce1-274d581eed50 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:49.632871 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e4353849-2f0b-4c98-bce1-274d581eed50 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:49.633620 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e4353849-2f0b-4c98-bce1-274d581eed50 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:49.634049 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e4353849-2f0b-4c98-bce1-274d581eed50 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:49.661955 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-e4353849-2f0b-4c98-bce1-274d581eed50 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040769 Jul 11 11:31:49.662776 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 384/766] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:31:49 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:31:49.680331 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-ecb9001b-270a-4b02-9423-6a2468dcebe2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:49.681564 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-ecb9001b-270a-4b02-9423-6a2468dcebe2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:49.688232 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ecb9001b-270a-4b02-9423-6a2468dcebe2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:49.697874 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ecb9001b-270a-4b02-9423-6a2468dcebe2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:49.697874 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ecb9001b-270a-4b02-9423-6a2468dcebe2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:49.697874 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ecb9001b-270a-4b02-9423-6a2468dcebe2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:49.821947 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-ecb9001b-270a-4b02-9423-6a2468dcebe2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:49.830292 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-ecb9001b-270a-4b02-9423-6a2468dcebe2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:49.831812 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-ecb9001b-270a-4b02-9423-6a2468dcebe2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:49.832970 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-ecb9001b-270a-4b02-9423-6a2468dcebe2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.156476 Jul 11 11:31:49.833520 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 383/767] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:31:49 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:31:49.971486 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-a08d8399-777b-4004-bfd7-59443ac56662 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:49.972095 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-a08d8399-777b-4004-bfd7-59443ac56662 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:49.978646 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a08d8399-777b-4004-bfd7-59443ac56662 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:49.979081 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a08d8399-777b-4004-bfd7-59443ac56662 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:49.979860 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a08d8399-777b-4004-bfd7-59443ac56662 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:49.980290 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a08d8399-777b-4004-bfd7-59443ac56662 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:50.292699 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-31ba46ef-80e6-487d-9a66-ba577c65d360 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:50.293652 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-31ba46ef-80e6-487d-9a66-ba577c65d360 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:50.299663 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-31ba46ef-80e6-487d-9a66-ba577c65d360 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:50.300111 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-31ba46ef-80e6-487d-9a66-ba577c65d360 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:50.300875 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-31ba46ef-80e6-487d-9a66-ba577c65d360 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:50.301309 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-31ba46ef-80e6-487d-9a66-ba577c65d360 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:50.330405 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-31ba46ef-80e6-487d-9a66-ba577c65d360 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041819 Jul 11 11:31:50.330973 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 384/768] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:31:50 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:31:50.344732 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-a08d8399-777b-4004-bfd7-59443ac56662 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:50.352453 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-a08d8399-777b-4004-bfd7-59443ac56662 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.384805 Jul 11 11:31:50.353005 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 385/769] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:31:49 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:31:50.673996 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-7a554b7d-0542-4ad5-9624-fac66624b0a3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:50.674922 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-7a554b7d-0542-4ad5-9624-fac66624b0a3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:50.681419 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7a554b7d-0542-4ad5-9624-fac66624b0a3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:50.681996 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7a554b7d-0542-4ad5-9624-fac66624b0a3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:50.682610 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7a554b7d-0542-4ad5-9624-fac66624b0a3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:50.683045 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7a554b7d-0542-4ad5-9624-fac66624b0a3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:50.711985 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-7a554b7d-0542-4ad5-9624-fac66624b0a3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041968 Jul 11 11:31:50.712543 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 385/770] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:31:50 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:31:50.853170 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-4f830f81-7729-4e7e-b31b-9a036e48fbc2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:50.853757 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-4f830f81-7729-4e7e-b31b-9a036e48fbc2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:50.860189 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4f830f81-7729-4e7e-b31b-9a036e48fbc2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:50.860628 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4f830f81-7729-4e7e-b31b-9a036e48fbc2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:50.861373 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4f830f81-7729-4e7e-b31b-9a036e48fbc2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:50.861823 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4f830f81-7729-4e7e-b31b-9a036e48fbc2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:50.987160 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-4f830f81-7729-4e7e-b31b-9a036e48fbc2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:50.996063 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-4f830f81-7729-4e7e-b31b-9a036e48fbc2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:50.997559 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-4f830f81-7729-4e7e-b31b-9a036e48fbc2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:50.998693 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-4f830f81-7729-4e7e-b31b-9a036e48fbc2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.150010 Jul 11 11:31:50.999245 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 386/771] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:31:50 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:31:51.341897 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-e5af5459-5e0d-405a-921d-ff29ebd97725 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:51.342840 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-e5af5459-5e0d-405a-921d-ff29ebd97725 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:51.348837 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e5af5459-5e0d-405a-921d-ff29ebd97725 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:51.349287 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e5af5459-5e0d-405a-921d-ff29ebd97725 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:51.350049 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e5af5459-5e0d-405a-921d-ff29ebd97725 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:51.350484 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e5af5459-5e0d-405a-921d-ff29ebd97725 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:51.368406 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-08e461c6-a67e-4f91-ab61-8de88979c3b4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:51.369014 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-08e461c6-a67e-4f91-ab61-8de88979c3b4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:51.374825 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-08e461c6-a67e-4f91-ab61-8de88979c3b4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:51.375282 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-08e461c6-a67e-4f91-ab61-8de88979c3b4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:51.376052 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-08e461c6-a67e-4f91-ab61-8de88979c3b4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:51.376481 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-08e461c6-a67e-4f91-ab61-8de88979c3b4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:51.379370 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-e5af5459-5e0d-405a-921d-ff29ebd97725 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041497 Jul 11 11:31:51.379940 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 386/772] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:31:51 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:31:51.602794 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-08e461c6-a67e-4f91-ab61-8de88979c3b4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:51.602794 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-08e461c6-a67e-4f91-ab61-8de88979c3b4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.152332 Jul 11 11:31:51.602794 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 387/773] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:31:51 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:31:51.723962 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-7fabb62d-9993-4dc8-9adb-d042b6a43ba3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:51.724912 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-7fabb62d-9993-4dc8-9adb-d042b6a43ba3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:51.732487 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7fabb62d-9993-4dc8-9adb-d042b6a43ba3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:51.732487 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7fabb62d-9993-4dc8-9adb-d042b6a43ba3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:51.732797 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7fabb62d-9993-4dc8-9adb-d042b6a43ba3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:51.733232 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7fabb62d-9993-4dc8-9adb-d042b6a43ba3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:51.762422 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-7fabb62d-9993-4dc8-9adb-d042b6a43ba3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042427 Jul 11 11:31:51.762978 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 387/774] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:31:51 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:31:52.017122 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-c22ddb67-7e71-487e-884a-853cc04c8341 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:52.017726 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-c22ddb67-7e71-487e-884a-853cc04c8341 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:52.023931 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c22ddb67-7e71-487e-884a-853cc04c8341 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:52.024891 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c22ddb67-7e71-487e-884a-853cc04c8341 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:52.025652 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c22ddb67-7e71-487e-884a-853cc04c8341 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:52.026083 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c22ddb67-7e71-487e-884a-853cc04c8341 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:52.156913 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-c22ddb67-7e71-487e-884a-853cc04c8341 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:52.165830 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-c22ddb67-7e71-487e-884a-853cc04c8341 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:52.167363 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-c22ddb67-7e71-487e-884a-853cc04c8341 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:52.168492 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-c22ddb67-7e71-487e-884a-853cc04c8341 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.155464 Jul 11 11:31:52.169041 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 388/775] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:31:52 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:31:52.390462 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-70d2fc60-d50b-41da-8ebc-e5b8fea2c1e1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:52.391339 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-70d2fc60-d50b-41da-8ebc-e5b8fea2c1e1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:52.397328 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-70d2fc60-d50b-41da-8ebc-e5b8fea2c1e1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:52.397782 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-70d2fc60-d50b-41da-8ebc-e5b8fea2c1e1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:52.398541 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-70d2fc60-d50b-41da-8ebc-e5b8fea2c1e1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:52.398983 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-70d2fc60-d50b-41da-8ebc-e5b8fea2c1e1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:52.428789 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-70d2fc60-d50b-41da-8ebc-e5b8fea2c1e1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042304 Jul 11 11:31:52.429331 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 388/776] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:31:52 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:31:52.617454 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-98f4df6b-ad5c-43c8-9922-9c38746eec3c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:52.618051 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-98f4df6b-ad5c-43c8-9922-9c38746eec3c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:52.624034 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-98f4df6b-ad5c-43c8-9922-9c38746eec3c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:52.624475 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-98f4df6b-ad5c-43c8-9922-9c38746eec3c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:52.625218 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-98f4df6b-ad5c-43c8-9922-9c38746eec3c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:52.625645 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-98f4df6b-ad5c-43c8-9922-9c38746eec3c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:52.752516 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-98f4df6b-ad5c-43c8-9922-9c38746eec3c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:52.761133 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-98f4df6b-ad5c-43c8-9922-9c38746eec3c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.147545 Jul 11 11:31:52.761751 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 389/777] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:31:52 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:31:52.812735 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-60cff32a-a520-4009-a3ff-09b409469fc2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:52.813660 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-60cff32a-a520-4009-a3ff-09b409469fc2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:52.820082 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-60cff32a-a520-4009-a3ff-09b409469fc2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:52.820536 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-60cff32a-a520-4009-a3ff-09b409469fc2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:52.821328 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-60cff32a-a520-4009-a3ff-09b409469fc2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:52.822294 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-60cff32a-a520-4009-a3ff-09b409469fc2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:52.851881 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-60cff32a-a520-4009-a3ff-09b409469fc2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043213 Jul 11 11:31:52.852643 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 389/778] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:31:52 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:31:53.186415 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-3f15ded6-9ec9-4a63-a29c-544e628689d6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:53.187059 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-3f15ded6-9ec9-4a63-a29c-544e628689d6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:53.193856 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3f15ded6-9ec9-4a63-a29c-544e628689d6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:53.194307 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3f15ded6-9ec9-4a63-a29c-544e628689d6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:53.195069 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3f15ded6-9ec9-4a63-a29c-544e628689d6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:53.195540 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3f15ded6-9ec9-4a63-a29c-544e628689d6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:53.319240 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-3f15ded6-9ec9-4a63-a29c-544e628689d6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:53.327738 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-3f15ded6-9ec9-4a63-a29c-544e628689d6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:53.329158 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-3f15ded6-9ec9-4a63-a29c-544e628689d6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:53.330284 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-3f15ded6-9ec9-4a63-a29c-544e628689d6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.147772 Jul 11 11:31:53.330840 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 390/779] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:31:53 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:31:53.440192 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-7638d4af-4c8b-496f-9967-b5f7c1ffce34 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:53.441105 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-7638d4af-4c8b-496f-9967-b5f7c1ffce34 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:53.447025 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7638d4af-4c8b-496f-9967-b5f7c1ffce34 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:53.447500 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7638d4af-4c8b-496f-9967-b5f7c1ffce34 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:53.448301 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7638d4af-4c8b-496f-9967-b5f7c1ffce34 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:53.448725 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7638d4af-4c8b-496f-9967-b5f7c1ffce34 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:53.477348 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-7638d4af-4c8b-496f-9967-b5f7c1ffce34 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041386 Jul 11 11:31:53.478449 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 390/780] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:31:53 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:31:53.778138 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-1ae5f8e4-b1a2-422f-bbc0-1e5d2ee434a7 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:53.778746 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-1ae5f8e4-b1a2-422f-bbc0-1e5d2ee434a7 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:53.784753 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1ae5f8e4-b1a2-422f-bbc0-1e5d2ee434a7 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:53.785199 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1ae5f8e4-b1a2-422f-bbc0-1e5d2ee434a7 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:53.785985 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1ae5f8e4-b1a2-422f-bbc0-1e5d2ee434a7 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:53.786420 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1ae5f8e4-b1a2-422f-bbc0-1e5d2ee434a7 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:53.862615 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-abb8ab95-e1fe-4131-a09b-85e85fe97ce8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:53.863607 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-abb8ab95-e1fe-4131-a09b-85e85fe97ce8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:53.870081 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-abb8ab95-e1fe-4131-a09b-85e85fe97ce8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:53.870539 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-abb8ab95-e1fe-4131-a09b-85e85fe97ce8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:53.871337 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-abb8ab95-e1fe-4131-a09b-85e85fe97ce8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:53.871785 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-abb8ab95-e1fe-4131-a09b-85e85fe97ce8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:53.902876 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-abb8ab95-e1fe-4131-a09b-85e85fe97ce8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044266 Jul 11 11:31:53.903669 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 391/781] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:31:53 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:31:53.918219 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-1ae5f8e4-b1a2-422f-bbc0-1e5d2ee434a7 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:53.926420 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-1ae5f8e4-b1a2-422f-bbc0-1e5d2ee434a7 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.152651 Jul 11 11:31:53.927170 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 391/782] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:31:53 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:31:54.348241 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-760f8e57-7f05-4871-9c76-3a3514eb5723 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:54.348799 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-760f8e57-7f05-4871-9c76-3a3514eb5723 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:54.354784 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-760f8e57-7f05-4871-9c76-3a3514eb5723 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:54.355229 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-760f8e57-7f05-4871-9c76-3a3514eb5723 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:54.356016 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-760f8e57-7f05-4871-9c76-3a3514eb5723 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:54.356451 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-760f8e57-7f05-4871-9c76-3a3514eb5723 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:54.479206 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-760f8e57-7f05-4871-9c76-3a3514eb5723 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:54.487762 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-760f8e57-7f05-4871-9c76-3a3514eb5723 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:54.489257 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-760f8e57-7f05-4871-9c76-3a3514eb5723 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:54.489710 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-5db280f7-b24f-4c8c-8da0-39a88d92537c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:54.490434 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-760f8e57-7f05-4871-9c76-3a3514eb5723 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.146125 Jul 11 11:31:54.490846 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-5db280f7-b24f-4c8c-8da0-39a88d92537c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:54.491023 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 392/783] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:31:54 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:31:54.498012 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5db280f7-b24f-4c8c-8da0-39a88d92537c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:54.498591 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5db280f7-b24f-4c8c-8da0-39a88d92537c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:54.499460 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5db280f7-b24f-4c8c-8da0-39a88d92537c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:54.499967 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5db280f7-b24f-4c8c-8da0-39a88d92537c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:54.528609 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-5db280f7-b24f-4c8c-8da0-39a88d92537c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043023 Jul 11 11:31:54.529162 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 392/784] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:31:54 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:31:54.914523 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-2e015de1-5139-448b-85d5-15840f3065fe tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:54.916118 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-2e015de1-5139-448b-85d5-15840f3065fe tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:54.922527 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2e015de1-5139-448b-85d5-15840f3065fe tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:54.922970 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2e015de1-5139-448b-85d5-15840f3065fe tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:54.923755 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2e015de1-5139-448b-85d5-15840f3065fe tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:54.924187 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2e015de1-5139-448b-85d5-15840f3065fe tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:54.944707 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-71397e1b-1944-444b-b2cd-5e69d9b4faf9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:54.945312 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-71397e1b-1944-444b-b2cd-5e69d9b4faf9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:54.951446 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-71397e1b-1944-444b-b2cd-5e69d9b4faf9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:54.952266 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-71397e1b-1944-444b-b2cd-5e69d9b4faf9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:54.953186 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-71397e1b-1944-444b-b2cd-5e69d9b4faf9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:54.953670 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-71397e1b-1944-444b-b2cd-5e69d9b4faf9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:54.955163 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-2e015de1-5139-448b-85d5-15840f3065fe tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044513 Jul 11 11:31:54.956175 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 393/785] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:31:54 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:31:55.080457 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-71397e1b-1944-444b-b2cd-5e69d9b4faf9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:55.088806 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-71397e1b-1944-444b-b2cd-5e69d9b4faf9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.149355 Jul 11 11:31:55.089364 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 393/786] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:31:54 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:31:55.515914 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-fe21c337-0c39-44d0-8b5c-c0e3de579e1e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:55.516638 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-fe21c337-0c39-44d0-8b5c-c0e3de579e1e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:55.522535 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fe21c337-0c39-44d0-8b5c-c0e3de579e1e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:55.522979 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fe21c337-0c39-44d0-8b5c-c0e3de579e1e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:55.523769 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fe21c337-0c39-44d0-8b5c-c0e3de579e1e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:55.524828 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fe21c337-0c39-44d0-8b5c-c0e3de579e1e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:55.539816 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-c3c2aaff-bd58-445e-bd47-fbd63cbebb31 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:55.540821 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-c3c2aaff-bd58-445e-bd47-fbd63cbebb31 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:55.547589 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c3c2aaff-bd58-445e-bd47-fbd63cbebb31 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:55.548038 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c3c2aaff-bd58-445e-bd47-fbd63cbebb31 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:55.549010 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c3c2aaff-bd58-445e-bd47-fbd63cbebb31 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:55.549527 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c3c2aaff-bd58-445e-bd47-fbd63cbebb31 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:55.580897 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-c3c2aaff-bd58-445e-bd47-fbd63cbebb31 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044946 Jul 11 11:31:55.581461 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 394/787] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:31:55 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:31:55.658914 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-fe21c337-0c39-44d0-8b5c-c0e3de579e1e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:55.667582 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-fe21c337-0c39-44d0-8b5c-c0e3de579e1e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:55.669062 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-fe21c337-0c39-44d0-8b5c-c0e3de579e1e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:55.670191 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-fe21c337-0c39-44d0-8b5c-c0e3de579e1e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.158270 Jul 11 11:31:55.670750 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 394/788] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:31:55 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:31:55.966874 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-3d17c224-4ad6-46f2-8793-6b22621de10e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:55.967830 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-3d17c224-4ad6-46f2-8793-6b22621de10e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:55.973754 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3d17c224-4ad6-46f2-8793-6b22621de10e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:55.974318 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3d17c224-4ad6-46f2-8793-6b22621de10e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:55.974985 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3d17c224-4ad6-46f2-8793-6b22621de10e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:55.975507 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3d17c224-4ad6-46f2-8793-6b22621de10e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:56.004759 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-3d17c224-4ad6-46f2-8793-6b22621de10e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041780 Jul 11 11:31:56.005358 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 395/789] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:31:55 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:31:56.105611 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-541950ef-a12d-4bef-9219-60621ffdfb0c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:56.106152 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-541950ef-a12d-4bef-9219-60621ffdfb0c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:56.112717 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-541950ef-a12d-4bef-9219-60621ffdfb0c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:56.113182 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-541950ef-a12d-4bef-9219-60621ffdfb0c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:56.113905 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-541950ef-a12d-4bef-9219-60621ffdfb0c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:56.114336 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-541950ef-a12d-4bef-9219-60621ffdfb0c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:56.244003 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-541950ef-a12d-4bef-9219-60621ffdfb0c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:56.251732 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-541950ef-a12d-4bef-9219-60621ffdfb0c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.149997 Jul 11 11:31:56.252296 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 395/790] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:31:56 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:31:56.592689 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-8be93b72-afd6-483e-9746-1771f616713f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:56.593636 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-8be93b72-afd6-483e-9746-1771f616713f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:56.600085 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8be93b72-afd6-483e-9746-1771f616713f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:56.600617 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8be93b72-afd6-483e-9746-1771f616713f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:56.601386 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8be93b72-afd6-483e-9746-1771f616713f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:56.601821 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8be93b72-afd6-483e-9746-1771f616713f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:56.630242 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-8be93b72-afd6-483e-9746-1771f616713f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041522 Jul 11 11:31:56.630789 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 396/791] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:31:56 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:31:56.688968 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-bed23b5b-286c-4672-a0a9-08c4d79feb57 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:56.689580 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-bed23b5b-286c-4672-a0a9-08c4d79feb57 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:56.695559 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-bed23b5b-286c-4672-a0a9-08c4d79feb57 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:56.696009 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-bed23b5b-286c-4672-a0a9-08c4d79feb57 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:56.697332 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-bed23b5b-286c-4672-a0a9-08c4d79feb57 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:56.697795 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-bed23b5b-286c-4672-a0a9-08c4d79feb57 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:56.824292 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-bed23b5b-286c-4672-a0a9-08c4d79feb57 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:56.832568 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-bed23b5b-286c-4672-a0a9-08c4d79feb57 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:56.834043 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-bed23b5b-286c-4672-a0a9-08c4d79feb57 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:56.835169 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-bed23b5b-286c-4672-a0a9-08c4d79feb57 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.150338 Jul 11 11:31:56.835755 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 396/792] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:31:56 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:31:57.016215 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-58ac907b-d6db-42ec-9752-32ea5528c90e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:57.017177 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-58ac907b-d6db-42ec-9752-32ea5528c90e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:57.023174 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-58ac907b-d6db-42ec-9752-32ea5528c90e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:57.023646 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-58ac907b-d6db-42ec-9752-32ea5528c90e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:57.024392 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-58ac907b-d6db-42ec-9752-32ea5528c90e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:57.024817 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-58ac907b-d6db-42ec-9752-32ea5528c90e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:57.028367 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=100 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:31:57.055360 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-58ac907b-d6db-42ec-9752-32ea5528c90e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042906 Jul 11 11:31:57.056536 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 397/793] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:31:57 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:31:57.268979 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-6b36ecd4-d808-4863-b08b-16720e43f91c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:57.269528 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-6b36ecd4-d808-4863-b08b-16720e43f91c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:57.276030 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6b36ecd4-d808-4863-b08b-16720e43f91c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:57.276476 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6b36ecd4-d808-4863-b08b-16720e43f91c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:57.277228 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6b36ecd4-d808-4863-b08b-16720e43f91c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:57.277664 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6b36ecd4-d808-4863-b08b-16720e43f91c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:57.281470 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=100 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:31:57.404905 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-6b36ecd4-d808-4863-b08b-16720e43f91c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:57.412680 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-6b36ecd4-d808-4863-b08b-16720e43f91c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.147628 Jul 11 11:31:57.413237 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 397/794] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:31:57 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:31:57.642714 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-6ea30992-a63f-4c9e-859b-7af8b1099c09 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:57.643672 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-6ea30992-a63f-4c9e-859b-7af8b1099c09 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:57.650245 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6ea30992-a63f-4c9e-859b-7af8b1099c09 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:57.650697 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6ea30992-a63f-4c9e-859b-7af8b1099c09 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:57.652385 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6ea30992-a63f-4c9e-859b-7af8b1099c09 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:57.652385 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6ea30992-a63f-4c9e-859b-7af8b1099c09 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:57.680432 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-6ea30992-a63f-4c9e-859b-7af8b1099c09 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042036 Jul 11 11:31:57.681614 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 398/795] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:31:57 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:31:57.853900 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-09ee54c0-6c6c-4c1a-b71b-653884712ebf tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:57.854617 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-09ee54c0-6c6c-4c1a-b71b-653884712ebf tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:57.860720 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-09ee54c0-6c6c-4c1a-b71b-653884712ebf tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:57.861174 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-09ee54c0-6c6c-4c1a-b71b-653884712ebf tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:57.861932 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-09ee54c0-6c6c-4c1a-b71b-653884712ebf tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:57.862365 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-09ee54c0-6c6c-4c1a-b71b-653884712ebf tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:57.987042 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-09ee54c0-6c6c-4c1a-b71b-653884712ebf tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:57.995363 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-09ee54c0-6c6c-4c1a-b71b-653884712ebf tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:57.996848 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-09ee54c0-6c6c-4c1a-b71b-653884712ebf tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:57.998165 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-09ee54c0-6c6c-4c1a-b71b-653884712ebf tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.148920 Jul 11 11:31:57.998748 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 398/796] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:31:57 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:31:58.068196 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-70c1d921-d19f-41c6-9d29-7473bd3e0a73 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:58.069125 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-70c1d921-d19f-41c6-9d29-7473bd3e0a73 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:58.075130 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-70c1d921-d19f-41c6-9d29-7473bd3e0a73 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:58.075613 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-70c1d921-d19f-41c6-9d29-7473bd3e0a73 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:58.076378 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-70c1d921-d19f-41c6-9d29-7473bd3e0a73 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:58.076814 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-70c1d921-d19f-41c6-9d29-7473bd3e0a73 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:58.107628 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-70c1d921-d19f-41c6-9d29-7473bd3e0a73 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041957 Jul 11 11:31:58.107628 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 399/797] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:31:58 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:31:58.429284 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-697e4097-dbbf-46ba-9cbf-5aa035063cf5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:58.430143 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-697e4097-dbbf-46ba-9cbf-5aa035063cf5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:58.437108 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-697e4097-dbbf-46ba-9cbf-5aa035063cf5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:58.437805 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-697e4097-dbbf-46ba-9cbf-5aa035063cf5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:58.438550 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-697e4097-dbbf-46ba-9cbf-5aa035063cf5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:58.439008 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-697e4097-dbbf-46ba-9cbf-5aa035063cf5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:58.566913 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-697e4097-dbbf-46ba-9cbf-5aa035063cf5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:58.574614 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-697e4097-dbbf-46ba-9cbf-5aa035063cf5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.149147 Jul 11 11:31:58.575176 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 399/798] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:31:58 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:31:58.693587 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-71c4c738-9ca4-475f-ae18-bc3686c40d50 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:58.694514 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-71c4c738-9ca4-475f-ae18-bc3686c40d50 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:58.701615 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-71c4c738-9ca4-475f-ae18-bc3686c40d50 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:58.702064 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-71c4c738-9ca4-475f-ae18-bc3686c40d50 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:58.702820 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-71c4c738-9ca4-475f-ae18-bc3686c40d50 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:58.703269 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-71c4c738-9ca4-475f-ae18-bc3686c40d50 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:58.732958 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-71c4c738-9ca4-475f-ae18-bc3686c40d50 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043862 Jul 11 11:31:58.733520 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 400/799] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:31:58 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:31:59.016365 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-944a0990-0da8-445e-bb1e-d3db630957dd tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:59.016891 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-944a0990-0da8-445e-bb1e-d3db630957dd tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:59.023014 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-944a0990-0da8-445e-bb1e-d3db630957dd tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:59.023471 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-944a0990-0da8-445e-bb1e-d3db630957dd tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:59.024718 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-944a0990-0da8-445e-bb1e-d3db630957dd tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:59.025149 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-944a0990-0da8-445e-bb1e-d3db630957dd tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:59.117889 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-17f64a7d-5f16-42f2-805d-7576b5ba2d97 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:59.118919 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-17f64a7d-5f16-42f2-805d-7576b5ba2d97 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:59.124889 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-17f64a7d-5f16-42f2-805d-7576b5ba2d97 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:59.126131 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-17f64a7d-5f16-42f2-805d-7576b5ba2d97 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:59.126131 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-17f64a7d-5f16-42f2-805d-7576b5ba2d97 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:59.126569 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-17f64a7d-5f16-42f2-805d-7576b5ba2d97 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:59.153923 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-944a0990-0da8-445e-bb1e-d3db630957dd tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:59.161874 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-17f64a7d-5f16-42f2-805d-7576b5ba2d97 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047888 Jul 11 11:31:59.162677 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 401/800] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:31:59 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:31:59.163024 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-944a0990-0da8-445e-bb1e-d3db630957dd tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:59.164676 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-944a0990-0da8-445e-bb1e-d3db630957dd tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:59.166413 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-944a0990-0da8-445e-bb1e-d3db630957dd tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.153543 Jul 11 11:31:59.166413 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 400/801] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:31:59 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:31:59.591863 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-bbf8332b-d07c-4997-acda-1f5fde66b41c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:59.592472 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-bbf8332b-d07c-4997-acda-1f5fde66b41c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:59.598483 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bbf8332b-d07c-4997-acda-1f5fde66b41c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:59.598926 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bbf8332b-d07c-4997-acda-1f5fde66b41c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:59.599716 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bbf8332b-d07c-4997-acda-1f5fde66b41c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:59.600151 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bbf8332b-d07c-4997-acda-1f5fde66b41c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:59.723189 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-bbf8332b-d07c-4997-acda-1f5fde66b41c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:31:59.732517 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-bbf8332b-d07c-4997-acda-1f5fde66b41c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.144413 Jul 11 11:31:59.733328 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 402/802] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:31:59 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:31:59.744353 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-3228171f-c738-4d9f-ba4e-72e383d0a3ce tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:31:59.745266 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-3228171f-c738-4d9f-ba4e-72e383d0a3ce tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:31:59.751725 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3228171f-c738-4d9f-ba4e-72e383d0a3ce tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:59.752167 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3228171f-c738-4d9f-ba4e-72e383d0a3ce tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:59.752917 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3228171f-c738-4d9f-ba4e-72e383d0a3ce tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:31:59.753347 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3228171f-c738-4d9f-ba4e-72e383d0a3ce tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:31:59.781157 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-3228171f-c738-4d9f-ba4e-72e383d0a3ce tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040718 Jul 11 11:31:59.781689 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 401/803] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:31:59 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:32:00.173696 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-e4179808-bf1c-4ef4-9431-ffb8e9609ede tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:00.174613 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-e4179808-bf1c-4ef4-9431-ffb8e9609ede tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:00.180641 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e4179808-bf1c-4ef4-9431-ffb8e9609ede tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:00.181085 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e4179808-bf1c-4ef4-9431-ffb8e9609ede tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:00.182344 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e4179808-bf1c-4ef4-9431-ffb8e9609ede tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:00.182778 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e4179808-bf1c-4ef4-9431-ffb8e9609ede tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:00.184565 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-dfffef90-e660-44ff-82c3-0e8fffd61cb0 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:00.185174 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-dfffef90-e660-44ff-82c3-0e8fffd61cb0 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:00.191616 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-dfffef90-e660-44ff-82c3-0e8fffd61cb0 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:00.192076 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-dfffef90-e660-44ff-82c3-0e8fffd61cb0 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:00.192849 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-dfffef90-e660-44ff-82c3-0e8fffd61cb0 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:00.193270 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-dfffef90-e660-44ff-82c3-0e8fffd61cb0 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:00.216749 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-e4179808-bf1c-4ef4-9431-ffb8e9609ede tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046913 Jul 11 11:32:00.219665 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 403/804] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:00 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:32:00.330194 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-dfffef90-e660-44ff-82c3-0e8fffd61cb0 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:00.338376 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-dfffef90-e660-44ff-82c3-0e8fffd61cb0 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:00.339897 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-dfffef90-e660-44ff-82c3-0e8fffd61cb0 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:00.341030 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-dfffef90-e660-44ff-82c3-0e8fffd61cb0 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.160778 Jul 11 11:32:00.341580 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 402/805] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:32:00 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 11:32:00.750679 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-cf4704e9-5d08-4a67-b921-67d8a6ff3b99 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:00.751295 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-cf4704e9-5d08-4a67-b921-67d8a6ff3b99 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:00.758124 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-cf4704e9-5d08-4a67-b921-67d8a6ff3b99 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:00.758620 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-cf4704e9-5d08-4a67-b921-67d8a6ff3b99 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:00.759396 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-cf4704e9-5d08-4a67-b921-67d8a6ff3b99 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:00.759848 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-cf4704e9-5d08-4a67-b921-67d8a6ff3b99 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:00.793448 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-bfeb066e-9bd3-4b83-833c-78831aa026d8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:00.794369 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-bfeb066e-9bd3-4b83-833c-78831aa026d8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:00.800828 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-bfeb066e-9bd3-4b83-833c-78831aa026d8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:00.801278 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-bfeb066e-9bd3-4b83-833c-78831aa026d8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:00.802047 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-bfeb066e-9bd3-4b83-833c-78831aa026d8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:00.802479 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-bfeb066e-9bd3-4b83-833c-78831aa026d8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:00.831544 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-bfeb066e-9bd3-4b83-833c-78831aa026d8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042597 Jul 11 11:32:00.832106 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 403/806] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:00 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:32:00.889222 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-cf4704e9-5d08-4a67-b921-67d8a6ff3b99 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:00.897011 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-cf4704e9-5d08-4a67-b921-67d8a6ff3b99 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.150146 Jul 11 11:32:00.897570 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 404/807] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:32:00 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:32:01.229020 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-4aa18ccb-ee31-431b-a302-3ca59abc4449 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:01.229968 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-4aa18ccb-ee31-431b-a302-3ca59abc4449 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:01.235979 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4aa18ccb-ee31-431b-a302-3ca59abc4449 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:01.236427 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4aa18ccb-ee31-431b-a302-3ca59abc4449 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:01.237181 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4aa18ccb-ee31-431b-a302-3ca59abc4449 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:01.237603 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4aa18ccb-ee31-431b-a302-3ca59abc4449 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:01.265514 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-4aa18ccb-ee31-431b-a302-3ca59abc4449 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041072 Jul 11 11:32:01.266076 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 404/808] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:01 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:32:01.358895 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-d92d16a1-0d60-479f-9449-79acd8c8ceac tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:01.359470 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-d92d16a1-0d60-479f-9449-79acd8c8ceac tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:01.365440 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d92d16a1-0d60-479f-9449-79acd8c8ceac tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:01.365883 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d92d16a1-0d60-479f-9449-79acd8c8ceac tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:01.366889 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d92d16a1-0d60-479f-9449-79acd8c8ceac tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:01.367348 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d92d16a1-0d60-479f-9449-79acd8c8ceac tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:01.498215 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-d92d16a1-0d60-479f-9449-79acd8c8ceac tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:01.506764 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-d92d16a1-0d60-479f-9449-79acd8c8ceac tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:01.508277 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-d92d16a1-0d60-479f-9449-79acd8c8ceac tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:01.509922 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-d92d16a1-0d60-479f-9449-79acd8c8ceac tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.154453 Jul 11 11:32:01.510476 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 405/809] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:32:01 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:32:01.843204 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-8dcccfc8-71ce-4853-a39f-3a0b82df9265 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:01.844176 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-8dcccfc8-71ce-4853-a39f-3a0b82df9265 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:01.850930 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8dcccfc8-71ce-4853-a39f-3a0b82df9265 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:01.851405 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8dcccfc8-71ce-4853-a39f-3a0b82df9265 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:01.852171 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8dcccfc8-71ce-4853-a39f-3a0b82df9265 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:01.852606 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8dcccfc8-71ce-4853-a39f-3a0b82df9265 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:01.882830 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-8dcccfc8-71ce-4853-a39f-3a0b82df9265 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043505 Jul 11 11:32:01.883406 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 405/810] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:01 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:32:01.916267 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-8f6e4b05-0646-4a87-9679-75c6593619c4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:01.916874 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-8f6e4b05-0646-4a87-9679-75c6593619c4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:01.923315 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8f6e4b05-0646-4a87-9679-75c6593619c4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:01.923767 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8f6e4b05-0646-4a87-9679-75c6593619c4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:01.924523 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8f6e4b05-0646-4a87-9679-75c6593619c4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:01.924957 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8f6e4b05-0646-4a87-9679-75c6593619c4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:02.068096 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-8f6e4b05-0646-4a87-9679-75c6593619c4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:02.076453 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-8f6e4b05-0646-4a87-9679-75c6593619c4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.166041 Jul 11 11:32:02.077030 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 406/811] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:32:01 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:32:02.277372 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-b4aac071-7b24-4a3a-99a7-6836aaab436e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:02.278294 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-b4aac071-7b24-4a3a-99a7-6836aaab436e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:02.284261 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b4aac071-7b24-4a3a-99a7-6836aaab436e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:02.284714 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b4aac071-7b24-4a3a-99a7-6836aaab436e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:02.285471 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b4aac071-7b24-4a3a-99a7-6836aaab436e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:02.285908 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b4aac071-7b24-4a3a-99a7-6836aaab436e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:02.318037 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-b4aac071-7b24-4a3a-99a7-6836aaab436e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044586 Jul 11 11:32:02.318615 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 406/812] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:02 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:32:02.528280 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-b1fa7e35-304b-4fc6-9271-02b3ac17bab8 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:02.528799 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-b1fa7e35-304b-4fc6-9271-02b3ac17bab8 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:02.535029 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b1fa7e35-304b-4fc6-9271-02b3ac17bab8 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:02.535847 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b1fa7e35-304b-4fc6-9271-02b3ac17bab8 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:02.537188 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b1fa7e35-304b-4fc6-9271-02b3ac17bab8 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:02.537970 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b1fa7e35-304b-4fc6-9271-02b3ac17bab8 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:02.684427 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-b1fa7e35-304b-4fc6-9271-02b3ac17bab8 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:02.693144 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-b1fa7e35-304b-4fc6-9271-02b3ac17bab8 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:02.694630 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-b1fa7e35-304b-4fc6-9271-02b3ac17bab8 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:02.695944 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-b1fa7e35-304b-4fc6-9271-02b3ac17bab8 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.172122 Jul 11 11:32:02.696497 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 407/813] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:32:02 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:32:02.895081 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-8bbee433-04ee-41fb-9ab2-8552a16f3b1b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:02.895922 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-8bbee433-04ee-41fb-9ab2-8552a16f3b1b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:02.902871 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8bbee433-04ee-41fb-9ab2-8552a16f3b1b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:02.903339 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8bbee433-04ee-41fb-9ab2-8552a16f3b1b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:02.904087 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8bbee433-04ee-41fb-9ab2-8552a16f3b1b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:02.904512 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8bbee433-04ee-41fb-9ab2-8552a16f3b1b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:02.931969 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-8bbee433-04ee-41fb-9ab2-8552a16f3b1b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040923 Jul 11 11:32:02.932511 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 407/814] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:02 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:32:03.093890 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-bff2a9b1-238c-404d-80ea-dd3960cd132e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:03.094498 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-bff2a9b1-238c-404d-80ea-dd3960cd132e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:03.100948 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bff2a9b1-238c-404d-80ea-dd3960cd132e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:03.101449 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bff2a9b1-238c-404d-80ea-dd3960cd132e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:03.102204 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bff2a9b1-238c-404d-80ea-dd3960cd132e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:03.102636 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bff2a9b1-238c-404d-80ea-dd3960cd132e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:03.232515 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-bff2a9b1-238c-404d-80ea-dd3960cd132e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:03.240399 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-bff2a9b1-238c-404d-80ea-dd3960cd132e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.150342 Jul 11 11:32:03.240967 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 408/815] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:32:03 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:32:03.329642 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-48e781fe-656a-4b84-9fc0-3d562fe497c8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:03.330550 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-48e781fe-656a-4b84-9fc0-3d562fe497c8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:03.336470 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-48e781fe-656a-4b84-9fc0-3d562fe497c8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:03.336914 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-48e781fe-656a-4b84-9fc0-3d562fe497c8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:03.337658 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-48e781fe-656a-4b84-9fc0-3d562fe497c8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:03.338084 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-48e781fe-656a-4b84-9fc0-3d562fe497c8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:03.365374 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-48e781fe-656a-4b84-9fc0-3d562fe497c8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039601 Jul 11 11:32:03.365922 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 408/816] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:03 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:32:03.713936 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-c577260f-57db-40a3-8f76-158fab7f81ef tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:03.714492 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-c577260f-57db-40a3-8f76-158fab7f81ef tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:03.720468 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c577260f-57db-40a3-8f76-158fab7f81ef tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:03.720914 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c577260f-57db-40a3-8f76-158fab7f81ef tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:03.721668 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c577260f-57db-40a3-8f76-158fab7f81ef tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:03.722098 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c577260f-57db-40a3-8f76-158fab7f81ef tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:03.848246 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-c577260f-57db-40a3-8f76-158fab7f81ef tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:03.857391 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-c577260f-57db-40a3-8f76-158fab7f81ef tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:03.858904 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-c577260f-57db-40a3-8f76-158fab7f81ef tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:03.860102 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-c577260f-57db-40a3-8f76-158fab7f81ef tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.150069 Jul 11 11:32:03.860653 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 409/817] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:32:03 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:32:03.943703 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-9214c33c-3960-425e-a58e-93973babbc0d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:03.944614 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-9214c33c-3960-425e-a58e-93973babbc0d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:03.946878 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_api:SELECT=100 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:32:03.951540 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9214c33c-3960-425e-a58e-93973babbc0d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:03.951979 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9214c33c-3960-425e-a58e-93973babbc0d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:03.952728 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9214c33c-3960-425e-a58e-93973babbc0d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:03.953156 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9214c33c-3960-425e-a58e-93973babbc0d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:03.981922 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-9214c33c-3960-425e-a58e-93973babbc0d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042128 Jul 11 11:32:03.982401 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 409/818] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:03 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:32:04.257198 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-249a8580-4dc7-4f05-9b05-13bdb254ff57 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:04.257740 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-249a8580-4dc7-4f05-9b05-13bdb254ff57 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:04.264117 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-249a8580-4dc7-4f05-9b05-13bdb254ff57 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:04.264566 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-249a8580-4dc7-4f05-9b05-13bdb254ff57 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:04.265318 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-249a8580-4dc7-4f05-9b05-13bdb254ff57 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:04.265752 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-249a8580-4dc7-4f05-9b05-13bdb254ff57 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:04.378290 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-1b064b74-2ecc-4868-a284-8275f1197cc8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:04.379200 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-1b064b74-2ecc-4868-a284-8275f1197cc8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:04.385721 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1b064b74-2ecc-4868-a284-8275f1197cc8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:04.386159 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1b064b74-2ecc-4868-a284-8275f1197cc8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:04.386908 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1b064b74-2ecc-4868-a284-8275f1197cc8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:04.387363 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1b064b74-2ecc-4868-a284-8275f1197cc8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:04.392293 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-249a8580-4dc7-4f05-9b05-13bdb254ff57 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:04.400725 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-249a8580-4dc7-4f05-9b05-13bdb254ff57 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.146808 Jul 11 11:32:04.401288 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 410/819] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:32:04 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:32:04.417172 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-1b064b74-2ecc-4868-a284-8275f1197cc8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043677 Jul 11 11:32:04.417721 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 410/820] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:04 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:32:04.878485 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-f22c0fdf-3783-48fd-8f46-700f2422aea2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:04.879089 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-f22c0fdf-3783-48fd-8f46-700f2422aea2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:04.881999 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_api:SELECT=100 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:32:04.885970 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f22c0fdf-3783-48fd-8f46-700f2422aea2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:04.886417 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f22c0fdf-3783-48fd-8f46-700f2422aea2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:04.887173 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f22c0fdf-3783-48fd-8f46-700f2422aea2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:04.887631 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f22c0fdf-3783-48fd-8f46-700f2422aea2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:04.993521 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-1bdf0d3c-01a5-45f7-9a08-f97c412809ec tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:04.994957 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-1bdf0d3c-01a5-45f7-9a08-f97c412809ec tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:05.001306 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1bdf0d3c-01a5-45f7-9a08-f97c412809ec tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:05.001780 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1bdf0d3c-01a5-45f7-9a08-f97c412809ec tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:05.002571 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1bdf0d3c-01a5-45f7-9a08-f97c412809ec tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:05.003208 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1bdf0d3c-01a5-45f7-9a08-f97c412809ec tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:05.017519 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-f22c0fdf-3783-48fd-8f46-700f2422aea2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:05.025966 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-f22c0fdf-3783-48fd-8f46-700f2422aea2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:05.027525 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-f22c0fdf-3783-48fd-8f46-700f2422aea2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:05.028669 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-f22c0fdf-3783-48fd-8f46-700f2422aea2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.154081 Jul 11 11:32:05.029224 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 411/821] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:32:04 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:32:05.032409 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-1bdf0d3c-01a5-45f7-9a08-f97c412809ec tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042846 Jul 11 11:32:05.032966 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 411/822] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:04 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:32:05.418938 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-8605c991-f87f-469f-8d84-06726d613351 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:05.419586 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-8605c991-f87f-469f-8d84-06726d613351 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:05.425961 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8605c991-f87f-469f-8d84-06726d613351 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:05.426428 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8605c991-f87f-469f-8d84-06726d613351 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:05.427166 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8605c991-f87f-469f-8d84-06726d613351 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:05.427622 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8605c991-f87f-469f-8d84-06726d613351 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:05.428819 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-cec7198a-dd9e-4097-b0ac-e287cc8423bd tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:05.429792 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-cec7198a-dd9e-4097-b0ac-e287cc8423bd tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:05.435622 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cec7198a-dd9e-4097-b0ac-e287cc8423bd tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:05.436074 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cec7198a-dd9e-4097-b0ac-e287cc8423bd tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:05.436849 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cec7198a-dd9e-4097-b0ac-e287cc8423bd tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:05.437326 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cec7198a-dd9e-4097-b0ac-e287cc8423bd tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:05.467455 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-cec7198a-dd9e-4097-b0ac-e287cc8423bd tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042647 Jul 11 11:32:05.468017 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 412/823] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:05 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:32:05.581822 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-8605c991-f87f-469f-8d84-06726d613351 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:05.590077 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-8605c991-f87f-469f-8d84-06726d613351 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.176609 Jul 11 11:32:05.590637 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 412/824] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:32:05 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:32:06.044018 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-76c4bd35-20e0-4593-88df-629617e9e4d2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:06.044941 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-76c4bd35-20e0-4593-88df-629617e9e4d2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:06.046587 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-d7b456d9-5f5d-4bbb-a798-8771bf77e044 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:06.047188 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-d7b456d9-5f5d-4bbb-a798-8771bf77e044 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:06.051863 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-76c4bd35-20e0-4593-88df-629617e9e4d2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:06.052314 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-76c4bd35-20e0-4593-88df-629617e9e4d2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:06.053088 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-76c4bd35-20e0-4593-88df-629617e9e4d2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:06.053324 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d7b456d9-5f5d-4bbb-a798-8771bf77e044 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:06.053524 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-76c4bd35-20e0-4593-88df-629617e9e4d2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:06.053802 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d7b456d9-5f5d-4bbb-a798-8771bf77e044 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:06.055186 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d7b456d9-5f5d-4bbb-a798-8771bf77e044 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:06.055787 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d7b456d9-5f5d-4bbb-a798-8771bf77e044 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:06.079086 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=100 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:32:06.083549 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-76c4bd35-20e0-4593-88df-629617e9e4d2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043542 Jul 11 11:32:06.084110 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 413/825] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:06 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:32:06.197912 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-d7b456d9-5f5d-4bbb-a798-8771bf77e044 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:06.201279 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=100 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:32:06.206828 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-d7b456d9-5f5d-4bbb-a798-8771bf77e044 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:06.211486 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-d7b456d9-5f5d-4bbb-a798-8771bf77e044 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:06.211486 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-d7b456d9-5f5d-4bbb-a798-8771bf77e044 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.166845 Jul 11 11:32:06.211486 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 413/826] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:32:06 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 11:32:06.481307 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-71212fd4-2860-4ff9-822d-809f539d2bc9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:06.482233 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-71212fd4-2860-4ff9-822d-809f539d2bc9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:06.488587 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-71212fd4-2860-4ff9-822d-809f539d2bc9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:06.489047 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-71212fd4-2860-4ff9-822d-809f539d2bc9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:06.489819 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-71212fd4-2860-4ff9-822d-809f539d2bc9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:06.490263 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-71212fd4-2860-4ff9-822d-809f539d2bc9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:06.519650 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-71212fd4-2860-4ff9-822d-809f539d2bc9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043396 Jul 11 11:32:06.520205 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 414/827] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:06 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:32:06.606337 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-ae0fa564-7000-4215-892c-2191a15a4bc2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:06.606939 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-ae0fa564-7000-4215-892c-2191a15a4bc2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:06.613424 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ae0fa564-7000-4215-892c-2191a15a4bc2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:06.613864 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ae0fa564-7000-4215-892c-2191a15a4bc2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:06.614611 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ae0fa564-7000-4215-892c-2191a15a4bc2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:06.615043 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ae0fa564-7000-4215-892c-2191a15a4bc2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:06.744742 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-ae0fa564-7000-4215-892c-2191a15a4bc2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:06.752082 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-ae0fa564-7000-4215-892c-2191a15a4bc2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.150237 Jul 11 11:32:06.752674 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 414/828] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:32:06 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:32:07.102523 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-e3cbd66d-aa5a-47e2-9396-e9e79af5a1ec tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:07.104070 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-e3cbd66d-aa5a-47e2-9396-e9e79af5a1ec tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:07.110714 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e3cbd66d-aa5a-47e2-9396-e9e79af5a1ec tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:07.111204 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e3cbd66d-aa5a-47e2-9396-e9e79af5a1ec tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:07.111999 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e3cbd66d-aa5a-47e2-9396-e9e79af5a1ec tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:07.112441 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e3cbd66d-aa5a-47e2-9396-e9e79af5a1ec tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:07.140382 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-e3cbd66d-aa5a-47e2-9396-e9e79af5a1ec tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041869 Jul 11 11:32:07.140934 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 415/829] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:07 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:32:07.227483 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-85943062-c465-4c4f-b215-65dd1b19d11a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:07.228083 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-85943062-c465-4c4f-b215-65dd1b19d11a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:07.234467 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-85943062-c465-4c4f-b215-65dd1b19d11a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:07.234903 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-85943062-c465-4c4f-b215-65dd1b19d11a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:07.235675 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-85943062-c465-4c4f-b215-65dd1b19d11a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:07.236100 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-85943062-c465-4c4f-b215-65dd1b19d11a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:07.359480 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-85943062-c465-4c4f-b215-65dd1b19d11a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:07.367692 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-85943062-c465-4c4f-b215-65dd1b19d11a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:07.369200 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-85943062-c465-4c4f-b215-65dd1b19d11a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:07.370342 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-85943062-c465-4c4f-b215-65dd1b19d11a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.146676 Jul 11 11:32:07.370948 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 415/830] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:32:07 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:32:07.531497 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-b7201892-be8c-4a36-b6c7-4f321e66cdc5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:07.532475 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-b7201892-be8c-4a36-b6c7-4f321e66cdc5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:07.538397 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b7201892-be8c-4a36-b6c7-4f321e66cdc5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:07.538846 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b7201892-be8c-4a36-b6c7-4f321e66cdc5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:07.539640 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b7201892-be8c-4a36-b6c7-4f321e66cdc5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:07.540082 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b7201892-be8c-4a36-b6c7-4f321e66cdc5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:07.568129 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-b7201892-be8c-4a36-b6c7-4f321e66cdc5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040601 Jul 11 11:32:07.568676 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 416/831] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:07 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:32:07.769006 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-79296b9a-07c5-4018-a5cc-981c4dc77b2a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:07.769618 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-79296b9a-07c5-4018-a5cc-981c4dc77b2a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:07.776589 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-79296b9a-07c5-4018-a5cc-981c4dc77b2a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:07.777041 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-79296b9a-07c5-4018-a5cc-981c4dc77b2a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:07.777799 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-79296b9a-07c5-4018-a5cc-981c4dc77b2a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:07.778237 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-79296b9a-07c5-4018-a5cc-981c4dc77b2a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:07.906712 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-79296b9a-07c5-4018-a5cc-981c4dc77b2a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:07.914536 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-79296b9a-07c5-4018-a5cc-981c4dc77b2a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.149351 Jul 11 11:32:07.915083 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 416/832] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:32:07 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:32:08.152399 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-200f884f-e1b6-4292-8e3d-5b73bd1cae24 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:08.153361 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-200f884f-e1b6-4292-8e3d-5b73bd1cae24 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:08.159877 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-200f884f-e1b6-4292-8e3d-5b73bd1cae24 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:08.160261 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-200f884f-e1b6-4292-8e3d-5b73bd1cae24 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:08.161015 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-200f884f-e1b6-4292-8e3d-5b73bd1cae24 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:08.161454 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-200f884f-e1b6-4292-8e3d-5b73bd1cae24 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:08.189411 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-200f884f-e1b6-4292-8e3d-5b73bd1cae24 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041519 Jul 11 11:32:08.189945 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 417/833] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:08 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:32:08.389526 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-c17e8d18-9664-4dd7-a412-9c72bbc44e66 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:08.390124 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-c17e8d18-9664-4dd7-a412-9c72bbc44e66 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:08.396148 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c17e8d18-9664-4dd7-a412-9c72bbc44e66 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:08.396592 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c17e8d18-9664-4dd7-a412-9c72bbc44e66 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:08.397341 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c17e8d18-9664-4dd7-a412-9c72bbc44e66 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:08.397772 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c17e8d18-9664-4dd7-a412-9c72bbc44e66 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:08.522147 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-c17e8d18-9664-4dd7-a412-9c72bbc44e66 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:08.530416 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-c17e8d18-9664-4dd7-a412-9c72bbc44e66 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:08.531965 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-c17e8d18-9664-4dd7-a412-9c72bbc44e66 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:08.533100 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-c17e8d18-9664-4dd7-a412-9c72bbc44e66 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.147443 Jul 11 11:32:08.533657 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 417/834] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:32:08 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:32:08.579824 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-9fb2f9db-8c4b-4ddf-9402-5731cc783447 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:08.580762 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-9fb2f9db-8c4b-4ddf-9402-5731cc783447 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:08.586654 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9fb2f9db-8c4b-4ddf-9402-5731cc783447 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:08.587102 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9fb2f9db-8c4b-4ddf-9402-5731cc783447 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:08.587925 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9fb2f9db-8c4b-4ddf-9402-5731cc783447 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:08.588364 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9fb2f9db-8c4b-4ddf-9402-5731cc783447 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:08.615925 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-9fb2f9db-8c4b-4ddf-9402-5731cc783447 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039997 Jul 11 11:32:08.616465 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 418/835] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:08 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:32:08.932272 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-82e6b083-9b61-4914-9cc7-56503572284e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:08.932877 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-82e6b083-9b61-4914-9cc7-56503572284e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:08.939541 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-82e6b083-9b61-4914-9cc7-56503572284e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:08.939982 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-82e6b083-9b61-4914-9cc7-56503572284e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:08.940739 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-82e6b083-9b61-4914-9cc7-56503572284e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:08.941165 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-82e6b083-9b61-4914-9cc7-56503572284e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:09.069435 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-82e6b083-9b61-4914-9cc7-56503572284e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:09.077976 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-82e6b083-9b61-4914-9cc7-56503572284e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.150056 Jul 11 11:32:09.078554 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 418/836] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:32:08 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:32:09.201764 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-0d5c816a-366a-4ee7-9423-f5024db664ad tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:09.202597 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-0d5c816a-366a-4ee7-9423-f5024db664ad tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:09.208758 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0d5c816a-366a-4ee7-9423-f5024db664ad tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:09.209199 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0d5c816a-366a-4ee7-9423-f5024db664ad tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:09.209979 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0d5c816a-366a-4ee7-9423-f5024db664ad tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:09.210408 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0d5c816a-366a-4ee7-9423-f5024db664ad tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:09.237916 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-0d5c816a-366a-4ee7-9423-f5024db664ad tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040789 Jul 11 11:32:09.238453 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 419/837] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:09 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:32:09.550766 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-41b39730-8c62-432a-9ccd-0002bcf428a4 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:09.551373 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-41b39730-8c62-432a-9ccd-0002bcf428a4 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:09.557330 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-41b39730-8c62-432a-9ccd-0002bcf428a4 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:09.563183 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-41b39730-8c62-432a-9ccd-0002bcf428a4 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:09.563183 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-41b39730-8c62-432a-9ccd-0002bcf428a4 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:09.563183 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-41b39730-8c62-432a-9ccd-0002bcf428a4 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:09.627972 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-1bf20704-3ddb-4fc5-ae81-5dc9d39be753 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:09.628891 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-1bf20704-3ddb-4fc5-ae81-5dc9d39be753 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:09.635834 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1bf20704-3ddb-4fc5-ae81-5dc9d39be753 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:09.636283 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1bf20704-3ddb-4fc5-ae81-5dc9d39be753 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:09.637047 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1bf20704-3ddb-4fc5-ae81-5dc9d39be753 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:09.637496 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1bf20704-3ddb-4fc5-ae81-5dc9d39be753 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:09.671202 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-1bf20704-3ddb-4fc5-ae81-5dc9d39be753 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047130 Jul 11 11:32:09.671852 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 420/838] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:09 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:32:09.686162 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-41b39730-8c62-432a-9ccd-0002bcf428a4 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:09.694997 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-41b39730-8c62-432a-9ccd-0002bcf428a4 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:09.696561 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-41b39730-8c62-432a-9ccd-0002bcf428a4 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:09.698214 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-41b39730-8c62-432a-9ccd-0002bcf428a4 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.151408 Jul 11 11:32:09.698826 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 419/839] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:32:09 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:32:10.094456 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-e8e1791f-0c26-466e-a9ee-350fd362e85f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:10.095058 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-e8e1791f-0c26-466e-a9ee-350fd362e85f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:10.101139 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e8e1791f-0c26-466e-a9ee-350fd362e85f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:10.101579 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e8e1791f-0c26-466e-a9ee-350fd362e85f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:10.102327 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e8e1791f-0c26-466e-a9ee-350fd362e85f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:10.102766 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e8e1791f-0c26-466e-a9ee-350fd362e85f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:10.228659 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-e8e1791f-0c26-466e-a9ee-350fd362e85f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:10.236533 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-e8e1791f-0c26-466e-a9ee-350fd362e85f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.145900 Jul 11 11:32:10.237102 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 421/840] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:32:10 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:32:10.249601 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-174be0bf-4555-41b4-8f7f-3693e98c4a77 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:10.250545 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-174be0bf-4555-41b4-8f7f-3693e98c4a77 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:10.256976 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-174be0bf-4555-41b4-8f7f-3693e98c4a77 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:10.257422 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-174be0bf-4555-41b4-8f7f-3693e98c4a77 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:10.258180 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-174be0bf-4555-41b4-8f7f-3693e98c4a77 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:10.258637 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-174be0bf-4555-41b4-8f7f-3693e98c4a77 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:10.286832 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-174be0bf-4555-41b4-8f7f-3693e98c4a77 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041139 Jul 11 11:32:10.287396 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 420/841] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:10 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:32:10.682797 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-72feccce-4125-4559-969a-af787d106365 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:10.683780 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-72feccce-4125-4559-969a-af787d106365 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:10.690017 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-72feccce-4125-4559-969a-af787d106365 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:10.690471 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-72feccce-4125-4559-969a-af787d106365 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:10.691237 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-72feccce-4125-4559-969a-af787d106365 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:10.691706 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-72feccce-4125-4559-969a-af787d106365 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:10.716019 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-99ee6f8c-20f5-487b-887e-f6ea6d5a584f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:10.716704 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-99ee6f8c-20f5-487b-887e-f6ea6d5a584f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:10.719906 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-72feccce-4125-4559-969a-af787d106365 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041022 Jul 11 11:32:10.720457 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 422/842] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:10 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:32:10.722636 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-99ee6f8c-20f5-487b-887e-f6ea6d5a584f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:10.723076 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-99ee6f8c-20f5-487b-887e-f6ea6d5a584f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:10.723858 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-99ee6f8c-20f5-487b-887e-f6ea6d5a584f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:10.724285 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-99ee6f8c-20f5-487b-887e-f6ea6d5a584f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:10.854395 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-99ee6f8c-20f5-487b-887e-f6ea6d5a584f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:10.862897 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-99ee6f8c-20f5-487b-887e-f6ea6d5a584f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:10.864480 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-99ee6f8c-20f5-487b-887e-f6ea6d5a584f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:10.865620 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-99ee6f8c-20f5-487b-887e-f6ea6d5a584f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.153973 Jul 11 11:32:10.866177 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 421/843] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:32:10 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 11:32:11.253969 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-00e0c562-2f9a-4591-a7f4-cf94663be7ee tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:11.254577 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-00e0c562-2f9a-4591-a7f4-cf94663be7ee tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:11.261613 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-00e0c562-2f9a-4591-a7f4-cf94663be7ee tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:11.262065 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-00e0c562-2f9a-4591-a7f4-cf94663be7ee tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:11.262826 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-00e0c562-2f9a-4591-a7f4-cf94663be7ee tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:11.263279 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-00e0c562-2f9a-4591-a7f4-cf94663be7ee tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:11.297928 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-1e2eb275-655c-4502-9448-7bb0ed079412 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:11.298877 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-1e2eb275-655c-4502-9448-7bb0ed079412 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:11.305315 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1e2eb275-655c-4502-9448-7bb0ed079412 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:11.305765 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1e2eb275-655c-4502-9448-7bb0ed079412 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:11.306525 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1e2eb275-655c-4502-9448-7bb0ed079412 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:11.306956 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1e2eb275-655c-4502-9448-7bb0ed079412 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:11.335953 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-1e2eb275-655c-4502-9448-7bb0ed079412 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041756 Jul 11 11:32:11.336440 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 422/844] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:11 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:32:11.389352 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-00e0c562-2f9a-4591-a7f4-cf94663be7ee tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:11.397085 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-00e0c562-2f9a-4591-a7f4-cf94663be7ee tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.146942 Jul 11 11:32:11.397645 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 423/845] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:32:11 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:32:11.731262 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-8b1433d5-7a1a-428d-884f-9b0fb459de43 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:11.732204 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-8b1433d5-7a1a-428d-884f-9b0fb459de43 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:11.738156 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8b1433d5-7a1a-428d-884f-9b0fb459de43 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:11.738603 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8b1433d5-7a1a-428d-884f-9b0fb459de43 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:11.739378 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8b1433d5-7a1a-428d-884f-9b0fb459de43 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:11.739812 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8b1433d5-7a1a-428d-884f-9b0fb459de43 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:11.768548 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-8b1433d5-7a1a-428d-884f-9b0fb459de43 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041170 Jul 11 11:32:11.769093 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 423/846] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:11 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:32:11.883571 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-23700eb2-0235-410b-972f-40aafd51ee2a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:11.884184 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-23700eb2-0235-410b-972f-40aafd51ee2a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:11.890123 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-23700eb2-0235-410b-972f-40aafd51ee2a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:11.890576 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-23700eb2-0235-410b-972f-40aafd51ee2a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:11.891360 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-23700eb2-0235-410b-972f-40aafd51ee2a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:11.891802 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-23700eb2-0235-410b-972f-40aafd51ee2a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:12.019835 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-23700eb2-0235-410b-972f-40aafd51ee2a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:12.028195 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-23700eb2-0235-410b-972f-40aafd51ee2a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:12.029711 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-23700eb2-0235-410b-972f-40aafd51ee2a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:12.030847 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-23700eb2-0235-410b-972f-40aafd51ee2a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.151262 Jul 11 11:32:12.031442 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 424/847] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:32:11 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:32:12.348031 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-1db167ea-b31f-4948-8434-827e46087cfc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:12.348892 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-1db167ea-b31f-4948-8434-827e46087cfc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:12.355998 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1db167ea-b31f-4948-8434-827e46087cfc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:12.356439 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1db167ea-b31f-4948-8434-827e46087cfc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:12.357188 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1db167ea-b31f-4948-8434-827e46087cfc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:12.357617 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1db167ea-b31f-4948-8434-827e46087cfc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:12.385135 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-1db167ea-b31f-4948-8434-827e46087cfc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041140 Jul 11 11:32:12.385678 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 424/848] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:12 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:32:12.414277 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-5b20d562-47c5-403e-97c9-729430648720 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:12.414884 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-5b20d562-47c5-403e-97c9-729430648720 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:12.421904 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5b20d562-47c5-403e-97c9-729430648720 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:12.422351 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5b20d562-47c5-403e-97c9-729430648720 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:12.423104 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5b20d562-47c5-403e-97c9-729430648720 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:12.423563 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5b20d562-47c5-403e-97c9-729430648720 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:12.547738 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-5b20d562-47c5-403e-97c9-729430648720 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:12.555596 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-5b20d562-47c5-403e-97c9-729430648720 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.145019 Jul 11 11:32:12.556165 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 425/849] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:32:12 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:32:12.779843 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-06580b25-a8ce-4906-b75c-a6bfedf5bdf9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:12.780750 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-06580b25-a8ce-4906-b75c-a6bfedf5bdf9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:12.786818 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-06580b25-a8ce-4906-b75c-a6bfedf5bdf9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:12.787277 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-06580b25-a8ce-4906-b75c-a6bfedf5bdf9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:12.788087 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-06580b25-a8ce-4906-b75c-a6bfedf5bdf9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:12.788580 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-06580b25-a8ce-4906-b75c-a6bfedf5bdf9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:12.818387 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-06580b25-a8ce-4906-b75c-a6bfedf5bdf9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042371 Jul 11 11:32:12.818937 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 425/850] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:12 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:32:13.048870 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-11559c00-738b-4117-b770-42023ce74a17 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:13.049408 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-11559c00-738b-4117-b770-42023ce74a17 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:13.055430 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-11559c00-738b-4117-b770-42023ce74a17 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:13.055878 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-11559c00-738b-4117-b770-42023ce74a17 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:13.056636 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-11559c00-738b-4117-b770-42023ce74a17 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:13.057073 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-11559c00-738b-4117-b770-42023ce74a17 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:13.185503 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-11559c00-738b-4117-b770-42023ce74a17 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:13.193961 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-11559c00-738b-4117-b770-42023ce74a17 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:13.195491 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-11559c00-738b-4117-b770-42023ce74a17 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:13.196642 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-11559c00-738b-4117-b770-42023ce74a17 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.151721 Jul 11 11:32:13.197204 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 426/851] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:32:13 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:32:13.396738 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-7324f7d0-655e-478e-94ae-9a26824c3800 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:13.397582 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-7324f7d0-655e-478e-94ae-9a26824c3800 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:13.404665 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7324f7d0-655e-478e-94ae-9a26824c3800 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:13.405116 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7324f7d0-655e-478e-94ae-9a26824c3800 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:13.405875 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7324f7d0-655e-478e-94ae-9a26824c3800 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:13.406309 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7324f7d0-655e-478e-94ae-9a26824c3800 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:13.434127 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-7324f7d0-655e-478e-94ae-9a26824c3800 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041419 Jul 11 11:32:13.434723 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 426/852] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:13 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:32:13.574139 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-27ca18d7-08dd-4109-abd8-9c97b269fec7 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:13.574756 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-27ca18d7-08dd-4109-abd8-9c97b269fec7 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:13.581232 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-27ca18d7-08dd-4109-abd8-9c97b269fec7 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:13.581689 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-27ca18d7-08dd-4109-abd8-9c97b269fec7 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:13.582433 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-27ca18d7-08dd-4109-abd8-9c97b269fec7 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:13.582869 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-27ca18d7-08dd-4109-abd8-9c97b269fec7 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:13.829184 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-34ea634c-aa32-4c9c-9d2e-4881bc0d493b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:13.830110 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-34ea634c-aa32-4c9c-9d2e-4881bc0d493b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:13.836213 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-34ea634c-aa32-4c9c-9d2e-4881bc0d493b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:13.836666 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-34ea634c-aa32-4c9c-9d2e-4881bc0d493b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:13.837446 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-34ea634c-aa32-4c9c-9d2e-4881bc0d493b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:13.837868 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-34ea634c-aa32-4c9c-9d2e-4881bc0d493b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:13.855036 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-27ca18d7-08dd-4109-abd8-9c97b269fec7 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:13.863362 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-27ca18d7-08dd-4109-abd8-9c97b269fec7 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.293979 Jul 11 11:32:13.863940 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 427/853] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:32:13 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:32:13.867479 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-34ea634c-aa32-4c9c-9d2e-4881bc0d493b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042198 Jul 11 11:32:13.868045 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 427/854] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:13 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:32:14.214682 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-9bd942b8-8ebf-4f15-b048-8fececf579e5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:14.215320 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-9bd942b8-8ebf-4f15-b048-8fececf579e5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:14.221237 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9bd942b8-8ebf-4f15-b048-8fececf579e5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:14.221687 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9bd942b8-8ebf-4f15-b048-8fececf579e5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:14.222441 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9bd942b8-8ebf-4f15-b048-8fececf579e5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:14.222873 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9bd942b8-8ebf-4f15-b048-8fececf579e5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:14.358285 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-9bd942b8-8ebf-4f15-b048-8fececf579e5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:14.366839 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-9bd942b8-8ebf-4f15-b048-8fececf579e5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:14.368389 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-9bd942b8-8ebf-4f15-b048-8fececf579e5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:14.370212 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-9bd942b8-8ebf-4f15-b048-8fececf579e5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.159455 Jul 11 11:32:14.370763 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 428/855] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:32:14 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 11:32:14.445830 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-fe9a6172-508b-4fda-a58e-4ac13654d475 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:14.446766 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-fe9a6172-508b-4fda-a58e-4ac13654d475 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:14.453134 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fe9a6172-508b-4fda-a58e-4ac13654d475 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:14.453580 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fe9a6172-508b-4fda-a58e-4ac13654d475 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:14.454333 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fe9a6172-508b-4fda-a58e-4ac13654d475 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:14.454766 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fe9a6172-508b-4fda-a58e-4ac13654d475 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:14.483357 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-fe9a6172-508b-4fda-a58e-4ac13654d475 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041458 Jul 11 11:32:14.483905 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 428/856] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:14 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:32:14.880788 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-8a8e4dd7-23d9-4c56-88d3-4d1b8412381e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:14.881431 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-8a8e4dd7-23d9-4c56-88d3-4d1b8412381e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:14.883783 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-f8dad962-60c7-4d01-bef8-6a9a8a1e5010 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:14.885438 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-f8dad962-60c7-4d01-bef8-6a9a8a1e5010 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:14.888079 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8a8e4dd7-23d9-4c56-88d3-4d1b8412381e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:14.888526 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8a8e4dd7-23d9-4c56-88d3-4d1b8412381e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:14.889319 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8a8e4dd7-23d9-4c56-88d3-4d1b8412381e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:14.889756 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8a8e4dd7-23d9-4c56-88d3-4d1b8412381e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:14.901035 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f8dad962-60c7-4d01-bef8-6a9a8a1e5010 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:14.901489 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f8dad962-60c7-4d01-bef8-6a9a8a1e5010 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:14.903518 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f8dad962-60c7-4d01-bef8-6a9a8a1e5010 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:14.903972 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f8dad962-60c7-4d01-bef8-6a9a8a1e5010 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:14.933230 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-f8dad962-60c7-4d01-bef8-6a9a8a1e5010 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057537 Jul 11 11:32:14.933790 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 429/857] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:14 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:32:15.023887 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-8a8e4dd7-23d9-4c56-88d3-4d1b8412381e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:15.032525 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-8a8e4dd7-23d9-4c56-88d3-4d1b8412381e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.155611 Jul 11 11:32:15.033094 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 429/858] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:32:14 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:32:15.395020 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-d7ffe2a2-41d7-4867-b3d1-1a5a21e1c166 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:15.395664 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-d7ffe2a2-41d7-4867-b3d1-1a5a21e1c166 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:15.401540 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d7ffe2a2-41d7-4867-b3d1-1a5a21e1c166 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:15.401983 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d7ffe2a2-41d7-4867-b3d1-1a5a21e1c166 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:15.404266 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d7ffe2a2-41d7-4867-b3d1-1a5a21e1c166 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:15.404266 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d7ffe2a2-41d7-4867-b3d1-1a5a21e1c166 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:15.420458 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=100 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:32:15.494504 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-4915aaa1-8e85-4ac4-8ffe-c544c7ff4cb7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:15.497248 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-4915aaa1-8e85-4ac4-8ffe-c544c7ff4cb7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:15.501808 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4915aaa1-8e85-4ac4-8ffe-c544c7ff4cb7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:15.502263 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4915aaa1-8e85-4ac4-8ffe-c544c7ff4cb7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:15.503015 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4915aaa1-8e85-4ac4-8ffe-c544c7ff4cb7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:15.503474 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4915aaa1-8e85-4ac4-8ffe-c544c7ff4cb7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:15.521660 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=100 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:32:15.534738 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-4915aaa1-8e85-4ac4-8ffe-c544c7ff4cb7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044607 Jul 11 11:32:15.536227 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 430/859] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:15 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:32:15.536341 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-d7ffe2a2-41d7-4867-b3d1-1a5a21e1c166 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:15.544759 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-d7ffe2a2-41d7-4867-b3d1-1a5a21e1c166 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:15.546244 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-d7ffe2a2-41d7-4867-b3d1-1a5a21e1c166 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:15.547420 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-d7ffe2a2-41d7-4867-b3d1-1a5a21e1c166 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.163016 Jul 11 11:32:15.547959 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 430/860] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:32:15 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:32:15.945037 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-c6e51cd6-e70c-4a08-b131-77f403c9be8c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:15.945950 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-c6e51cd6-e70c-4a08-b131-77f403c9be8c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:15.952780 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c6e51cd6-e70c-4a08-b131-77f403c9be8c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:15.953220 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c6e51cd6-e70c-4a08-b131-77f403c9be8c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:15.953966 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c6e51cd6-e70c-4a08-b131-77f403c9be8c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:15.954402 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c6e51cd6-e70c-4a08-b131-77f403c9be8c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:15.981859 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-c6e51cd6-e70c-4a08-b131-77f403c9be8c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040829 Jul 11 11:32:15.982396 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 431/861] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:15 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:32:16.049336 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-2ddfe36c-1a1c-49d1-86c4-02f260fc5064 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:16.049885 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-2ddfe36c-1a1c-49d1-86c4-02f260fc5064 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:16.056830 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2ddfe36c-1a1c-49d1-86c4-02f260fc5064 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:16.057290 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2ddfe36c-1a1c-49d1-86c4-02f260fc5064 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:16.058087 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2ddfe36c-1a1c-49d1-86c4-02f260fc5064 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:16.058527 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2ddfe36c-1a1c-49d1-86c4-02f260fc5064 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:16.184192 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-2ddfe36c-1a1c-49d1-86c4-02f260fc5064 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:16.192557 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-2ddfe36c-1a1c-49d1-86c4-02f260fc5064 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.147084 Jul 11 11:32:16.193108 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 431/862] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:32:16 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:32:16.547164 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-2d2dcd19-e4df-4dd0-9483-81db275117f8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:16.548120 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-2d2dcd19-e4df-4dd0-9483-81db275117f8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:16.554458 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2d2dcd19-e4df-4dd0-9483-81db275117f8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:16.554897 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2d2dcd19-e4df-4dd0-9483-81db275117f8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:16.555674 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2d2dcd19-e4df-4dd0-9483-81db275117f8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:16.556106 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2d2dcd19-e4df-4dd0-9483-81db275117f8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:16.566172 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-e53865a0-f98c-4290-b8a1-7c20c16fe9b7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:16.566775 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-e53865a0-f98c-4290-b8a1-7c20c16fe9b7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:16.573020 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e53865a0-f98c-4290-b8a1-7c20c16fe9b7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:16.573462 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e53865a0-f98c-4290-b8a1-7c20c16fe9b7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:16.574247 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e53865a0-f98c-4290-b8a1-7c20c16fe9b7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:16.574676 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e53865a0-f98c-4290-b8a1-7c20c16fe9b7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:16.585875 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-2d2dcd19-e4df-4dd0-9483-81db275117f8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042846 Jul 11 11:32:16.586440 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 432/863] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:16 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:32:16.706096 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-e53865a0-f98c-4290-b8a1-7c20c16fe9b7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:16.715051 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-e53865a0-f98c-4290-b8a1-7c20c16fe9b7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:16.716569 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-e53865a0-f98c-4290-b8a1-7c20c16fe9b7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:16.717699 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-e53865a0-f98c-4290-b8a1-7c20c16fe9b7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.155803 Jul 11 11:32:16.718243 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 432/864] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:32:16 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 11:32:16.993124 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-703a7436-d2ef-4332-8db2-bc0b85b12bd2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:16.994038 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-703a7436-d2ef-4332-8db2-bc0b85b12bd2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:17.000016 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-703a7436-d2ef-4332-8db2-bc0b85b12bd2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:17.000460 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-703a7436-d2ef-4332-8db2-bc0b85b12bd2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:17.001209 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-703a7436-d2ef-4332-8db2-bc0b85b12bd2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:17.001637 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-703a7436-d2ef-4332-8db2-bc0b85b12bd2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:17.031210 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-703a7436-d2ef-4332-8db2-bc0b85b12bd2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041982 Jul 11 11:32:17.031834 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 433/865] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:16 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:32:17.210156 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-5fa92cce-4698-4b63-9748-7b169f95cc42 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:17.210766 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-5fa92cce-4698-4b63-9748-7b169f95cc42 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:17.218831 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5fa92cce-4698-4b63-9748-7b169f95cc42 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:17.219341 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5fa92cce-4698-4b63-9748-7b169f95cc42 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:17.220125 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5fa92cce-4698-4b63-9748-7b169f95cc42 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:17.221512 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5fa92cce-4698-4b63-9748-7b169f95cc42 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:17.349913 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-5fa92cce-4698-4b63-9748-7b169f95cc42 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:17.357764 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-5fa92cce-4698-4b63-9748-7b169f95cc42 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.151680 Jul 11 11:32:17.358324 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 433/866] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:32:17 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:32:17.597627 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-41053c62-d9a0-44d3-a896-29611c242379 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:17.598455 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-41053c62-d9a0-44d3-a896-29611c242379 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:17.605036 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-41053c62-d9a0-44d3-a896-29611c242379 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:17.605478 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-41053c62-d9a0-44d3-a896-29611c242379 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:17.606227 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-41053c62-d9a0-44d3-a896-29611c242379 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:17.606660 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-41053c62-d9a0-44d3-a896-29611c242379 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:17.636692 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-41053c62-d9a0-44d3-a896-29611c242379 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043091 Jul 11 11:32:17.637409 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 434/867] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:17 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:32:17.740807 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-8b37074f-5abc-43b3-99ef-4e292712de90 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:17.741430 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-8b37074f-5abc-43b3-99ef-4e292712de90 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:17.747996 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8b37074f-5abc-43b3-99ef-4e292712de90 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:17.748444 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8b37074f-5abc-43b3-99ef-4e292712de90 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:17.749209 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8b37074f-5abc-43b3-99ef-4e292712de90 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:17.749642 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8b37074f-5abc-43b3-99ef-4e292712de90 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:17.878459 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-8b37074f-5abc-43b3-99ef-4e292712de90 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:17.886720 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-8b37074f-5abc-43b3-99ef-4e292712de90 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:17.888234 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-8b37074f-5abc-43b3-99ef-4e292712de90 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:17.889377 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-8b37074f-5abc-43b3-99ef-4e292712de90 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.156604 Jul 11 11:32:17.889931 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 434/868] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:32:17 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:32:18.043553 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-2437a0b0-8f9f-4bd5-bbad-9884d97238ed tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:18.044420 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-2437a0b0-8f9f-4bd5-bbad-9884d97238ed tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:18.050640 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2437a0b0-8f9f-4bd5-bbad-9884d97238ed tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:18.051089 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2437a0b0-8f9f-4bd5-bbad-9884d97238ed tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:18.051910 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2437a0b0-8f9f-4bd5-bbad-9884d97238ed tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:18.052372 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2437a0b0-8f9f-4bd5-bbad-9884d97238ed tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:18.081571 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-2437a0b0-8f9f-4bd5-bbad-9884d97238ed tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042579 Jul 11 11:32:18.082126 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 435/869] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:18 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:32:18.375040 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-d58c5038-29ba-4957-a902-b787456339b4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:18.375710 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-d58c5038-29ba-4957-a902-b787456339b4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:18.382151 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d58c5038-29ba-4957-a902-b787456339b4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:18.382598 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d58c5038-29ba-4957-a902-b787456339b4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:18.383387 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d58c5038-29ba-4957-a902-b787456339b4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:18.383826 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d58c5038-29ba-4957-a902-b787456339b4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:18.508922 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-d58c5038-29ba-4957-a902-b787456339b4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:18.517772 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-d58c5038-29ba-4957-a902-b787456339b4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.146630 Jul 11 11:32:18.518331 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 435/870] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:32:18 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:32:18.648159 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-82beb0e5-81d6-4cad-92ff-d3f90140b4a8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:18.649029 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-82beb0e5-81d6-4cad-92ff-d3f90140b4a8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:18.656263 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-82beb0e5-81d6-4cad-92ff-d3f90140b4a8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:18.656720 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-82beb0e5-81d6-4cad-92ff-d3f90140b4a8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:18.657471 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-82beb0e5-81d6-4cad-92ff-d3f90140b4a8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:18.657908 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-82beb0e5-81d6-4cad-92ff-d3f90140b4a8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:18.686237 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-82beb0e5-81d6-4cad-92ff-d3f90140b4a8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042032 Jul 11 11:32:18.686790 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 436/871] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:18 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:32:18.907706 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-9ec74500-fa87-4e2e-9692-b89c61e7e909 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:18.908256 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-9ec74500-fa87-4e2e-9692-b89c61e7e909 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:18.914199 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9ec74500-fa87-4e2e-9692-b89c61e7e909 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:18.914650 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9ec74500-fa87-4e2e-9692-b89c61e7e909 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:18.915458 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9ec74500-fa87-4e2e-9692-b89c61e7e909 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:18.916472 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9ec74500-fa87-4e2e-9692-b89c61e7e909 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:19.043688 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-9ec74500-fa87-4e2e-9692-b89c61e7e909 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:19.052098 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-9ec74500-fa87-4e2e-9692-b89c61e7e909 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:19.053614 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-9ec74500-fa87-4e2e-9692-b89c61e7e909 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:19.054794 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-9ec74500-fa87-4e2e-9692-b89c61e7e909 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.151061 Jul 11 11:32:19.055345 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 436/872] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:32:18 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:32:19.093652 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-3b896882-12b1-4a4e-b88b-fe3a45be1e78 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:19.094553 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-3b896882-12b1-4a4e-b88b-fe3a45be1e78 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:19.101356 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3b896882-12b1-4a4e-b88b-fe3a45be1e78 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:19.101807 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3b896882-12b1-4a4e-b88b-fe3a45be1e78 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:19.102563 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3b896882-12b1-4a4e-b88b-fe3a45be1e78 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:19.103036 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3b896882-12b1-4a4e-b88b-fe3a45be1e78 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:19.131404 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-3b896882-12b1-4a4e-b88b-fe3a45be1e78 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041824 Jul 11 11:32:19.131946 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 437/873] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:19 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:32:19.539628 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-bc6d4c07-bf5a-4a89-9a36-332ee7ca562b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:19.540153 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-bc6d4c07-bf5a-4a89-9a36-332ee7ca562b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:19.547076 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-bc6d4c07-bf5a-4a89-9a36-332ee7ca562b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:19.547555 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-bc6d4c07-bf5a-4a89-9a36-332ee7ca562b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:19.548305 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-bc6d4c07-bf5a-4a89-9a36-332ee7ca562b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:19.548736 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-bc6d4c07-bf5a-4a89-9a36-332ee7ca562b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:19.675733 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-bc6d4c07-bf5a-4a89-9a36-332ee7ca562b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:19.683974 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-bc6d4c07-bf5a-4a89-9a36-332ee7ca562b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.152371 Jul 11 11:32:19.684527 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 437/874] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:32:19 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:32:19.698077 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-8faf3621-6941-4274-bdcc-4ff33a8f05c8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:19.699021 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-8faf3621-6941-4274-bdcc-4ff33a8f05c8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:19.705389 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8faf3621-6941-4274-bdcc-4ff33a8f05c8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:19.705834 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8faf3621-6941-4274-bdcc-4ff33a8f05c8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:19.706586 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8faf3621-6941-4274-bdcc-4ff33a8f05c8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:19.707018 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8faf3621-6941-4274-bdcc-4ff33a8f05c8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:19.734518 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-8faf3621-6941-4274-bdcc-4ff33a8f05c8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040838 Jul 11 11:32:19.735066 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 438/875] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:19 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:32:20.073165 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-d66f3c16-9382-4542-8100-abe64e4fc3b2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:20.073944 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-d66f3c16-9382-4542-8100-abe64e4fc3b2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:20.079746 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d66f3c16-9382-4542-8100-abe64e4fc3b2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:20.080193 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d66f3c16-9382-4542-8100-abe64e4fc3b2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:20.080954 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d66f3c16-9382-4542-8100-abe64e4fc3b2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:20.081391 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d66f3c16-9382-4542-8100-abe64e4fc3b2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:20.143526 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-66262663-ea52-4519-b986-edd721b961f1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:20.144362 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-66262663-ea52-4519-b986-edd721b961f1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:20.150198 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-66262663-ea52-4519-b986-edd721b961f1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:20.150644 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-66262663-ea52-4519-b986-edd721b961f1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:20.151437 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-66262663-ea52-4519-b986-edd721b961f1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:20.151872 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-66262663-ea52-4519-b986-edd721b961f1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:20.180883 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-66262663-ea52-4519-b986-edd721b961f1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041408 Jul 11 11:32:20.182014 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 439/876] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:20 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:32:20.207722 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-d66f3c16-9382-4542-8100-abe64e4fc3b2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:20.216585 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-d66f3c16-9382-4542-8100-abe64e4fc3b2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:20.218125 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-d66f3c16-9382-4542-8100-abe64e4fc3b2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:20.219298 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-d66f3c16-9382-4542-8100-abe64e4fc3b2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.150046 Jul 11 11:32:20.219858 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 438/877] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:32:20 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:32:20.701918 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-31fa29ed-005a-4e5e-bc3a-48f03a482076 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:20.702518 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-31fa29ed-005a-4e5e-bc3a-48f03a482076 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:20.708975 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-31fa29ed-005a-4e5e-bc3a-48f03a482076 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:20.709422 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-31fa29ed-005a-4e5e-bc3a-48f03a482076 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:20.710175 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-31fa29ed-005a-4e5e-bc3a-48f03a482076 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:20.710608 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-31fa29ed-005a-4e5e-bc3a-48f03a482076 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:20.745959 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-142efcf2-e879-407a-a16c-49de032d2872 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:20.746917 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-142efcf2-e879-407a-a16c-49de032d2872 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:20.753421 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-142efcf2-e879-407a-a16c-49de032d2872 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:20.753867 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-142efcf2-e879-407a-a16c-49de032d2872 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:20.754628 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-142efcf2-e879-407a-a16c-49de032d2872 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:20.755056 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-142efcf2-e879-407a-a16c-49de032d2872 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:20.785131 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-142efcf2-e879-407a-a16c-49de032d2872 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043525 Jul 11 11:32:20.786378 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 439/878] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:20 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:32:20.837272 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-31fa29ed-005a-4e5e-bc3a-48f03a482076 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:20.845145 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-31fa29ed-005a-4e5e-bc3a-48f03a482076 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.147695 Jul 11 11:32:20.845701 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 440/879] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:32:20 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:32:21.193394 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-c37ded43-0d5e-45ee-80f9-3ed6ea069e07 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:21.194445 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-c37ded43-0d5e-45ee-80f9-3ed6ea069e07 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:21.201061 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c37ded43-0d5e-45ee-80f9-3ed6ea069e07 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:21.201510 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c37ded43-0d5e-45ee-80f9-3ed6ea069e07 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:21.202266 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c37ded43-0d5e-45ee-80f9-3ed6ea069e07 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:21.202705 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c37ded43-0d5e-45ee-80f9-3ed6ea069e07 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:21.231165 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-c37ded43-0d5e-45ee-80f9-3ed6ea069e07 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041651 Jul 11 11:32:21.231762 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 440/880] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:21 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:32:21.237690 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-5cc2cf19-2c0a-4b14-a234-e44295c890e8 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:21.238294 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-5cc2cf19-2c0a-4b14-a234-e44295c890e8 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:21.245362 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5cc2cf19-2c0a-4b14-a234-e44295c890e8 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:21.245591 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5cc2cf19-2c0a-4b14-a234-e44295c890e8 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:21.246346 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5cc2cf19-2c0a-4b14-a234-e44295c890e8 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:21.246777 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5cc2cf19-2c0a-4b14-a234-e44295c890e8 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:21.386267 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-5cc2cf19-2c0a-4b14-a234-e44295c890e8 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:21.394465 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-5cc2cf19-2c0a-4b14-a234-e44295c890e8 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:21.395997 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-5cc2cf19-2c0a-4b14-a234-e44295c890e8 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:21.397161 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-5cc2cf19-2c0a-4b14-a234-e44295c890e8 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.163353 Jul 11 11:32:21.397710 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 441/881] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:32:21 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:32:21.797109 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-25bbe015-63c3-42ab-8bb7-55a2e9d31134 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:21.798040 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-25bbe015-63c3-42ab-8bb7-55a2e9d31134 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:21.804532 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-25bbe015-63c3-42ab-8bb7-55a2e9d31134 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:21.804987 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-25bbe015-63c3-42ab-8bb7-55a2e9d31134 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:21.805757 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-25bbe015-63c3-42ab-8bb7-55a2e9d31134 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:21.806786 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-25bbe015-63c3-42ab-8bb7-55a2e9d31134 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:21.834771 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-25bbe015-63c3-42ab-8bb7-55a2e9d31134 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041609 Jul 11 11:32:21.835326 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 441/882] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:21 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:32:21.869975 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-a0dc47bb-1754-41d7-be86-704b98e67320 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:21.870579 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-a0dc47bb-1754-41d7-be86-704b98e67320 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:21.878689 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a0dc47bb-1754-41d7-be86-704b98e67320 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:21.881231 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a0dc47bb-1754-41d7-be86-704b98e67320 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:21.881231 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a0dc47bb-1754-41d7-be86-704b98e67320 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:21.881231 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a0dc47bb-1754-41d7-be86-704b98e67320 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:22.009246 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-a0dc47bb-1754-41d7-be86-704b98e67320 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:22.017838 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-a0dc47bb-1754-41d7-be86-704b98e67320 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.152558 Jul 11 11:32:22.018410 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 442/883] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:32:21 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:32:22.242835 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-5ed1d4ac-3c1d-4411-9621-125eec4754e4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:22.243873 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-5ed1d4ac-3c1d-4411-9621-125eec4754e4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:22.250144 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5ed1d4ac-3c1d-4411-9621-125eec4754e4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:22.250594 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5ed1d4ac-3c1d-4411-9621-125eec4754e4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:22.251373 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5ed1d4ac-3c1d-4411-9621-125eec4754e4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:22.251811 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5ed1d4ac-3c1d-4411-9621-125eec4754e4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:22.282718 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-5ed1d4ac-3c1d-4411-9621-125eec4754e4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043764 Jul 11 11:32:22.283537 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 442/884] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:22 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:32:22.414868 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-24a81907-2bd1-4c7b-9f71-8544ea240865 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:22.415528 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-24a81907-2bd1-4c7b-9f71-8544ea240865 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:22.421427 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-24a81907-2bd1-4c7b-9f71-8544ea240865 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:22.421868 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-24a81907-2bd1-4c7b-9f71-8544ea240865 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:22.422620 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-24a81907-2bd1-4c7b-9f71-8544ea240865 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:22.423049 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-24a81907-2bd1-4c7b-9f71-8544ea240865 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:22.565894 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-24a81907-2bd1-4c7b-9f71-8544ea240865 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:22.574624 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-24a81907-2bd1-4c7b-9f71-8544ea240865 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:22.576160 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-24a81907-2bd1-4c7b-9f71-8544ea240865 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:22.577297 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-24a81907-2bd1-4c7b-9f71-8544ea240865 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.166250 Jul 11 11:32:22.577862 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 443/885] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:32:22 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:32:22.846201 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-ae90aaa2-edb1-43a7-a9d2-4d5e5cd32b27 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:22.847286 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-ae90aaa2-edb1-43a7-a9d2-4d5e5cd32b27 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:22.854284 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ae90aaa2-edb1-43a7-a9d2-4d5e5cd32b27 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:22.854727 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ae90aaa2-edb1-43a7-a9d2-4d5e5cd32b27 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:22.855552 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ae90aaa2-edb1-43a7-a9d2-4d5e5cd32b27 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:22.855988 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ae90aaa2-edb1-43a7-a9d2-4d5e5cd32b27 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:22.884479 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-ae90aaa2-edb1-43a7-a9d2-4d5e5cd32b27 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042466 Jul 11 11:32:22.885028 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 443/886] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:22 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:32:23.035442 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-8d182bf6-d8d8-4262-863c-47e982dde03a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:23.036054 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-8d182bf6-d8d8-4262-863c-47e982dde03a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:23.043319 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8d182bf6-d8d8-4262-863c-47e982dde03a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:23.047285 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8d182bf6-d8d8-4262-863c-47e982dde03a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:23.047285 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8d182bf6-d8d8-4262-863c-47e982dde03a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:23.047285 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8d182bf6-d8d8-4262-863c-47e982dde03a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:23.172062 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-8d182bf6-d8d8-4262-863c-47e982dde03a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:23.179852 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-8d182bf6-d8d8-4262-863c-47e982dde03a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.148390 Jul 11 11:32:23.180417 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 444/887] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:32:23 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:32:23.293901 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-19838a72-964b-4bf1-8f43-d0f27b3e315b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:23.294819 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-19838a72-964b-4bf1-8f43-d0f27b3e315b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:23.300791 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-19838a72-964b-4bf1-8f43-d0f27b3e315b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:23.301239 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-19838a72-964b-4bf1-8f43-d0f27b3e315b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:23.301994 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-19838a72-964b-4bf1-8f43-d0f27b3e315b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:23.302429 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-19838a72-964b-4bf1-8f43-d0f27b3e315b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:23.330670 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-19838a72-964b-4bf1-8f43-d0f27b3e315b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040677 Jul 11 11:32:23.331203 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 444/888] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:23 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:32:23.596060 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-c9419bbf-736d-44f6-84a5-b3698d5f21b3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:23.596832 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-c9419bbf-736d-44f6-84a5-b3698d5f21b3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:23.602720 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c9419bbf-736d-44f6-84a5-b3698d5f21b3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:23.603196 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c9419bbf-736d-44f6-84a5-b3698d5f21b3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:23.603973 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c9419bbf-736d-44f6-84a5-b3698d5f21b3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:23.604402 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c9419bbf-736d-44f6-84a5-b3698d5f21b3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:23.729406 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-c9419bbf-736d-44f6-84a5-b3698d5f21b3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:23.737607 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-c9419bbf-736d-44f6-84a5-b3698d5f21b3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:23.739211 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-c9419bbf-736d-44f6-84a5-b3698d5f21b3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:23.740364 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-c9419bbf-736d-44f6-84a5-b3698d5f21b3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.148252 Jul 11 11:32:23.740920 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 445/889] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:32:23 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:32:23.896120 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-51f5f8d2-5dad-46aa-8e8c-ddc1f9f4413e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:23.897047 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-51f5f8d2-5dad-46aa-8e8c-ddc1f9f4413e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:23.903522 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-51f5f8d2-5dad-46aa-8e8c-ddc1f9f4413e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:23.903976 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-51f5f8d2-5dad-46aa-8e8c-ddc1f9f4413e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:23.904767 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-51f5f8d2-5dad-46aa-8e8c-ddc1f9f4413e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:23.905210 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-51f5f8d2-5dad-46aa-8e8c-ddc1f9f4413e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:23.934049 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-51f5f8d2-5dad-46aa-8e8c-ddc1f9f4413e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041897 Jul 11 11:32:23.934525 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 445/890] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:23 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:32:24.196907 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-619ec488-f956-4251-913a-b20c85450812 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:24.197441 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-619ec488-f956-4251-913a-b20c85450812 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:24.203876 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-619ec488-f956-4251-913a-b20c85450812 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:24.204321 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-619ec488-f956-4251-913a-b20c85450812 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:24.205067 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-619ec488-f956-4251-913a-b20c85450812 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:24.205493 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-619ec488-f956-4251-913a-b20c85450812 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:24.336941 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-619ec488-f956-4251-913a-b20c85450812 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:24.342372 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-8810ab11-331a-4e5b-8cf5-62ce8d1fd208 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:24.343350 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-8810ab11-331a-4e5b-8cf5-62ce8d1fd208 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:24.345289 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-619ec488-f956-4251-913a-b20c85450812 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.152330 Jul 11 11:32:24.346025 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 446/891] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:32:24 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:32:24.349315 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8810ab11-331a-4e5b-8cf5-62ce8d1fd208 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:24.349765 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8810ab11-331a-4e5b-8cf5-62ce8d1fd208 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:24.350527 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8810ab11-331a-4e5b-8cf5-62ce8d1fd208 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:24.350964 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8810ab11-331a-4e5b-8cf5-62ce8d1fd208 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:24.379220 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-8810ab11-331a-4e5b-8cf5-62ce8d1fd208 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040698 Jul 11 11:32:24.379784 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 446/892] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:24 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:32:24.757817 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-88e95927-733a-4880-bf0a-1e56e3c6c742 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:24.758340 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-88e95927-733a-4880-bf0a-1e56e3c6c742 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:24.765026 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-88e95927-733a-4880-bf0a-1e56e3c6c742 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:24.765594 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-88e95927-733a-4880-bf0a-1e56e3c6c742 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:24.766413 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-88e95927-733a-4880-bf0a-1e56e3c6c742 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:24.766845 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-88e95927-733a-4880-bf0a-1e56e3c6c742 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:24.770780 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=100 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:32:24.890725 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-88e95927-733a-4880-bf0a-1e56e3c6c742 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:24.898843 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-88e95927-733a-4880-bf0a-1e56e3c6c742 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:24.901040 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-88e95927-733a-4880-bf0a-1e56e3c6c742 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:24.902238 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-88e95927-733a-4880-bf0a-1e56e3c6c742 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.148339 Jul 11 11:32:24.902798 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 447/893] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:32:24 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:32:24.944839 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-ac324cdc-0d3a-498d-a877-69a0bf8b2882 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:24.945758 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-ac324cdc-0d3a-498d-a877-69a0bf8b2882 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:24.952719 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ac324cdc-0d3a-498d-a877-69a0bf8b2882 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:24.953161 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ac324cdc-0d3a-498d-a877-69a0bf8b2882 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:24.953908 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ac324cdc-0d3a-498d-a877-69a0bf8b2882 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:24.954336 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ac324cdc-0d3a-498d-a877-69a0bf8b2882 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:24.957915 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=100 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:32:24.982730 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-ac324cdc-0d3a-498d-a877-69a0bf8b2882 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041748 Jul 11 11:32:24.983285 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 447/894] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:24 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:32:25.362576 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-c5e0647a-f7d9-4087-ad91-16fe46d05ca4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:25.363111 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-c5e0647a-f7d9-4087-ad91-16fe46d05ca4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:25.370205 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c5e0647a-f7d9-4087-ad91-16fe46d05ca4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:25.370645 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c5e0647a-f7d9-4087-ad91-16fe46d05ca4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:25.371421 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c5e0647a-f7d9-4087-ad91-16fe46d05ca4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:25.371854 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c5e0647a-f7d9-4087-ad91-16fe46d05ca4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:25.390552 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-417cdef8-ae2d-491e-bf41-2a8ad9dc2dfd tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:25.391738 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-417cdef8-ae2d-491e-bf41-2a8ad9dc2dfd tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:25.398237 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-417cdef8-ae2d-491e-bf41-2a8ad9dc2dfd tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:25.398683 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-417cdef8-ae2d-491e-bf41-2a8ad9dc2dfd tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:25.399473 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-417cdef8-ae2d-491e-bf41-2a8ad9dc2dfd tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:25.399906 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-417cdef8-ae2d-491e-bf41-2a8ad9dc2dfd tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:25.429496 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-417cdef8-ae2d-491e-bf41-2a8ad9dc2dfd tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042804 Jul 11 11:32:25.430070 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 448/895] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:25 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:32:25.502443 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-c5e0647a-f7d9-4087-ad91-16fe46d05ca4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:25.510702 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-c5e0647a-f7d9-4087-ad91-16fe46d05ca4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.151952 Jul 11 11:32:25.511478 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 448/896] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:32:25 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:32:25.920868 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-ce0624c4-ddb3-4880-a42b-bc95217cf460 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:25.921470 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-ce0624c4-ddb3-4880-a42b-bc95217cf460 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:25.927452 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ce0624c4-ddb3-4880-a42b-bc95217cf460 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:25.927899 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ce0624c4-ddb3-4880-a42b-bc95217cf460 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:25.928652 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ce0624c4-ddb3-4880-a42b-bc95217cf460 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:25.929085 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ce0624c4-ddb3-4880-a42b-bc95217cf460 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:25.994863 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-84b92864-6c47-4af9-8331-98a2c6dfa78c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:25.995803 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-84b92864-6c47-4af9-8331-98a2c6dfa78c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:26.001957 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-84b92864-6c47-4af9-8331-98a2c6dfa78c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:26.002475 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-84b92864-6c47-4af9-8331-98a2c6dfa78c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:26.003425 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-84b92864-6c47-4af9-8331-98a2c6dfa78c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:26.003922 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-84b92864-6c47-4af9-8331-98a2c6dfa78c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:26.035423 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-84b92864-6c47-4af9-8331-98a2c6dfa78c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044967 Jul 11 11:32:26.035987 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 449/897] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:25 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:32:26.060247 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-ce0624c4-ddb3-4880-a42b-bc95217cf460 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:26.068795 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-ce0624c4-ddb3-4880-a42b-bc95217cf460 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:26.070327 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-ce0624c4-ddb3-4880-a42b-bc95217cf460 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:26.071504 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-ce0624c4-ddb3-4880-a42b-bc95217cf460 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.154501 Jul 11 11:32:26.072084 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 449/898] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:32:25 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:32:26.441849 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-679d4354-727b-4707-8b5e-c48ec392db0b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:26.442763 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-679d4354-727b-4707-8b5e-c48ec392db0b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:26.449220 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-679d4354-727b-4707-8b5e-c48ec392db0b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:26.449665 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-679d4354-727b-4707-8b5e-c48ec392db0b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:26.450420 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-679d4354-727b-4707-8b5e-c48ec392db0b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:26.450850 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-679d4354-727b-4707-8b5e-c48ec392db0b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:26.479752 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-679d4354-727b-4707-8b5e-c48ec392db0b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042076 Jul 11 11:32:26.480295 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 450/899] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:26 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:32:26.527348 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-f1a06054-b111-4d2f-8847-7a8e71a65270 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:26.527955 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-f1a06054-b111-4d2f-8847-7a8e71a65270 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:26.533965 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f1a06054-b111-4d2f-8847-7a8e71a65270 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:26.534414 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f1a06054-b111-4d2f-8847-7a8e71a65270 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:26.535166 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f1a06054-b111-4d2f-8847-7a8e71a65270 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:26.535627 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f1a06054-b111-4d2f-8847-7a8e71a65270 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:26.663085 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-f1a06054-b111-4d2f-8847-7a8e71a65270 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:26.671504 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-f1a06054-b111-4d2f-8847-7a8e71a65270 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.148417 Jul 11 11:32:26.672063 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 450/900] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:32:26 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:32:27.046636 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-f577b2f9-94bf-4508-b706-894831e984bd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:27.047528 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-f577b2f9-94bf-4508-b706-894831e984bd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:27.053624 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f577b2f9-94bf-4508-b706-894831e984bd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:27.054067 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f577b2f9-94bf-4508-b706-894831e984bd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:27.054821 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f577b2f9-94bf-4508-b706-894831e984bd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:27.055272 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f577b2f9-94bf-4508-b706-894831e984bd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:27.085030 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-f577b2f9-94bf-4508-b706-894831e984bd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042365 Jul 11 11:32:27.085591 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 451/901] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:27 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:32:27.090304 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-bcc75288-31d2-4a60-be35-120183804bda tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:27.090904 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-bcc75288-31d2-4a60-be35-120183804bda tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:27.097240 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-bcc75288-31d2-4a60-be35-120183804bda tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:27.097675 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-bcc75288-31d2-4a60-be35-120183804bda tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:27.098419 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-bcc75288-31d2-4a60-be35-120183804bda tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:27.098846 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-bcc75288-31d2-4a60-be35-120183804bda tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:27.225172 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-bcc75288-31d2-4a60-be35-120183804bda tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:27.233417 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-bcc75288-31d2-4a60-be35-120183804bda tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:27.234920 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-bcc75288-31d2-4a60-be35-120183804bda tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:27.236097 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-bcc75288-31d2-4a60-be35-120183804bda tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.150466 Jul 11 11:32:27.236658 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 451/902] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:32:27 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 11:32:27.491062 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-e7865518-5675-4ad6-a4ef-9bac1f1a2c96 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:27.491990 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-e7865518-5675-4ad6-a4ef-9bac1f1a2c96 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:27.498891 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e7865518-5675-4ad6-a4ef-9bac1f1a2c96 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:27.499371 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e7865518-5675-4ad6-a4ef-9bac1f1a2c96 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:27.500153 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e7865518-5675-4ad6-a4ef-9bac1f1a2c96 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:27.500599 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e7865518-5675-4ad6-a4ef-9bac1f1a2c96 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:27.529068 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-e7865518-5675-4ad6-a4ef-9bac1f1a2c96 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041940 Jul 11 11:32:27.529616 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 452/903] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:27 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:32:27.688734 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-5f6f5877-f104-4b8b-91f7-0bad90b48fba tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:27.689448 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-5f6f5877-f104-4b8b-91f7-0bad90b48fba tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:27.695483 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5f6f5877-f104-4b8b-91f7-0bad90b48fba tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:27.695928 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5f6f5877-f104-4b8b-91f7-0bad90b48fba tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:27.696681 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5f6f5877-f104-4b8b-91f7-0bad90b48fba tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:27.697113 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5f6f5877-f104-4b8b-91f7-0bad90b48fba tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:27.820878 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-5f6f5877-f104-4b8b-91f7-0bad90b48fba tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:27.828610 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-5f6f5877-f104-4b8b-91f7-0bad90b48fba tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.144174 Jul 11 11:32:27.829172 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 452/904] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:32:27 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:32:28.096957 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-a243e69f-94fa-4e5f-9426-44841124061b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:28.097883 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-a243e69f-94fa-4e5f-9426-44841124061b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:28.104619 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a243e69f-94fa-4e5f-9426-44841124061b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:28.105069 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a243e69f-94fa-4e5f-9426-44841124061b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:28.105858 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a243e69f-94fa-4e5f-9426-44841124061b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:28.106298 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a243e69f-94fa-4e5f-9426-44841124061b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:28.133907 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-a243e69f-94fa-4e5f-9426-44841124061b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040899 Jul 11 11:32:28.134484 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 453/905] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:28 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:32:28.253681 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-85bb2b8a-cb9c-42ff-bc32-a0169f68757d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:28.254283 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-85bb2b8a-cb9c-42ff-bc32-a0169f68757d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:28.260733 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-85bb2b8a-cb9c-42ff-bc32-a0169f68757d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:28.261175 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-85bb2b8a-cb9c-42ff-bc32-a0169f68757d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:28.261925 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-85bb2b8a-cb9c-42ff-bc32-a0169f68757d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:28.262352 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-85bb2b8a-cb9c-42ff-bc32-a0169f68757d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:28.388789 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-85bb2b8a-cb9c-42ff-bc32-a0169f68757d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:28.397078 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-85bb2b8a-cb9c-42ff-bc32-a0169f68757d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:28.398576 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-85bb2b8a-cb9c-42ff-bc32-a0169f68757d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:28.399752 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-85bb2b8a-cb9c-42ff-bc32-a0169f68757d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.149941 Jul 11 11:32:28.400927 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 453/906] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:32:28 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:32:28.539988 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-1bd68746-a615-49bc-b40e-f0782b6c1247 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:28.540908 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-1bd68746-a615-49bc-b40e-f0782b6c1247 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:28.547216 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1bd68746-a615-49bc-b40e-f0782b6c1247 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:28.547693 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1bd68746-a615-49bc-b40e-f0782b6c1247 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:28.548446 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1bd68746-a615-49bc-b40e-f0782b6c1247 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:28.548880 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1bd68746-a615-49bc-b40e-f0782b6c1247 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:28.577024 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-1bd68746-a615-49bc-b40e-f0782b6c1247 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040939 Jul 11 11:32:28.577566 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 454/907] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:28 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:32:28.844390 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-5cd36732-6796-4eb3-9b89-dac326d8a725 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:28.844993 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-5cd36732-6796-4eb3-9b89-dac326d8a725 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:28.850845 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5cd36732-6796-4eb3-9b89-dac326d8a725 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:28.851311 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5cd36732-6796-4eb3-9b89-dac326d8a725 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:28.852064 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5cd36732-6796-4eb3-9b89-dac326d8a725 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:28.852491 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5cd36732-6796-4eb3-9b89-dac326d8a725 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:28.980410 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-5cd36732-6796-4eb3-9b89-dac326d8a725 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:28.988210 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-5cd36732-6796-4eb3-9b89-dac326d8a725 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.147605 Jul 11 11:32:28.988825 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 454/908] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:32:28 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:32:29.145544 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-d170480f-ea6f-441b-bdcd-6de16638d383 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:29.146386 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-d170480f-ea6f-441b-bdcd-6de16638d383 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:29.152987 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d170480f-ea6f-441b-bdcd-6de16638d383 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:29.153433 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d170480f-ea6f-441b-bdcd-6de16638d383 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:29.154189 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d170480f-ea6f-441b-bdcd-6de16638d383 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:29.154620 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d170480f-ea6f-441b-bdcd-6de16638d383 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:29.181727 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-d170480f-ea6f-441b-bdcd-6de16638d383 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040191 Jul 11 11:32:29.182267 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 455/909] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:29 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:32:29.419026 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-e529043f-8220-4443-b7fe-3d395c3f0442 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:29.419661 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-e529043f-8220-4443-b7fe-3d395c3f0442 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:29.426026 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e529043f-8220-4443-b7fe-3d395c3f0442 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:29.426473 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e529043f-8220-4443-b7fe-3d395c3f0442 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:29.427230 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e529043f-8220-4443-b7fe-3d395c3f0442 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:29.427793 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e529043f-8220-4443-b7fe-3d395c3f0442 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:29.552313 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-e529043f-8220-4443-b7fe-3d395c3f0442 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:29.560548 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-e529043f-8220-4443-b7fe-3d395c3f0442 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:29.562054 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-e529043f-8220-4443-b7fe-3d395c3f0442 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:29.563196 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-e529043f-8220-4443-b7fe-3d395c3f0442 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.148781 Jul 11 11:32:29.564045 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 455/910] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:32:29 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:32:29.588296 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-4ec2687b-08ae-4e0a-a5e9-058eec32f891 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:29.589701 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-4ec2687b-08ae-4e0a-a5e9-058eec32f891 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:29.596050 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4ec2687b-08ae-4e0a-a5e9-058eec32f891 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:29.596492 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4ec2687b-08ae-4e0a-a5e9-058eec32f891 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:29.597249 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4ec2687b-08ae-4e0a-a5e9-058eec32f891 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:29.597680 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4ec2687b-08ae-4e0a-a5e9-058eec32f891 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:29.625942 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-4ec2687b-08ae-4e0a-a5e9-058eec32f891 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041455 Jul 11 11:32:29.626484 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 456/911] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:29 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:32:30.004982 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-fc207fb9-3fb2-4946-90d4-ed40d64fc0c2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:30.005514 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-fc207fb9-3fb2-4946-90d4-ed40d64fc0c2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:30.011542 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fc207fb9-3fb2-4946-90d4-ed40d64fc0c2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:30.011991 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fc207fb9-3fb2-4946-90d4-ed40d64fc0c2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:30.012738 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fc207fb9-3fb2-4946-90d4-ed40d64fc0c2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:30.013172 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fc207fb9-3fb2-4946-90d4-ed40d64fc0c2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:30.149039 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-fc207fb9-3fb2-4946-90d4-ed40d64fc0c2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:30.157417 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-fc207fb9-3fb2-4946-90d4-ed40d64fc0c2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.156526 Jul 11 11:32:30.157977 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 456/912] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:32:29 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:32:30.193453 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-e280e686-1512-4c8e-bdef-e7c74918ca54 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:30.194367 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-e280e686-1512-4c8e-bdef-e7c74918ca54 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:30.200277 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e280e686-1512-4c8e-bdef-e7c74918ca54 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:30.200724 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e280e686-1512-4c8e-bdef-e7c74918ca54 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:30.201482 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e280e686-1512-4c8e-bdef-e7c74918ca54 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:30.201915 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e280e686-1512-4c8e-bdef-e7c74918ca54 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:30.230736 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-e280e686-1512-4c8e-bdef-e7c74918ca54 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041138 Jul 11 11:32:30.231315 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 457/913] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:30 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:32:30.581657 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-64cdaad5-dbc6-47c1-98b6-35d01e4a1496 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:30.582258 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-64cdaad5-dbc6-47c1-98b6-35d01e4a1496 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:30.589320 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-64cdaad5-dbc6-47c1-98b6-35d01e4a1496 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:30.589764 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-64cdaad5-dbc6-47c1-98b6-35d01e4a1496 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:30.590526 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-64cdaad5-dbc6-47c1-98b6-35d01e4a1496 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:30.590962 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-64cdaad5-dbc6-47c1-98b6-35d01e4a1496 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:30.637912 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-ee909b28-4e89-45e4-b75a-f957262a003c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:30.638860 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-ee909b28-4e89-45e4-b75a-f957262a003c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:30.645241 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ee909b28-4e89-45e4-b75a-f957262a003c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:30.645688 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ee909b28-4e89-45e4-b75a-f957262a003c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:30.646447 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ee909b28-4e89-45e4-b75a-f957262a003c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:30.646882 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ee909b28-4e89-45e4-b75a-f957262a003c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:30.678655 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-ee909b28-4e89-45e4-b75a-f957262a003c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044647 Jul 11 11:32:30.679909 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 458/914] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:30 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:32:30.720664 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-64cdaad5-dbc6-47c1-98b6-35d01e4a1496 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:30.728871 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-64cdaad5-dbc6-47c1-98b6-35d01e4a1496 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:30.730370 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-64cdaad5-dbc6-47c1-98b6-35d01e4a1496 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:30.731537 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-64cdaad5-dbc6-47c1-98b6-35d01e4a1496 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.153789 Jul 11 11:32:30.732090 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 457/915] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:32:30 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:32:31.175118 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-558a10d8-7a95-4a2a-837e-f662af379e79 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:31.175790 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-558a10d8-7a95-4a2a-837e-f662af379e79 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:31.181751 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-558a10d8-7a95-4a2a-837e-f662af379e79 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:31.182235 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-558a10d8-7a95-4a2a-837e-f662af379e79 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:31.183019 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-558a10d8-7a95-4a2a-837e-f662af379e79 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:31.183478 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-558a10d8-7a95-4a2a-837e-f662af379e79 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:31.242212 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-e4c3a55e-ee69-430b-b7c9-8783aa02032c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:31.243142 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-e4c3a55e-ee69-430b-b7c9-8783aa02032c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:31.249092 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e4c3a55e-ee69-430b-b7c9-8783aa02032c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:31.249542 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e4c3a55e-ee69-430b-b7c9-8783aa02032c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:31.250305 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e4c3a55e-ee69-430b-b7c9-8783aa02032c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:31.250738 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e4c3a55e-ee69-430b-b7c9-8783aa02032c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:31.281782 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-e4c3a55e-ee69-430b-b7c9-8783aa02032c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043601 Jul 11 11:32:31.282543 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 458/916] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:31 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:32:31.310199 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-558a10d8-7a95-4a2a-837e-f662af379e79 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:31.322224 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-558a10d8-7a95-4a2a-837e-f662af379e79 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.150938 Jul 11 11:32:31.323346 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 459/917] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:32:31 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:32:31.691492 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-38777ff2-23e2-480c-a3aa-2fa1399fa807 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:31.692265 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-38777ff2-23e2-480c-a3aa-2fa1399fa807 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:31.694493 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_api:SELECT=100 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:32:31.699223 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-38777ff2-23e2-480c-a3aa-2fa1399fa807 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:31.699702 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-38777ff2-23e2-480c-a3aa-2fa1399fa807 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:31.700461 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-38777ff2-23e2-480c-a3aa-2fa1399fa807 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:31.700900 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-38777ff2-23e2-480c-a3aa-2fa1399fa807 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:31.728950 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-38777ff2-23e2-480c-a3aa-2fa1399fa807 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041967 Jul 11 11:32:31.730094 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 459/918] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:31 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:32:31.749169 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-f5b3e1ac-8681-4acc-b296-eda19f7d6907 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:31.749780 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-f5b3e1ac-8681-4acc-b296-eda19f7d6907 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:31.756233 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f5b3e1ac-8681-4acc-b296-eda19f7d6907 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:31.756713 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f5b3e1ac-8681-4acc-b296-eda19f7d6907 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:31.757479 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f5b3e1ac-8681-4acc-b296-eda19f7d6907 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:31.757915 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f5b3e1ac-8681-4acc-b296-eda19f7d6907 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:31.885240 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-f5b3e1ac-8681-4acc-b296-eda19f7d6907 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:31.893557 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-f5b3e1ac-8681-4acc-b296-eda19f7d6907 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:31.895055 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-f5b3e1ac-8681-4acc-b296-eda19f7d6907 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:31.896227 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-f5b3e1ac-8681-4acc-b296-eda19f7d6907 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.150953 Jul 11 11:32:31.896796 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 460/919] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:32:31 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:32:32.293898 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-6d4c70a6-e793-446a-a874-fdaa42639281 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:32.294825 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-6d4c70a6-e793-446a-a874-fdaa42639281 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:32.300820 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6d4c70a6-e793-446a-a874-fdaa42639281 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:32.301273 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6d4c70a6-e793-446a-a874-fdaa42639281 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:32.302036 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6d4c70a6-e793-446a-a874-fdaa42639281 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:32.302499 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6d4c70a6-e793-446a-a874-fdaa42639281 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:32.338562 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-6d4c70a6-e793-446a-a874-fdaa42639281 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048801 Jul 11 11:32:32.339590 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 460/920] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:32 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:32:32.341180 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-2e415fc6-65a3-4743-8f33-f50776d7140b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:32.341798 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-2e415fc6-65a3-4743-8f33-f50776d7140b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:32.344682 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_api:SELECT=100 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:32:32.348127 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2e415fc6-65a3-4743-8f33-f50776d7140b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:32.348573 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2e415fc6-65a3-4743-8f33-f50776d7140b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:32.349340 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2e415fc6-65a3-4743-8f33-f50776d7140b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:32.349779 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2e415fc6-65a3-4743-8f33-f50776d7140b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:32.483939 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-2e415fc6-65a3-4743-8f33-f50776d7140b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:32.491739 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-2e415fc6-65a3-4743-8f33-f50776d7140b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.155142 Jul 11 11:32:32.492306 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 461/921] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:32:32 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:32:32.741306 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-590789e1-b3c6-4d71-8d3a-9d55d3003224 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:32.742248 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-590789e1-b3c6-4d71-8d3a-9d55d3003224 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:32.749221 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-590789e1-b3c6-4d71-8d3a-9d55d3003224 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:32.749670 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-590789e1-b3c6-4d71-8d3a-9d55d3003224 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:32.750455 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-590789e1-b3c6-4d71-8d3a-9d55d3003224 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:32.750895 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-590789e1-b3c6-4d71-8d3a-9d55d3003224 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:32.779203 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-590789e1-b3c6-4d71-8d3a-9d55d3003224 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041865 Jul 11 11:32:32.779784 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 461/922] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:32 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:32:32.915099 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-e7e5a870-849d-417f-8eb3-75ed3b2bf3a1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:32.915727 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-e7e5a870-849d-417f-8eb3-75ed3b2bf3a1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:32.922784 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e7e5a870-849d-417f-8eb3-75ed3b2bf3a1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:32.923238 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e7e5a870-849d-417f-8eb3-75ed3b2bf3a1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:32.924058 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e7e5a870-849d-417f-8eb3-75ed3b2bf3a1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:32.924489 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e7e5a870-849d-417f-8eb3-75ed3b2bf3a1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:33.053017 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-e7e5a870-849d-417f-8eb3-75ed3b2bf3a1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:33.062214 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-e7e5a870-849d-417f-8eb3-75ed3b2bf3a1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:33.064012 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-e7e5a870-849d-417f-8eb3-75ed3b2bf3a1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:33.065153 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-e7e5a870-849d-417f-8eb3-75ed3b2bf3a1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.153983 Jul 11 11:32:33.065706 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 462/923] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:32:32 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:32:33.350428 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-86a69576-df0e-4093-b20c-fd51dc462613 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:33.351325 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-86a69576-df0e-4093-b20c-fd51dc462613 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:33.357280 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-86a69576-df0e-4093-b20c-fd51dc462613 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:33.357732 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-86a69576-df0e-4093-b20c-fd51dc462613 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:33.358487 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-86a69576-df0e-4093-b20c-fd51dc462613 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:33.358923 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-86a69576-df0e-4093-b20c-fd51dc462613 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:33.387947 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-86a69576-df0e-4093-b20c-fd51dc462613 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041514 Jul 11 11:32:33.388492 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 462/924] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:33 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:32:33.509058 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-ffe966f3-f32e-484d-8000-33eb299bb88a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:33.509665 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-ffe966f3-f32e-484d-8000-33eb299bb88a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:33.516354 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ffe966f3-f32e-484d-8000-33eb299bb88a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:33.518726 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ffe966f3-f32e-484d-8000-33eb299bb88a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:33.518726 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ffe966f3-f32e-484d-8000-33eb299bb88a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:33.518726 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ffe966f3-f32e-484d-8000-33eb299bb88a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:33.645819 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-ffe966f3-f32e-484d-8000-33eb299bb88a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:33.649153 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=100 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:32:33.653894 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-ffe966f3-f32e-484d-8000-33eb299bb88a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.148713 Jul 11 11:32:33.654450 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 463/925] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:32:33 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:32:33.789867 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-0791eefb-72fc-408c-bc73-239a1f45598d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:33.790788 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-0791eefb-72fc-408c-bc73-239a1f45598d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:33.797177 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0791eefb-72fc-408c-bc73-239a1f45598d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:33.797625 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0791eefb-72fc-408c-bc73-239a1f45598d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:33.798377 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0791eefb-72fc-408c-bc73-239a1f45598d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:33.798811 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0791eefb-72fc-408c-bc73-239a1f45598d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:33.822551 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=100 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:32:33.827395 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-0791eefb-72fc-408c-bc73-239a1f45598d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041423 Jul 11 11:32:33.827940 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 463/926] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:33 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:32:34.084407 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-1c3aaf4e-5595-42bf-b0dd-df4e46182d39 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:34.085010 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-1c3aaf4e-5595-42bf-b0dd-df4e46182d39 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:34.092539 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1c3aaf4e-5595-42bf-b0dd-df4e46182d39 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:34.093035 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1c3aaf4e-5595-42bf-b0dd-df4e46182d39 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:34.093836 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1c3aaf4e-5595-42bf-b0dd-df4e46182d39 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:34.094285 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1c3aaf4e-5595-42bf-b0dd-df4e46182d39 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:34.232084 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-1c3aaf4e-5595-42bf-b0dd-df4e46182d39 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:34.240317 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-1c3aaf4e-5595-42bf-b0dd-df4e46182d39 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:34.241808 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-1c3aaf4e-5595-42bf-b0dd-df4e46182d39 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:34.242942 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-1c3aaf4e-5595-42bf-b0dd-df4e46182d39 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.162886 Jul 11 11:32:34.243545 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 464/927] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:32:34 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:32:34.399538 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-e8418781-22a7-40c5-b7a8-941fd1addeeb tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:34.400509 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-e8418781-22a7-40c5-b7a8-941fd1addeeb tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:34.406734 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e8418781-22a7-40c5-b7a8-941fd1addeeb tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:34.407178 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e8418781-22a7-40c5-b7a8-941fd1addeeb tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:34.407952 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e8418781-22a7-40c5-b7a8-941fd1addeeb tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:34.408382 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e8418781-22a7-40c5-b7a8-941fd1addeeb tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:34.436914 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-e8418781-22a7-40c5-b7a8-941fd1addeeb tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040694 Jul 11 11:32:34.437387 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 464/928] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:34 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:32:34.670209 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-90472e4e-9605-4e21-b632-5b4c6f282f43 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:34.670812 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-90472e4e-9605-4e21-b632-5b4c6f282f43 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:34.676730 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-90472e4e-9605-4e21-b632-5b4c6f282f43 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:34.677170 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-90472e4e-9605-4e21-b632-5b4c6f282f43 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:34.677917 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-90472e4e-9605-4e21-b632-5b4c6f282f43 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:34.678344 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-90472e4e-9605-4e21-b632-5b4c6f282f43 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:34.804906 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-90472e4e-9605-4e21-b632-5b4c6f282f43 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:34.812592 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-90472e4e-9605-4e21-b632-5b4c6f282f43 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.146707 Jul 11 11:32:34.813156 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 465/929] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:32:34 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:32:34.837848 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-bd0bc92d-3a1f-439b-a61d-484aa0c7628c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:34.839313 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-bd0bc92d-3a1f-439b-a61d-484aa0c7628c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:34.845771 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-bd0bc92d-3a1f-439b-a61d-484aa0c7628c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:34.846220 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-bd0bc92d-3a1f-439b-a61d-484aa0c7628c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:34.846988 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-bd0bc92d-3a1f-439b-a61d-484aa0c7628c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:34.847452 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-bd0bc92d-3a1f-439b-a61d-484aa0c7628c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:34.875927 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-bd0bc92d-3a1f-439b-a61d-484aa0c7628c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041990 Jul 11 11:32:34.876480 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 465/930] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:34 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:32:35.262176 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-8e5bf102-8859-4496-a304-2bc943d2ec69 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:35.262714 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-8e5bf102-8859-4496-a304-2bc943d2ec69 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:35.269133 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8e5bf102-8859-4496-a304-2bc943d2ec69 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:35.269579 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8e5bf102-8859-4496-a304-2bc943d2ec69 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:35.270338 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8e5bf102-8859-4496-a304-2bc943d2ec69 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:35.270774 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8e5bf102-8859-4496-a304-2bc943d2ec69 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:35.397441 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-8e5bf102-8859-4496-a304-2bc943d2ec69 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:35.404611 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-8e5bf102-8859-4496-a304-2bc943d2ec69 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:35.406101 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-8e5bf102-8859-4496-a304-2bc943d2ec69 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:35.407272 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-8e5bf102-8859-4496-a304-2bc943d2ec69 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.149568 Jul 11 11:32:35.416092 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 466/931] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:32:35 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:32:35.449423 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-f8277ef1-b3d1-4296-97a3-259c47441def tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:35.453188 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-f8277ef1-b3d1-4296-97a3-259c47441def tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:35.456439 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f8277ef1-b3d1-4296-97a3-259c47441def tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:35.456911 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f8277ef1-b3d1-4296-97a3-259c47441def tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:35.457670 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f8277ef1-b3d1-4296-97a3-259c47441def tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:35.458128 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f8277ef1-b3d1-4296-97a3-259c47441def tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:35.486156 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-f8277ef1-b3d1-4296-97a3-259c47441def tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041379 Jul 11 11:32:35.486705 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 466/932] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:35 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:32:35.829367 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-cb71c32a-a7b0-4f35-a13e-0ebb2ea8085d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:35.830002 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-cb71c32a-a7b0-4f35-a13e-0ebb2ea8085d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:35.835972 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-cb71c32a-a7b0-4f35-a13e-0ebb2ea8085d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:35.836410 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-cb71c32a-a7b0-4f35-a13e-0ebb2ea8085d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:35.837154 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-cb71c32a-a7b0-4f35-a13e-0ebb2ea8085d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:35.837582 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-cb71c32a-a7b0-4f35-a13e-0ebb2ea8085d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:35.887205 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-4f565e3f-6c22-46d2-a4b4-f7b7c32318e5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:35.888150 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-4f565e3f-6c22-46d2-a4b4-f7b7c32318e5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:35.894688 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4f565e3f-6c22-46d2-a4b4-f7b7c32318e5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:35.895132 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4f565e3f-6c22-46d2-a4b4-f7b7c32318e5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:35.895914 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4f565e3f-6c22-46d2-a4b4-f7b7c32318e5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:35.896350 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4f565e3f-6c22-46d2-a4b4-f7b7c32318e5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:35.925188 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-4f565e3f-6c22-46d2-a4b4-f7b7c32318e5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041865 Jul 11 11:32:35.925750 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 467/933] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:35 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:32:35.965625 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-cb71c32a-a7b0-4f35-a13e-0ebb2ea8085d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:35.973475 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-cb71c32a-a7b0-4f35-a13e-0ebb2ea8085d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.147896 Jul 11 11:32:35.974025 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 467/934] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:32:35 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:32:36.425542 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-669153a3-206b-4020-9492-427d8a3a5ff8 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:36.426146 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-669153a3-206b-4020-9492-427d8a3a5ff8 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:36.432681 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-669153a3-206b-4020-9492-427d8a3a5ff8 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:36.433118 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-669153a3-206b-4020-9492-427d8a3a5ff8 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:36.433869 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-669153a3-206b-4020-9492-427d8a3a5ff8 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:36.434295 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-669153a3-206b-4020-9492-427d8a3a5ff8 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:36.498374 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-a72b154e-3ae4-406b-8f59-5711e6d8be51 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:36.499307 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-a72b154e-3ae4-406b-8f59-5711e6d8be51 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:36.505691 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a72b154e-3ae4-406b-8f59-5711e6d8be51 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:36.506136 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a72b154e-3ae4-406b-8f59-5711e6d8be51 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:36.506897 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a72b154e-3ae4-406b-8f59-5711e6d8be51 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:36.507364 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a72b154e-3ae4-406b-8f59-5711e6d8be51 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:36.567834 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-669153a3-206b-4020-9492-427d8a3a5ff8 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:36.577049 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-669153a3-206b-4020-9492-427d8a3a5ff8 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:36.578456 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-669153a3-206b-4020-9492-427d8a3a5ff8 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:36.579681 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-669153a3-206b-4020-9492-427d8a3a5ff8 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.157997 Jul 11 11:32:36.580255 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 468/935] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:32:36 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:32:36.683957 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-a72b154e-3ae4-406b-8f59-5711e6d8be51 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.189944 Jul 11 11:32:36.684512 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 468/936] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:36 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:32:36.936588 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-2b746937-f4d2-417a-85db-476a9baaed88 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:36.937503 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-2b746937-f4d2-417a-85db-476a9baaed88 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:36.944124 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2b746937-f4d2-417a-85db-476a9baaed88 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:36.944568 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2b746937-f4d2-417a-85db-476a9baaed88 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:36.945311 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2b746937-f4d2-417a-85db-476a9baaed88 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:36.945737 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2b746937-f4d2-417a-85db-476a9baaed88 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:36.974061 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-2b746937-f4d2-417a-85db-476a9baaed88 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041395 Jul 11 11:32:36.974589 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 469/937] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:36 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:32:36.989747 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-5ca2983a-23c8-4ecf-ad7d-bba049badfce tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:36.990422 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-5ca2983a-23c8-4ecf-ad7d-bba049badfce tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:36.996355 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5ca2983a-23c8-4ecf-ad7d-bba049badfce tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:36.996819 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5ca2983a-23c8-4ecf-ad7d-bba049badfce tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:36.997669 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5ca2983a-23c8-4ecf-ad7d-bba049badfce tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:36.998102 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5ca2983a-23c8-4ecf-ad7d-bba049badfce tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:37.136755 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-5ca2983a-23c8-4ecf-ad7d-bba049badfce tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:37.144502 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-5ca2983a-23c8-4ecf-ad7d-bba049badfce tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.158519 Jul 11 11:32:37.145051 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 469/938] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:32:36 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:32:37.598474 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-ce417d97-dda2-4638-afce-f782a4ad8d92 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:37.599577 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-ce417d97-dda2-4638-afce-f782a4ad8d92 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:37.605186 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ce417d97-dda2-4638-afce-f782a4ad8d92 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:37.605633 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ce417d97-dda2-4638-afce-f782a4ad8d92 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:37.606408 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ce417d97-dda2-4638-afce-f782a4ad8d92 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:37.606864 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ce417d97-dda2-4638-afce-f782a4ad8d92 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:37.697468 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-9aa443d0-15ac-4c65-a2bc-b82a9429564d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:37.701063 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-9aa443d0-15ac-4c65-a2bc-b82a9429564d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:37.705299 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9aa443d0-15ac-4c65-a2bc-b82a9429564d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:37.705744 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9aa443d0-15ac-4c65-a2bc-b82a9429564d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:37.706507 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9aa443d0-15ac-4c65-a2bc-b82a9429564d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:37.706940 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9aa443d0-15ac-4c65-a2bc-b82a9429564d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:37.735492 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-9aa443d0-15ac-4c65-a2bc-b82a9429564d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043828 Jul 11 11:32:37.736051 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 470/939] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:37 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:32:37.739433 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-ce417d97-dda2-4638-afce-f782a4ad8d92 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:37.748328 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-ce417d97-dda2-4638-afce-f782a4ad8d92 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:37.749860 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-ce417d97-dda2-4638-afce-f782a4ad8d92 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:37.751005 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-ce417d97-dda2-4638-afce-f782a4ad8d92 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.156868 Jul 11 11:32:37.751583 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 470/940] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:32:37 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:32:37.985707 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-37e1e966-20a4-49cb-ab83-992fcd861b76 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:37.992276 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-37e1e966-20a4-49cb-ab83-992fcd861b76 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:37.992557 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-37e1e966-20a4-49cb-ab83-992fcd861b76 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:37.992994 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-37e1e966-20a4-49cb-ab83-992fcd861b76 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:37.993741 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-37e1e966-20a4-49cb-ab83-992fcd861b76 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:37.994169 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-37e1e966-20a4-49cb-ab83-992fcd861b76 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:38.027154 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-37e1e966-20a4-49cb-ab83-992fcd861b76 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043988 Jul 11 11:32:38.027154 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 471/941] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:37 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:32:38.161769 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-4adb9ac6-4522-49e4-b981-3fde6fe2b800 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:38.162489 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-4adb9ac6-4522-49e4-b981-3fde6fe2b800 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:38.168793 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4adb9ac6-4522-49e4-b981-3fde6fe2b800 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:38.169303 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4adb9ac6-4522-49e4-b981-3fde6fe2b800 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:38.170100 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4adb9ac6-4522-49e4-b981-3fde6fe2b800 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:38.170414 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4adb9ac6-4522-49e4-b981-3fde6fe2b800 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:38.295133 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-4adb9ac6-4522-49e4-b981-3fde6fe2b800 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:38.302922 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-4adb9ac6-4522-49e4-b981-3fde6fe2b800 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.145144 Jul 11 11:32:38.303517 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 471/942] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:32:38 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:32:38.359463 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 11:32:38.360418 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Mon Jul 11 11:32:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 11:32:38.746501 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-52349194-ee9e-4826-a365-1605020a01cc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:38.747465 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-52349194-ee9e-4826-a365-1605020a01cc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:38.753910 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-52349194-ee9e-4826-a365-1605020a01cc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:38.754361 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-52349194-ee9e-4826-a365-1605020a01cc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:38.755122 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-52349194-ee9e-4826-a365-1605020a01cc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:38.755593 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-52349194-ee9e-4826-a365-1605020a01cc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:38.769499 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-96d66300-2923-4056-90a2-bc4555dc0f37 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:38.770106 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-96d66300-2923-4056-90a2-bc4555dc0f37 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:38.776582 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-96d66300-2923-4056-90a2-bc4555dc0f37 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:38.777089 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-96d66300-2923-4056-90a2-bc4555dc0f37 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:38.777850 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-96d66300-2923-4056-90a2-bc4555dc0f37 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:38.778287 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-96d66300-2923-4056-90a2-bc4555dc0f37 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:38.785423 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-52349194-ee9e-4826-a365-1605020a01cc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042891 Jul 11 11:32:38.785964 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 472/943] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:38 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:32:38.905014 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-96d66300-2923-4056-90a2-bc4555dc0f37 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:38.913319 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-96d66300-2923-4056-90a2-bc4555dc0f37 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:38.914815 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-96d66300-2923-4056-90a2-bc4555dc0f37 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:38.916003 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-96d66300-2923-4056-90a2-bc4555dc0f37 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.150393 Jul 11 11:32:38.916582 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 472/944] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:32:38 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 11:32:39.037895 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-b2bb4453-bd2b-4303-9723-6cbb4a264be7 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:39.038730 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-b2bb4453-bd2b-4303-9723-6cbb4a264be7 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:39.044800 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b2bb4453-bd2b-4303-9723-6cbb4a264be7 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:39.045241 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b2bb4453-bd2b-4303-9723-6cbb4a264be7 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:39.045989 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b2bb4453-bd2b-4303-9723-6cbb4a264be7 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:39.046414 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b2bb4453-bd2b-4303-9723-6cbb4a264be7 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:39.075705 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-b2bb4453-bd2b-4303-9723-6cbb4a264be7 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041672 Jul 11 11:32:39.076253 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 473/945] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:39 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:32:39.320242 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-7b7f4698-befd-46fd-89b6-8715a8d26ede tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:39.320815 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-7b7f4698-befd-46fd-89b6-8715a8d26ede tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:39.327523 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7b7f4698-befd-46fd-89b6-8715a8d26ede tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:39.327972 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7b7f4698-befd-46fd-89b6-8715a8d26ede tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:39.328732 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7b7f4698-befd-46fd-89b6-8715a8d26ede tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:39.329168 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7b7f4698-befd-46fd-89b6-8715a8d26ede tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:39.452718 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-7b7f4698-befd-46fd-89b6-8715a8d26ede tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:39.460579 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-7b7f4698-befd-46fd-89b6-8715a8d26ede tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.144356 Jul 11 11:32:39.461146 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 473/946] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:32:39 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:32:39.797549 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-10328fe7-909b-48e3-90d0-b9c730383b52 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:39.798470 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-10328fe7-909b-48e3-90d0-b9c730383b52 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:39.804996 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-10328fe7-909b-48e3-90d0-b9c730383b52 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:39.805449 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-10328fe7-909b-48e3-90d0-b9c730383b52 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:39.806215 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-10328fe7-909b-48e3-90d0-b9c730383b52 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:39.806652 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-10328fe7-909b-48e3-90d0-b9c730383b52 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:39.836824 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-10328fe7-909b-48e3-90d0-b9c730383b52 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043282 Jul 11 11:32:39.842224 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 474/947] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:39 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:32:39.934122 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-6a8678ea-dc37-4c68-8445-42b266819d1f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:39.934728 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-6a8678ea-dc37-4c68-8445-42b266819d1f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:39.941270 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6a8678ea-dc37-4c68-8445-42b266819d1f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:39.941713 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6a8678ea-dc37-4c68-8445-42b266819d1f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:39.942499 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6a8678ea-dc37-4c68-8445-42b266819d1f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:39.942925 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6a8678ea-dc37-4c68-8445-42b266819d1f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:40.071550 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-6a8678ea-dc37-4c68-8445-42b266819d1f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:40.078750 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-6a8678ea-dc37-4c68-8445-42b266819d1f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:40.080278 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-6a8678ea-dc37-4c68-8445-42b266819d1f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:40.081480 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-6a8678ea-dc37-4c68-8445-42b266819d1f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.151205 Jul 11 11:32:40.082086 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 474/948] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:32:39 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:32:40.087301 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-de2ab550-4687-4266-885f-f6bbcc6895d3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:40.088233 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-de2ab550-4687-4266-885f-f6bbcc6895d3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:40.094586 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-de2ab550-4687-4266-885f-f6bbcc6895d3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:40.095024 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-de2ab550-4687-4266-885f-f6bbcc6895d3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:40.095803 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-de2ab550-4687-4266-885f-f6bbcc6895d3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:40.096230 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-de2ab550-4687-4266-885f-f6bbcc6895d3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:40.125244 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-de2ab550-4687-4266-885f-f6bbcc6895d3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041815 Jul 11 11:32:40.125732 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 475/949] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:40 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:32:40.477483 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-22c4ad98-0f90-4c87-b9a5-e077ac81da7a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:40.478094 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-22c4ad98-0f90-4c87-b9a5-e077ac81da7a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:40.485141 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-22c4ad98-0f90-4c87-b9a5-e077ac81da7a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:40.485595 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-22c4ad98-0f90-4c87-b9a5-e077ac81da7a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:40.486353 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-22c4ad98-0f90-4c87-b9a5-e077ac81da7a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:40.486789 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-22c4ad98-0f90-4c87-b9a5-e077ac81da7a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:40.611369 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-22c4ad98-0f90-4c87-b9a5-e077ac81da7a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:40.619142 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-22c4ad98-0f90-4c87-b9a5-e077ac81da7a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.145480 Jul 11 11:32:40.619734 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 475/950] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:32:40 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:32:40.848492 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-557f3f03-959a-4e7c-b8e8-f9c8c1202bea tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:40.849323 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-557f3f03-959a-4e7c-b8e8-f9c8c1202bea tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:40.856296 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-557f3f03-959a-4e7c-b8e8-f9c8c1202bea tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:40.856744 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-557f3f03-959a-4e7c-b8e8-f9c8c1202bea tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:40.857495 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-557f3f03-959a-4e7c-b8e8-f9c8c1202bea tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:40.857929 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-557f3f03-959a-4e7c-b8e8-f9c8c1202bea tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:40.885864 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-557f3f03-959a-4e7c-b8e8-f9c8c1202bea tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041380 Jul 11 11:32:40.886405 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 476/951] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:40 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:32:41.100174 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-42cb5279-5131-4b28-8a82-91e611c3e0b5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:41.100695 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-42cb5279-5131-4b28-8a82-91e611c3e0b5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:41.106646 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-42cb5279-5131-4b28-8a82-91e611c3e0b5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:41.107104 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-42cb5279-5131-4b28-8a82-91e611c3e0b5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:41.107924 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-42cb5279-5131-4b28-8a82-91e611c3e0b5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:41.108361 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-42cb5279-5131-4b28-8a82-91e611c3e0b5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:41.137081 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-6b74c643-5b81-4117-af6f-5d68849c7f4e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:41.137988 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-6b74c643-5b81-4117-af6f-5d68849c7f4e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:41.143941 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6b74c643-5b81-4117-af6f-5d68849c7f4e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:41.144386 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6b74c643-5b81-4117-af6f-5d68849c7f4e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:41.145137 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6b74c643-5b81-4117-af6f-5d68849c7f4e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:41.145562 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6b74c643-5b81-4117-af6f-5d68849c7f4e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:41.175221 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-6b74c643-5b81-4117-af6f-5d68849c7f4e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042459 Jul 11 11:32:41.180305 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 477/952] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:41 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:32:41.237152 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-42cb5279-5131-4b28-8a82-91e611c3e0b5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:41.245438 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-42cb5279-5131-4b28-8a82-91e611c3e0b5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:41.247010 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-42cb5279-5131-4b28-8a82-91e611c3e0b5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:41.248272 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-42cb5279-5131-4b28-8a82-91e611c3e0b5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.152018 Jul 11 11:32:41.248825 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 476/953] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:32:41 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:32:41.637074 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-a29bd142-d045-43a6-9edc-f299efb8e195 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:41.637586 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-a29bd142-d045-43a6-9edc-f299efb8e195 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:41.643836 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a29bd142-d045-43a6-9edc-f299efb8e195 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:41.644285 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a29bd142-d045-43a6-9edc-f299efb8e195 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:41.645042 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a29bd142-d045-43a6-9edc-f299efb8e195 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:41.645477 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a29bd142-d045-43a6-9edc-f299efb8e195 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:41.771422 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-a29bd142-d045-43a6-9edc-f299efb8e195 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:41.779418 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-a29bd142-d045-43a6-9edc-f299efb8e195 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.146779 Jul 11 11:32:41.779972 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 478/954] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:32:41 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:32:41.898023 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-1240b5dc-bfc2-47bb-b9af-8973ad5796c3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:41.899047 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-1240b5dc-bfc2-47bb-b9af-8973ad5796c3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:41.905521 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1240b5dc-bfc2-47bb-b9af-8973ad5796c3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:41.905971 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1240b5dc-bfc2-47bb-b9af-8973ad5796c3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:41.906731 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1240b5dc-bfc2-47bb-b9af-8973ad5796c3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:41.907166 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1240b5dc-bfc2-47bb-b9af-8973ad5796c3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:41.936057 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-1240b5dc-bfc2-47bb-b9af-8973ad5796c3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042662 Jul 11 11:32:41.936606 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 477/955] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:41 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:32:42.186947 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-3d749b98-cee8-4e10-8e16-bca5d0bff5f7 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:42.187895 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-3d749b98-cee8-4e10-8e16-bca5d0bff5f7 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:42.194814 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3d749b98-cee8-4e10-8e16-bca5d0bff5f7 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:42.195284 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3d749b98-cee8-4e10-8e16-bca5d0bff5f7 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:42.196055 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3d749b98-cee8-4e10-8e16-bca5d0bff5f7 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:42.196526 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3d749b98-cee8-4e10-8e16-bca5d0bff5f7 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:42.224876 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-3d749b98-cee8-4e10-8e16-bca5d0bff5f7 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041874 Jul 11 11:32:42.225419 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 479/956] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:42 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:32:42.266327 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-8a42cdaa-a401-4fbb-9c19-e3b4c672dce1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:42.266927 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-8a42cdaa-a401-4fbb-9c19-e3b4c672dce1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:42.272802 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8a42cdaa-a401-4fbb-9c19-e3b4c672dce1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:42.273247 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8a42cdaa-a401-4fbb-9c19-e3b4c672dce1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:42.273991 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8a42cdaa-a401-4fbb-9c19-e3b4c672dce1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:42.274421 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8a42cdaa-a401-4fbb-9c19-e3b4c672dce1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:42.405368 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-8a42cdaa-a401-4fbb-9c19-e3b4c672dce1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:42.414487 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-8a42cdaa-a401-4fbb-9c19-e3b4c672dce1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:42.416345 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-8a42cdaa-a401-4fbb-9c19-e3b4c672dce1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:42.418924 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-8a42cdaa-a401-4fbb-9c19-e3b4c672dce1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.155859 Jul 11 11:32:42.419538 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 478/957] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:32:42 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:32:42.796405 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-0aafb920-a716-4f43-a7ff-da399ae98ca5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:42.797018 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-0aafb920-a716-4f43-a7ff-da399ae98ca5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:42.803052 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0aafb920-a716-4f43-a7ff-da399ae98ca5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:42.803532 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0aafb920-a716-4f43-a7ff-da399ae98ca5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:42.804297 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0aafb920-a716-4f43-a7ff-da399ae98ca5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:42.804738 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0aafb920-a716-4f43-a7ff-da399ae98ca5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:42.822772 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=100 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:32:42.934763 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-0aafb920-a716-4f43-a7ff-da399ae98ca5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:42.943134 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-0aafb920-a716-4f43-a7ff-da399ae98ca5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.150643 Jul 11 11:32:42.943709 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 480/958] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:32:42 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:32:42.948041 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-07154df6-4230-4e5c-a328-d0123364eb27 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:42.949520 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-07154df6-4230-4e5c-a328-d0123364eb27 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:42.955992 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-07154df6-4230-4e5c-a328-d0123364eb27 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:42.956440 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-07154df6-4230-4e5c-a328-d0123364eb27 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:42.957195 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-07154df6-4230-4e5c-a328-d0123364eb27 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:42.957631 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-07154df6-4230-4e5c-a328-d0123364eb27 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:42.986185 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-07154df6-4230-4e5c-a328-d0123364eb27 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042304 Jul 11 11:32:42.986743 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 479/959] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:42 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:32:43.236585 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-8250f6ca-c969-43a7-a601-5e7d2c7d26e1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:43.237535 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-8250f6ca-c969-43a7-a601-5e7d2c7d26e1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:43.244082 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8250f6ca-c969-43a7-a601-5e7d2c7d26e1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:43.244534 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8250f6ca-c969-43a7-a601-5e7d2c7d26e1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:43.245948 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8250f6ca-c969-43a7-a601-5e7d2c7d26e1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:43.246382 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8250f6ca-c969-43a7-a601-5e7d2c7d26e1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:43.274803 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-8250f6ca-c969-43a7-a601-5e7d2c7d26e1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042219 Jul 11 11:32:43.275361 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 481/960] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:43 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:32:43.442969 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-7663d760-0965-4152-befb-ecc86bf545a0 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:43.448192 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-7663d760-0965-4152-befb-ecc86bf545a0 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:43.449816 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7663d760-0965-4152-befb-ecc86bf545a0 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:43.450311 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7663d760-0965-4152-befb-ecc86bf545a0 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:43.451071 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7663d760-0965-4152-befb-ecc86bf545a0 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:43.451545 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7663d760-0965-4152-befb-ecc86bf545a0 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:43.470638 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=100 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:32:43.582496 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-7663d760-0965-4152-befb-ecc86bf545a0 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:43.590805 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-7663d760-0965-4152-befb-ecc86bf545a0 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:43.592375 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-7663d760-0965-4152-befb-ecc86bf545a0 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:43.593533 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-7663d760-0965-4152-befb-ecc86bf545a0 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.154700 Jul 11 11:32:43.594089 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 480/961] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:32:43 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:32:43.960361 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-fac47f63-2e84-4798-9eb1-3d08fffd4ce3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:43.960981 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-fac47f63-2e84-4798-9eb1-3d08fffd4ce3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:43.967491 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fac47f63-2e84-4798-9eb1-3d08fffd4ce3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:43.967942 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fac47f63-2e84-4798-9eb1-3d08fffd4ce3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:43.968697 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fac47f63-2e84-4798-9eb1-3d08fffd4ce3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:43.969128 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fac47f63-2e84-4798-9eb1-3d08fffd4ce3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:43.997688 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-d1050ed7-d27f-4b85-8103-4e64cd6b2870 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:43.998611 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-d1050ed7-d27f-4b85-8103-4e64cd6b2870 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:44.005185 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d1050ed7-d27f-4b85-8103-4e64cd6b2870 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:44.005644 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d1050ed7-d27f-4b85-8103-4e64cd6b2870 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:44.006415 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d1050ed7-d27f-4b85-8103-4e64cd6b2870 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:44.006856 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d1050ed7-d27f-4b85-8103-4e64cd6b2870 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:44.036604 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-d1050ed7-d27f-4b85-8103-4e64cd6b2870 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042713 Jul 11 11:32:44.037177 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 481/962] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:43 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:32:44.097506 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-fac47f63-2e84-4798-9eb1-3d08fffd4ce3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:44.106037 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-fac47f63-2e84-4798-9eb1-3d08fffd4ce3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.149488 Jul 11 11:32:44.111672 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 482/963] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:32:43 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:32:44.286419 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-fa98f652-ee0a-4145-a228-c42fd79598db tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:44.287352 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-fa98f652-ee0a-4145-a228-c42fd79598db tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:44.293717 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fa98f652-ee0a-4145-a228-c42fd79598db tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:44.294160 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fa98f652-ee0a-4145-a228-c42fd79598db tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:44.294911 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fa98f652-ee0a-4145-a228-c42fd79598db tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:44.295376 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fa98f652-ee0a-4145-a228-c42fd79598db tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:44.323845 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-fa98f652-ee0a-4145-a228-c42fd79598db tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041330 Jul 11 11:32:44.324397 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 482/964] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:44 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:32:44.611609 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-caf47c7c-e0e0-4763-a353-0be45b621425 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:44.612135 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-caf47c7c-e0e0-4763-a353-0be45b621425 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:44.618541 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-caf47c7c-e0e0-4763-a353-0be45b621425 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:44.619176 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-caf47c7c-e0e0-4763-a353-0be45b621425 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:44.620014 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-caf47c7c-e0e0-4763-a353-0be45b621425 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:44.620446 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-caf47c7c-e0e0-4763-a353-0be45b621425 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:44.743447 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-caf47c7c-e0e0-4763-a353-0be45b621425 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:44.751657 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-caf47c7c-e0e0-4763-a353-0be45b621425 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:44.753132 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-caf47c7c-e0e0-4763-a353-0be45b621425 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:44.754438 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-caf47c7c-e0e0-4763-a353-0be45b621425 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.146720 Jul 11 11:32:44.754984 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 483/965] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:32:44 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:32:45.048474 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-fd246b60-b540-461f-b578-8017b7191c25 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:45.049390 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-fd246b60-b540-461f-b578-8017b7191c25 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:45.056075 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fd246b60-b540-461f-b578-8017b7191c25 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:45.056525 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fd246b60-b540-461f-b578-8017b7191c25 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:45.057287 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fd246b60-b540-461f-b578-8017b7191c25 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:45.057729 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fd246b60-b540-461f-b578-8017b7191c25 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:45.086571 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-fd246b60-b540-461f-b578-8017b7191c25 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042023 Jul 11 11:32:45.087124 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 483/966] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:45 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:32:45.123165 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-0ca7f310-588a-4da6-8543-4b0dc77a2b19 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:45.123801 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-0ca7f310-588a-4da6-8543-4b0dc77a2b19 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:45.130380 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0ca7f310-588a-4da6-8543-4b0dc77a2b19 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:45.130819 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0ca7f310-588a-4da6-8543-4b0dc77a2b19 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:45.131603 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0ca7f310-588a-4da6-8543-4b0dc77a2b19 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:45.132033 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0ca7f310-588a-4da6-8543-4b0dc77a2b19 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:45.258611 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-0ca7f310-588a-4da6-8543-4b0dc77a2b19 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:45.266972 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-0ca7f310-588a-4da6-8543-4b0dc77a2b19 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.148137 Jul 11 11:32:45.267567 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 484/967] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:32:45 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:32:45.335308 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-8028eab8-bdfa-4547-a78a-8b9ae7f2bebe tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:45.336150 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-8028eab8-bdfa-4547-a78a-8b9ae7f2bebe tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:45.342112 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8028eab8-bdfa-4547-a78a-8b9ae7f2bebe tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:45.342561 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8028eab8-bdfa-4547-a78a-8b9ae7f2bebe tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:45.343350 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8028eab8-bdfa-4547-a78a-8b9ae7f2bebe tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:45.343793 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8028eab8-bdfa-4547-a78a-8b9ae7f2bebe tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:45.371850 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-8028eab8-bdfa-4547-a78a-8b9ae7f2bebe tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040531 Jul 11 11:32:45.372396 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 484/968] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:45 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:32:45.772869 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-fdc9ac21-437f-4159-801e-28f63946414f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:45.773475 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-fdc9ac21-437f-4159-801e-28f63946414f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:45.780730 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fdc9ac21-437f-4159-801e-28f63946414f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:45.781182 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fdc9ac21-437f-4159-801e-28f63946414f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:45.781938 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fdc9ac21-437f-4159-801e-28f63946414f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:45.782372 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fdc9ac21-437f-4159-801e-28f63946414f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:45.908527 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-fdc9ac21-437f-4159-801e-28f63946414f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:45.916752 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-fdc9ac21-437f-4159-801e-28f63946414f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:45.918236 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-fdc9ac21-437f-4159-801e-28f63946414f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:45.919402 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-fdc9ac21-437f-4159-801e-28f63946414f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.150380 Jul 11 11:32:45.919953 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 485/969] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:32:45 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:32:46.098055 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-aa7a2f30-ba32-4e47-9bc2-c777383a8910 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:46.098981 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-aa7a2f30-ba32-4e47-9bc2-c777383a8910 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:46.105498 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-aa7a2f30-ba32-4e47-9bc2-c777383a8910 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:46.105943 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-aa7a2f30-ba32-4e47-9bc2-c777383a8910 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:46.109309 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-aa7a2f30-ba32-4e47-9bc2-c777383a8910 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:46.109309 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-aa7a2f30-ba32-4e47-9bc2-c777383a8910 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:46.142144 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-aa7a2f30-ba32-4e47-9bc2-c777383a8910 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048013 Jul 11 11:32:46.142702 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 485/970] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:46 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:32:46.283694 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-8358198e-9180-4a61-b66d-6e41706fcb4c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:46.284296 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-8358198e-9180-4a61-b66d-6e41706fcb4c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:46.290534 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8358198e-9180-4a61-b66d-6e41706fcb4c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:46.290981 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8358198e-9180-4a61-b66d-6e41706fcb4c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:46.292314 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8358198e-9180-4a61-b66d-6e41706fcb4c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:46.292746 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8358198e-9180-4a61-b66d-6e41706fcb4c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:46.383244 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-fce08982-27e9-4a50-832e-08205540d5a6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:46.384199 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-fce08982-27e9-4a50-832e-08205540d5a6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:46.390381 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fce08982-27e9-4a50-832e-08205540d5a6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:46.390848 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fce08982-27e9-4a50-832e-08205540d5a6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:46.391705 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fce08982-27e9-4a50-832e-08205540d5a6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:46.392157 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fce08982-27e9-4a50-832e-08205540d5a6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:46.429156 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-8358198e-9180-4a61-b66d-6e41706fcb4c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:46.429678 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-fce08982-27e9-4a50-832e-08205540d5a6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050284 Jul 11 11:32:46.430449 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 486/971] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:46 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:32:46.437927 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-8358198e-9180-4a61-b66d-6e41706fcb4c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.158010 Jul 11 11:32:46.438555 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 486/972] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:32:46 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:32:46.936856 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-08f6531e-34cd-46bd-b7dc-0172348c3ed7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:46.937460 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-08f6531e-34cd-46bd-b7dc-0172348c3ed7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:46.943716 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-08f6531e-34cd-46bd-b7dc-0172348c3ed7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:46.944157 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-08f6531e-34cd-46bd-b7dc-0172348c3ed7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:46.944904 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-08f6531e-34cd-46bd-b7dc-0172348c3ed7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:46.945332 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-08f6531e-34cd-46bd-b7dc-0172348c3ed7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:47.071717 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-08f6531e-34cd-46bd-b7dc-0172348c3ed7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:47.080501 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-08f6531e-34cd-46bd-b7dc-0172348c3ed7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:47.081987 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-08f6531e-34cd-46bd-b7dc-0172348c3ed7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:47.083145 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-08f6531e-34cd-46bd-b7dc-0172348c3ed7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.150271 Jul 11 11:32:47.083718 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 487/973] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:32:46 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:32:47.153752 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-7c337e68-ed7d-4b2f-9b76-8dc6b252c395 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:47.154666 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-7c337e68-ed7d-4b2f-9b76-8dc6b252c395 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:47.161075 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7c337e68-ed7d-4b2f-9b76-8dc6b252c395 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:47.161521 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7c337e68-ed7d-4b2f-9b76-8dc6b252c395 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:47.162272 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7c337e68-ed7d-4b2f-9b76-8dc6b252c395 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:47.162701 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7c337e68-ed7d-4b2f-9b76-8dc6b252c395 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:47.192421 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-7c337e68-ed7d-4b2f-9b76-8dc6b252c395 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042576 Jul 11 11:32:47.192890 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 487/974] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:47 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:32:47.441657 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-607b2d18-d695-4a1d-b8c2-ced782b5169d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:47.444243 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-607b2d18-d695-4a1d-b8c2-ced782b5169d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:47.448977 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-607b2d18-d695-4a1d-b8c2-ced782b5169d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:47.449426 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-607b2d18-d695-4a1d-b8c2-ced782b5169d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:47.450171 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-607b2d18-d695-4a1d-b8c2-ced782b5169d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:47.450602 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-607b2d18-d695-4a1d-b8c2-ced782b5169d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:47.454968 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-f0f7dfbb-08d1-4d77-a8fc-0efc77de573c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:47.455602 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-f0f7dfbb-08d1-4d77-a8fc-0efc77de573c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:47.461726 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f0f7dfbb-08d1-4d77-a8fc-0efc77de573c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:47.462182 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f0f7dfbb-08d1-4d77-a8fc-0efc77de573c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:47.462954 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f0f7dfbb-08d1-4d77-a8fc-0efc77de573c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:47.463418 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f0f7dfbb-08d1-4d77-a8fc-0efc77de573c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:47.479515 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-607b2d18-d695-4a1d-b8c2-ced782b5169d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041949 Jul 11 11:32:47.480082 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 488/975] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:47 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:32:47.589660 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-f0f7dfbb-08d1-4d77-a8fc-0efc77de573c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:47.597671 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-f0f7dfbb-08d1-4d77-a8fc-0efc77de573c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.146506 Jul 11 11:32:47.598247 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 488/976] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:32:47 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:32:48.101812 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-dcf44945-90f0-4ec9-b5b8-b2691dd5abf9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:48.102964 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-dcf44945-90f0-4ec9-b5b8-b2691dd5abf9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:48.109045 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-dcf44945-90f0-4ec9-b5b8-b2691dd5abf9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:48.109547 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-dcf44945-90f0-4ec9-b5b8-b2691dd5abf9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:48.110362 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-dcf44945-90f0-4ec9-b5b8-b2691dd5abf9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:48.110793 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-dcf44945-90f0-4ec9-b5b8-b2691dd5abf9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:48.206106 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-77f6438c-5024-4b94-8aea-0119662311f5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:48.207035 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-77f6438c-5024-4b94-8aea-0119662311f5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:48.213914 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-77f6438c-5024-4b94-8aea-0119662311f5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:48.214365 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-77f6438c-5024-4b94-8aea-0119662311f5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:48.215142 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-77f6438c-5024-4b94-8aea-0119662311f5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:48.215608 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-77f6438c-5024-4b94-8aea-0119662311f5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:48.246363 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-77f6438c-5024-4b94-8aea-0119662311f5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045082 Jul 11 11:32:48.246975 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 489/977] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:48 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:32:48.263824 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-dcf44945-90f0-4ec9-b5b8-b2691dd5abf9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:48.272122 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-dcf44945-90f0-4ec9-b5b8-b2691dd5abf9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:48.273626 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-dcf44945-90f0-4ec9-b5b8-b2691dd5abf9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:48.274779 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-dcf44945-90f0-4ec9-b5b8-b2691dd5abf9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.176851 Jul 11 11:32:48.275369 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 489/978] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:32:48 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:32:48.491808 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-1c601bad-e890-4c6f-86e9-480180593883 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:48.492855 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-1c601bad-e890-4c6f-86e9-480180593883 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:48.499264 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1c601bad-e890-4c6f-86e9-480180593883 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:48.499717 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1c601bad-e890-4c6f-86e9-480180593883 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:48.500632 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1c601bad-e890-4c6f-86e9-480180593883 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:48.501069 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1c601bad-e890-4c6f-86e9-480180593883 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:48.531421 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-1c601bad-e890-4c6f-86e9-480180593883 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043648 Jul 11 11:32:48.532219 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 490/979] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:48 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:32:48.614300 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-be7d05b1-448b-4ef2-b3cc-31353ec26e80 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:48.614940 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-be7d05b1-448b-4ef2-b3cc-31353ec26e80 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:48.622030 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-be7d05b1-448b-4ef2-b3cc-31353ec26e80 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:48.622474 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-be7d05b1-448b-4ef2-b3cc-31353ec26e80 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:48.623226 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-be7d05b1-448b-4ef2-b3cc-31353ec26e80 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:48.623676 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-be7d05b1-448b-4ef2-b3cc-31353ec26e80 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:48.751408 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-be7d05b1-448b-4ef2-b3cc-31353ec26e80 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:48.759301 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-be7d05b1-448b-4ef2-b3cc-31353ec26e80 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.148860 Jul 11 11:32:48.759846 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 490/980] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:32:48 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:32:49.258046 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-d7e85bdd-7cd0-46e4-a3fd-cda0f031b679 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:49.258977 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-d7e85bdd-7cd0-46e4-a3fd-cda0f031b679 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:49.265893 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d7e85bdd-7cd0-46e4-a3fd-cda0f031b679 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:49.266332 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d7e85bdd-7cd0-46e4-a3fd-cda0f031b679 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:49.267080 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d7e85bdd-7cd0-46e4-a3fd-cda0f031b679 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:49.267537 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d7e85bdd-7cd0-46e4-a3fd-cda0f031b679 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:49.292880 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-5848e9d0-08ee-42b6-8994-3aa088ca16a9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:49.293585 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-5848e9d0-08ee-42b6-8994-3aa088ca16a9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:49.295762 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-d7e85bdd-7cd0-46e4-a3fd-cda0f031b679 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041624 Jul 11 11:32:49.296315 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 491/981] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:49 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:32:49.299640 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5848e9d0-08ee-42b6-8994-3aa088ca16a9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:49.300091 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5848e9d0-08ee-42b6-8994-3aa088ca16a9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:49.300856 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5848e9d0-08ee-42b6-8994-3aa088ca16a9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:49.301293 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5848e9d0-08ee-42b6-8994-3aa088ca16a9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:49.428995 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-5848e9d0-08ee-42b6-8994-3aa088ca16a9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:49.437166 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-5848e9d0-08ee-42b6-8994-3aa088ca16a9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:49.438646 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-5848e9d0-08ee-42b6-8994-3aa088ca16a9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:49.440081 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-5848e9d0-08ee-42b6-8994-3aa088ca16a9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.151136 Jul 11 11:32:49.440652 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 491/982] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:32:49 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 11:32:49.542785 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-b8c863e6-8212-4a39-a364-6107d781a3cd tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:49.543714 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-b8c863e6-8212-4a39-a364-6107d781a3cd tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:49.549574 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b8c863e6-8212-4a39-a364-6107d781a3cd tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:49.550010 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b8c863e6-8212-4a39-a364-6107d781a3cd tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:49.550761 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b8c863e6-8212-4a39-a364-6107d781a3cd tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:49.551190 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b8c863e6-8212-4a39-a364-6107d781a3cd tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:49.579351 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-b8c863e6-8212-4a39-a364-6107d781a3cd tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040479 Jul 11 11:32:49.579883 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 492/983] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:49 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:32:49.777702 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-dc20d350-2723-496e-9e83-b9cc67bad6cd tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:49.778341 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-dc20d350-2723-496e-9e83-b9cc67bad6cd tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:49.784896 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-dc20d350-2723-496e-9e83-b9cc67bad6cd tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:49.785351 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-dc20d350-2723-496e-9e83-b9cc67bad6cd tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:49.786122 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-dc20d350-2723-496e-9e83-b9cc67bad6cd tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:49.786562 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-dc20d350-2723-496e-9e83-b9cc67bad6cd tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:49.913463 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-dc20d350-2723-496e-9e83-b9cc67bad6cd tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:49.921632 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-dc20d350-2723-496e-9e83-b9cc67bad6cd tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.147740 Jul 11 11:32:49.922206 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 492/984] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:32:49 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:32:50.307145 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-6842fbc5-6bcf-4652-ac9d-37e37e711b47 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:50.308092 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-6842fbc5-6bcf-4652-ac9d-37e37e711b47 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:50.315529 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6842fbc5-6bcf-4652-ac9d-37e37e711b47 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:50.315981 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6842fbc5-6bcf-4652-ac9d-37e37e711b47 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:50.316768 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6842fbc5-6bcf-4652-ac9d-37e37e711b47 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:50.317258 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6842fbc5-6bcf-4652-ac9d-37e37e711b47 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:50.345671 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-6842fbc5-6bcf-4652-ac9d-37e37e711b47 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042450 Jul 11 11:32:50.346153 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 493/985] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:50 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:32:50.459053 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-2145057f-5e46-4322-95df-afa6d2c2e7ca tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:50.459703 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-2145057f-5e46-4322-95df-afa6d2c2e7ca tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:50.466268 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2145057f-5e46-4322-95df-afa6d2c2e7ca tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:50.466717 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2145057f-5e46-4322-95df-afa6d2c2e7ca tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:50.467539 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2145057f-5e46-4322-95df-afa6d2c2e7ca tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:50.467983 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2145057f-5e46-4322-95df-afa6d2c2e7ca tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:50.590500 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-8db2922b-599e-48e7-a84a-d4e5af38015c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:50.591517 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-8db2922b-599e-48e7-a84a-d4e5af38015c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:50.597360 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8db2922b-599e-48e7-a84a-d4e5af38015c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:50.597742 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8db2922b-599e-48e7-a84a-d4e5af38015c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:50.598500 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8db2922b-599e-48e7-a84a-d4e5af38015c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:50.598933 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8db2922b-599e-48e7-a84a-d4e5af38015c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:50.609082 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-2145057f-5e46-4322-95df-afa6d2c2e7ca tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:50.618173 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-2145057f-5e46-4322-95df-afa6d2c2e7ca tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:50.619715 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-2145057f-5e46-4322-95df-afa6d2c2e7ca tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:50.620875 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-2145057f-5e46-4322-95df-afa6d2c2e7ca tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.165823 Jul 11 11:32:50.621474 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 493/986] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:32:50 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:32:50.628465 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-8db2922b-599e-48e7-a84a-d4e5af38015c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042377 Jul 11 11:32:50.629015 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 494/987] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:50 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:32:50.937791 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-880a5b05-3003-47cf-8fa6-5f51d95d7fc3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:50.938407 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-880a5b05-3003-47cf-8fa6-5f51d95d7fc3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:50.945155 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-880a5b05-3003-47cf-8fa6-5f51d95d7fc3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:50.945607 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-880a5b05-3003-47cf-8fa6-5f51d95d7fc3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:50.946370 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-880a5b05-3003-47cf-8fa6-5f51d95d7fc3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:50.946813 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-880a5b05-3003-47cf-8fa6-5f51d95d7fc3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:51.074205 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-880a5b05-3003-47cf-8fa6-5f51d95d7fc3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:51.082596 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-880a5b05-3003-47cf-8fa6-5f51d95d7fc3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.148643 Jul 11 11:32:51.083162 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 494/988] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:32:50 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:32:51.357314 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-5ac4aefc-7b97-49f8-b5d8-4faae5f0b142 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:51.358222 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-5ac4aefc-7b97-49f8-b5d8-4faae5f0b142 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:51.364640 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5ac4aefc-7b97-49f8-b5d8-4faae5f0b142 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:51.365081 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5ac4aefc-7b97-49f8-b5d8-4faae5f0b142 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:51.365828 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5ac4aefc-7b97-49f8-b5d8-4faae5f0b142 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:51.366255 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5ac4aefc-7b97-49f8-b5d8-4faae5f0b142 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:51.394908 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-5ac4aefc-7b97-49f8-b5d8-4faae5f0b142 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041602 Jul 11 11:32:51.395469 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 495/989] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:51 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:32:51.638936 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-ddab3a5a-49c1-425b-b68c-21c9af522141 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:51.639507 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-ddab3a5a-49c1-425b-b68c-21c9af522141 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:51.639774 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-2d71239b-2c90-4a28-abc1-6c6b3021ad6b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:51.640687 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-2d71239b-2c90-4a28-abc1-6c6b3021ad6b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:51.645712 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ddab3a5a-49c1-425b-b68c-21c9af522141 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:51.646162 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ddab3a5a-49c1-425b-b68c-21c9af522141 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:51.646458 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2d71239b-2c90-4a28-abc1-6c6b3021ad6b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:51.646901 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2d71239b-2c90-4a28-abc1-6c6b3021ad6b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:51.647006 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ddab3a5a-49c1-425b-b68c-21c9af522141 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:51.647366 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ddab3a5a-49c1-425b-b68c-21c9af522141 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:51.647687 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2d71239b-2c90-4a28-abc1-6c6b3021ad6b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:51.648114 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2d71239b-2c90-4a28-abc1-6c6b3021ad6b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:51.676849 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-2d71239b-2c90-4a28-abc1-6c6b3021ad6b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040858 Jul 11 11:32:51.677404 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 496/990] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:51 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:32:51.775289 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-ddab3a5a-49c1-425b-b68c-21c9af522141 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:51.783656 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-ddab3a5a-49c1-425b-b68c-21c9af522141 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:51.785144 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-ddab3a5a-49c1-425b-b68c-21c9af522141 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:51.786280 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-ddab3a5a-49c1-425b-b68c-21c9af522141 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.151193 Jul 11 11:32:51.786838 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 495/991] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:32:51 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:32:52.099772 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-e6b41bfd-9241-46ba-bbf7-c62115770cdc tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:52.100388 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-e6b41bfd-9241-46ba-bbf7-c62115770cdc tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:52.107115 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e6b41bfd-9241-46ba-bbf7-c62115770cdc tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:52.107591 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e6b41bfd-9241-46ba-bbf7-c62115770cdc tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:52.108385 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e6b41bfd-9241-46ba-bbf7-c62115770cdc tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:52.108854 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e6b41bfd-9241-46ba-bbf7-c62115770cdc tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:52.112790 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=100 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:32:52.242911 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-e6b41bfd-9241-46ba-bbf7-c62115770cdc tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:52.250807 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-e6b41bfd-9241-46ba-bbf7-c62115770cdc tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.154852 Jul 11 11:32:52.251390 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 497/992] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:32:52 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:32:52.409944 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-ab17bb5b-412f-457b-b8c8-4622a8005268 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:52.410968 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-ab17bb5b-412f-457b-b8c8-4622a8005268 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:52.418060 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ab17bb5b-412f-457b-b8c8-4622a8005268 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:52.418504 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ab17bb5b-412f-457b-b8c8-4622a8005268 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:52.419276 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ab17bb5b-412f-457b-b8c8-4622a8005268 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:52.419716 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ab17bb5b-412f-457b-b8c8-4622a8005268 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:52.447799 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-ab17bb5b-412f-457b-b8c8-4622a8005268 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045598 Jul 11 11:32:52.448275 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 496/993] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:52 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:32:52.689178 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-d81f050a-9712-4b1e-96c2-20a7d489b47f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:52.690121 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-d81f050a-9712-4b1e-96c2-20a7d489b47f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:52.696107 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d81f050a-9712-4b1e-96c2-20a7d489b47f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:52.696555 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d81f050a-9712-4b1e-96c2-20a7d489b47f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:52.697311 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d81f050a-9712-4b1e-96c2-20a7d489b47f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:52.697742 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d81f050a-9712-4b1e-96c2-20a7d489b47f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:52.725848 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-d81f050a-9712-4b1e-96c2-20a7d489b47f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040859 Jul 11 11:32:52.726319 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 498/994] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:52 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:32:52.806316 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-e45fd86e-7672-4cfa-9e3e-50484a5de406 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:52.807297 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-e45fd86e-7672-4cfa-9e3e-50484a5de406 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:52.813877 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e45fd86e-7672-4cfa-9e3e-50484a5de406 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:52.814665 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e45fd86e-7672-4cfa-9e3e-50484a5de406 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:52.815502 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e45fd86e-7672-4cfa-9e3e-50484a5de406 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:52.816045 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e45fd86e-7672-4cfa-9e3e-50484a5de406 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:52.820290 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=100 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:32:52.953178 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-e45fd86e-7672-4cfa-9e3e-50484a5de406 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:52.963326 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-e45fd86e-7672-4cfa-9e3e-50484a5de406 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:52.964826 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-e45fd86e-7672-4cfa-9e3e-50484a5de406 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:52.965963 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-e45fd86e-7672-4cfa-9e3e-50484a5de406 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.165387 Jul 11 11:32:52.966526 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 497/995] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:32:52 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:32:53.268183 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-93268a1d-53fb-441e-95e0-904c07929723 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:53.268791 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-93268a1d-53fb-441e-95e0-904c07929723 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:53.275172 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-93268a1d-53fb-441e-95e0-904c07929723 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:53.275664 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-93268a1d-53fb-441e-95e0-904c07929723 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:53.276572 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-93268a1d-53fb-441e-95e0-904c07929723 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:53.277022 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-93268a1d-53fb-441e-95e0-904c07929723 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:53.404037 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-93268a1d-53fb-441e-95e0-904c07929723 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:53.411927 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-93268a1d-53fb-441e-95e0-904c07929723 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.147561 Jul 11 11:32:53.412485 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 499/996] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:32:53 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:32:53.460618 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-1294db20-aab2-4cb7-8040-732776dd7a44 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:53.461535 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-1294db20-aab2-4cb7-8040-732776dd7a44 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:53.468606 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1294db20-aab2-4cb7-8040-732776dd7a44 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:53.469048 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1294db20-aab2-4cb7-8040-732776dd7a44 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:53.469803 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1294db20-aab2-4cb7-8040-732776dd7a44 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:53.470380 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1294db20-aab2-4cb7-8040-732776dd7a44 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:53.499381 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-1294db20-aab2-4cb7-8040-732776dd7a44 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042653 Jul 11 11:32:53.499930 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 498/997] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:53 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:32:53.736594 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-2acce7db-1ce7-4382-afb0-53d3076db384 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:53.737519 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-2acce7db-1ce7-4382-afb0-53d3076db384 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:53.743471 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2acce7db-1ce7-4382-afb0-53d3076db384 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:53.743918 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2acce7db-1ce7-4382-afb0-53d3076db384 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:53.744668 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2acce7db-1ce7-4382-afb0-53d3076db384 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:53.745107 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2acce7db-1ce7-4382-afb0-53d3076db384 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:53.773016 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-2acce7db-1ce7-4382-afb0-53d3076db384 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040356 Jul 11 11:32:53.773561 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 500/998] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:53 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:32:53.984136 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-b3245468-f64f-4005-b91e-a76193acd2e6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:53.988293 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-b3245468-f64f-4005-b91e-a76193acd2e6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:53.990901 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b3245468-f64f-4005-b91e-a76193acd2e6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:53.991476 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b3245468-f64f-4005-b91e-a76193acd2e6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:53.992287 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b3245468-f64f-4005-b91e-a76193acd2e6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:53.992726 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b3245468-f64f-4005-b91e-a76193acd2e6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:54.120474 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-b3245468-f64f-4005-b91e-a76193acd2e6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:54.129346 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-b3245468-f64f-4005-b91e-a76193acd2e6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:54.132927 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-b3245468-f64f-4005-b91e-a76193acd2e6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:54.132927 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-b3245468-f64f-4005-b91e-a76193acd2e6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.151822 Jul 11 11:32:54.132927 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 499/999] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:32:53 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:32:54.429377 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-dbf86444-82e5-4ac2-9566-9f2ea58d6b67 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:54.429991 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-dbf86444-82e5-4ac2-9566-9f2ea58d6b67 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:54.436975 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-dbf86444-82e5-4ac2-9566-9f2ea58d6b67 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:54.437425 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-dbf86444-82e5-4ac2-9566-9f2ea58d6b67 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:54.438182 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-dbf86444-82e5-4ac2-9566-9f2ea58d6b67 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:54.438621 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-dbf86444-82e5-4ac2-9566-9f2ea58d6b67 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:54.510111 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-eba363ac-f2fe-4116-a20a-cf8f9c874f3b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:54.511121 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-eba363ac-f2fe-4116-a20a-cf8f9c874f3b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:54.517682 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-eba363ac-f2fe-4116-a20a-cf8f9c874f3b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:54.518179 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-eba363ac-f2fe-4116-a20a-cf8f9c874f3b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:54.518941 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-eba363ac-f2fe-4116-a20a-cf8f9c874f3b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:54.519401 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-eba363ac-f2fe-4116-a20a-cf8f9c874f3b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:54.548129 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-eba363ac-f2fe-4116-a20a-cf8f9c874f3b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041938 Jul 11 11:32:54.548686 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 500/1000] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:54 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:32:54.568909 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-dbf86444-82e5-4ac2-9566-9f2ea58d6b67 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:54.576750 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-dbf86444-82e5-4ac2-9566-9f2ea58d6b67 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.151281 Jul 11 11:32:54.577321 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 501/1001] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:32:54 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:32:54.784487 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-5bcc3e10-88cd-4f14-bb68-455e5f3e13b6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:54.785335 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-5bcc3e10-88cd-4f14-bb68-455e5f3e13b6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:54.791219 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5bcc3e10-88cd-4f14-bb68-455e5f3e13b6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:54.791702 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5bcc3e10-88cd-4f14-bb68-455e5f3e13b6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:54.792452 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5bcc3e10-88cd-4f14-bb68-455e5f3e13b6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:54.792883 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5bcc3e10-88cd-4f14-bb68-455e5f3e13b6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:54.821739 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-5bcc3e10-88cd-4f14-bb68-455e5f3e13b6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041310 Jul 11 11:32:54.822270 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 501/1002] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:54 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:32:55.150518 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-40ee443b-f171-4038-90c0-a716b00a38f1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:55.151128 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-40ee443b-f171-4038-90c0-a716b00a38f1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:55.157623 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-40ee443b-f171-4038-90c0-a716b00a38f1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:55.158072 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-40ee443b-f171-4038-90c0-a716b00a38f1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:55.158828 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-40ee443b-f171-4038-90c0-a716b00a38f1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:55.159275 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-40ee443b-f171-4038-90c0-a716b00a38f1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:55.283341 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-40ee443b-f171-4038-90c0-a716b00a38f1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:55.291628 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-40ee443b-f171-4038-90c0-a716b00a38f1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:55.293068 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-40ee443b-f171-4038-90c0-a716b00a38f1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:55.294215 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-40ee443b-f171-4038-90c0-a716b00a38f1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.147550 Jul 11 11:32:55.294772 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 502/1003] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:32:55 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:32:55.560580 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-b553244a-52ee-4c23-8bbe-165644a2d7d3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:55.561428 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-b553244a-52ee-4c23-8bbe-165644a2d7d3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:55.568346 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b553244a-52ee-4c23-8bbe-165644a2d7d3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:55.568800 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b553244a-52ee-4c23-8bbe-165644a2d7d3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:55.569598 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b553244a-52ee-4c23-8bbe-165644a2d7d3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:55.570039 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b553244a-52ee-4c23-8bbe-165644a2d7d3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:55.597927 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-28e87f50-9f78-4cbe-9afb-cca59165f7b6 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:55.598782 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-28e87f50-9f78-4cbe-9afb-cca59165f7b6 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:55.601296 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-b553244a-52ee-4c23-8bbe-165644a2d7d3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045343 Jul 11 11:32:55.602082 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 502/1004] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:55 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:32:55.605795 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-28e87f50-9f78-4cbe-9afb-cca59165f7b6 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:55.606238 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-28e87f50-9f78-4cbe-9afb-cca59165f7b6 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:55.607096 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-28e87f50-9f78-4cbe-9afb-cca59165f7b6 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:55.607578 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-28e87f50-9f78-4cbe-9afb-cca59165f7b6 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:55.739528 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-28e87f50-9f78-4cbe-9afb-cca59165f7b6 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:55.747237 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-28e87f50-9f78-4cbe-9afb-cca59165f7b6 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.157512 Jul 11 11:32:55.748379 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 503/1005] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:32:55 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:32:55.833315 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-abd78961-b9d4-4548-9df7-32dfb88cda09 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:55.834170 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-abd78961-b9d4-4548-9df7-32dfb88cda09 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:55.840124 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-abd78961-b9d4-4548-9df7-32dfb88cda09 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:55.840577 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-abd78961-b9d4-4548-9df7-32dfb88cda09 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:55.841372 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-abd78961-b9d4-4548-9df7-32dfb88cda09 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:55.841810 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-abd78961-b9d4-4548-9df7-32dfb88cda09 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:55.869487 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-abd78961-b9d4-4548-9df7-32dfb88cda09 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040213 Jul 11 11:32:55.870032 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 503/1006] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:55 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:32:56.312730 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-439959db-b24a-4753-82ab-25c1f417afa8 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:56.313337 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-439959db-b24a-4753-82ab-25c1f417afa8 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:56.319682 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-439959db-b24a-4753-82ab-25c1f417afa8 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:56.320134 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-439959db-b24a-4753-82ab-25c1f417afa8 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:56.320922 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-439959db-b24a-4753-82ab-25c1f417afa8 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:56.321360 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-439959db-b24a-4753-82ab-25c1f417afa8 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:56.458712 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-439959db-b24a-4753-82ab-25c1f417afa8 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:56.467502 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-439959db-b24a-4753-82ab-25c1f417afa8 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:56.468982 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-439959db-b24a-4753-82ab-25c1f417afa8 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:56.470112 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-439959db-b24a-4753-82ab-25c1f417afa8 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.161886 Jul 11 11:32:56.470658 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 504/1007] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:32:56 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:32:56.614327 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-dfe27120-8bd5-4eec-9b61-d0dfab6880a8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:56.615304 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-dfe27120-8bd5-4eec-9b61-d0dfab6880a8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:56.621758 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-dfe27120-8bd5-4eec-9b61-d0dfab6880a8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:56.622206 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-dfe27120-8bd5-4eec-9b61-d0dfab6880a8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:56.622962 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-dfe27120-8bd5-4eec-9b61-d0dfab6880a8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:56.623429 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-dfe27120-8bd5-4eec-9b61-d0dfab6880a8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:56.651930 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-dfe27120-8bd5-4eec-9b61-d0dfab6880a8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041601 Jul 11 11:32:56.652463 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 504/1008] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:56 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:32:56.765482 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-3041973f-c3f6-49d9-bc9c-ac8358ad2ee3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:56.766121 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-3041973f-c3f6-49d9-bc9c-ac8358ad2ee3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:56.772642 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3041973f-c3f6-49d9-bc9c-ac8358ad2ee3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:56.773091 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3041973f-c3f6-49d9-bc9c-ac8358ad2ee3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:56.773897 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3041973f-c3f6-49d9-bc9c-ac8358ad2ee3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:56.774334 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3041973f-c3f6-49d9-bc9c-ac8358ad2ee3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:56.881555 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-9b2ebbb4-cfd6-4908-994e-e02b204f9661 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:56.882516 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-9b2ebbb4-cfd6-4908-994e-e02b204f9661 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:56.889097 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9b2ebbb4-cfd6-4908-994e-e02b204f9661 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:56.889545 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9b2ebbb4-cfd6-4908-994e-e02b204f9661 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:56.890311 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9b2ebbb4-cfd6-4908-994e-e02b204f9661 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:56.890751 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9b2ebbb4-cfd6-4908-994e-e02b204f9661 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:56.900844 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-3041973f-c3f6-49d9-bc9c-ac8358ad2ee3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:56.909587 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-3041973f-c3f6-49d9-bc9c-ac8358ad2ee3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.148596 Jul 11 11:32:56.910231 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 505/1009] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:32:56 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:32:56.919930 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-9b2ebbb4-cfd6-4908-994e-e02b204f9661 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042244 Jul 11 11:32:56.920474 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 505/1010] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:56 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:32:57.488627 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-bf93c75d-0f17-43d2-b6b4-5ea6258074b5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:57.489259 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-bf93c75d-0f17-43d2-b6b4-5ea6258074b5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:57.495178 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bf93c75d-0f17-43d2-b6b4-5ea6258074b5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:57.495653 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bf93c75d-0f17-43d2-b6b4-5ea6258074b5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:57.496478 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bf93c75d-0f17-43d2-b6b4-5ea6258074b5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:57.496913 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bf93c75d-0f17-43d2-b6b4-5ea6258074b5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:57.624544 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-bf93c75d-0f17-43d2-b6b4-5ea6258074b5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:57.632801 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-bf93c75d-0f17-43d2-b6b4-5ea6258074b5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:57.634288 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-bf93c75d-0f17-43d2-b6b4-5ea6258074b5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:57.635475 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-bf93c75d-0f17-43d2-b6b4-5ea6258074b5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.150743 Jul 11 11:32:57.636013 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 506/1011] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:32:57 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:32:57.663830 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-e9f6c2c6-1bb2-490b-a5dc-b50e330a08af tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:57.664755 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-e9f6c2c6-1bb2-490b-a5dc-b50e330a08af tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:57.672009 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e9f6c2c6-1bb2-490b-a5dc-b50e330a08af tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:57.672461 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e9f6c2c6-1bb2-490b-a5dc-b50e330a08af tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:57.673221 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e9f6c2c6-1bb2-490b-a5dc-b50e330a08af tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:57.673656 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e9f6c2c6-1bb2-490b-a5dc-b50e330a08af tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:57.702242 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-e9f6c2c6-1bb2-490b-a5dc-b50e330a08af tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042342 Jul 11 11:32:57.702786 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 506/1012] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:57 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:32:57.926619 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-ddd8abf6-2037-4669-a2a6-e5a4f3e96703 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:57.927223 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-ddd8abf6-2037-4669-a2a6-e5a4f3e96703 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:57.933815 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-cb3da4ea-d44b-4ca2-a217-e5bf487a0862 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:57.934090 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ddd8abf6-2037-4669-a2a6-e5a4f3e96703 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:57.934870 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ddd8abf6-2037-4669-a2a6-e5a4f3e96703 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:57.935059 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-cb3da4ea-d44b-4ca2-a217-e5bf487a0862 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:57.936254 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ddd8abf6-2037-4669-a2a6-e5a4f3e96703 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:57.937014 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ddd8abf6-2037-4669-a2a6-e5a4f3e96703 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:57.941721 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cb3da4ea-d44b-4ca2-a217-e5bf487a0862 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:57.942248 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cb3da4ea-d44b-4ca2-a217-e5bf487a0862 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:57.942988 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cb3da4ea-d44b-4ca2-a217-e5bf487a0862 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:57.943451 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cb3da4ea-d44b-4ca2-a217-e5bf487a0862 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:57.978449 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-cb3da4ea-d44b-4ca2-a217-e5bf487a0862 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051068 Jul 11 11:32:57.979027 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 507/1013] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:57 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:32:58.077108 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-ddd8abf6-2037-4669-a2a6-e5a4f3e96703 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:58.084992 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-ddd8abf6-2037-4669-a2a6-e5a4f3e96703 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.162244 Jul 11 11:32:58.085542 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 507/1014] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:32:57 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:32:58.653754 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-c96246dd-f4f7-4126-bac0-6914a431ad6c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:58.654260 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-c96246dd-f4f7-4126-bac0-6914a431ad6c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:58.660219 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c96246dd-f4f7-4126-bac0-6914a431ad6c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:58.660665 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c96246dd-f4f7-4126-bac0-6914a431ad6c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:58.661410 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c96246dd-f4f7-4126-bac0-6914a431ad6c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:58.661871 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c96246dd-f4f7-4126-bac0-6914a431ad6c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:58.713882 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-c75a9364-186e-4d19-987a-f2962a6974f3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:58.714795 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-c75a9364-186e-4d19-987a-f2962a6974f3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:58.720769 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c75a9364-186e-4d19-987a-f2962a6974f3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:58.721211 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c75a9364-186e-4d19-987a-f2962a6974f3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:58.721963 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c75a9364-186e-4d19-987a-f2962a6974f3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:58.722388 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c75a9364-186e-4d19-987a-f2962a6974f3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:58.751073 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-c75a9364-186e-4d19-987a-f2962a6974f3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041094 Jul 11 11:32:58.751671 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 508/1015] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:58 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:32:58.790697 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-c96246dd-f4f7-4126-bac0-6914a431ad6c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:58.799070 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-c96246dd-f4f7-4126-bac0-6914a431ad6c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:58.800596 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-c96246dd-f4f7-4126-bac0-6914a431ad6c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:58.801739 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-c96246dd-f4f7-4126-bac0-6914a431ad6c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.151995 Jul 11 11:32:58.802293 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 508/1016] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:32:58 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:32:58.990686 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-76e1b4df-0f37-44e0-8e52-6ccbb04f9559 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:59.012157 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-76e1b4df-0f37-44e0-8e52-6ccbb04f9559 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:59.012157 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-76e1b4df-0f37-44e0-8e52-6ccbb04f9559 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:59.012157 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-76e1b4df-0f37-44e0-8e52-6ccbb04f9559 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:59.012157 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-76e1b4df-0f37-44e0-8e52-6ccbb04f9559 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:59.012538 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-76e1b4df-0f37-44e0-8e52-6ccbb04f9559 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:59.027786 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-76e1b4df-0f37-44e0-8e52-6ccbb04f9559 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041080 Jul 11 11:32:59.028338 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 509/1017] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:58 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:32:59.102461 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-cfc4ced5-bf9b-41d9-8efc-7680e247f74d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:59.103070 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-cfc4ced5-bf9b-41d9-8efc-7680e247f74d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:59.104971 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_api:SELECT=100 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:32:59.109622 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cfc4ced5-bf9b-41d9-8efc-7680e247f74d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:59.110070 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cfc4ced5-bf9b-41d9-8efc-7680e247f74d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:59.110831 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cfc4ced5-bf9b-41d9-8efc-7680e247f74d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:59.111273 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cfc4ced5-bf9b-41d9-8efc-7680e247f74d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:59.240158 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-cfc4ced5-bf9b-41d9-8efc-7680e247f74d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:59.248166 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-cfc4ced5-bf9b-41d9-8efc-7680e247f74d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.149489 Jul 11 11:32:59.248911 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 509/1018] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:32:59 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:32:59.761904 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-fa033451-a2ef-4138-b347-d1b9af62e632 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:59.762820 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-fa033451-a2ef-4138-b347-d1b9af62e632 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:59.768774 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fa033451-a2ef-4138-b347-d1b9af62e632 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:59.769214 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fa033451-a2ef-4138-b347-d1b9af62e632 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:59.769961 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fa033451-a2ef-4138-b347-d1b9af62e632 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:59.770386 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fa033451-a2ef-4138-b347-d1b9af62e632 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:59.799477 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-fa033451-a2ef-4138-b347-d1b9af62e632 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041451 Jul 11 11:32:59.800040 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 510/1019] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:32:59 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:32:59.820359 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-eae24e09-0887-4eac-b1ce-b795b0aff64c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:32:59.820970 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-eae24e09-0887-4eac-b1ce-b795b0aff64c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:32:59.827499 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-eae24e09-0887-4eac-b1ce-b795b0aff64c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:59.827950 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-eae24e09-0887-4eac-b1ce-b795b0aff64c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:59.828712 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-eae24e09-0887-4eac-b1ce-b795b0aff64c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:32:59.829143 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-eae24e09-0887-4eac-b1ce-b795b0aff64c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:32:59.958236 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-eae24e09-0887-4eac-b1ce-b795b0aff64c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:59.966545 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-eae24e09-0887-4eac-b1ce-b795b0aff64c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:59.968072 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-eae24e09-0887-4eac-b1ce-b795b0aff64c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:32:59.969219 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-eae24e09-0887-4eac-b1ce-b795b0aff64c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.152749 Jul 11 11:32:59.969777 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 510/1020] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:32:59 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:33:00.040617 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-87fae6c4-e38b-400f-af30-a09ff37eed8a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:00.041445 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-87fae6c4-e38b-400f-af30-a09ff37eed8a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:00.044811 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_api:SELECT=100 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:33:00.048248 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-87fae6c4-e38b-400f-af30-a09ff37eed8a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:00.048700 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-87fae6c4-e38b-400f-af30-a09ff37eed8a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:00.049455 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-87fae6c4-e38b-400f-af30-a09ff37eed8a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:00.049890 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-87fae6c4-e38b-400f-af30-a09ff37eed8a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:00.079510 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-87fae6c4-e38b-400f-af30-a09ff37eed8a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043473 Jul 11 11:33:00.080058 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 511/1021] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:00 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:33:00.265094 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-d20b30b1-78ad-4789-9b1b-f247940399b4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:00.265699 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-d20b30b1-78ad-4789-9b1b-f247940399b4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:00.271662 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d20b30b1-78ad-4789-9b1b-f247940399b4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:00.272108 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d20b30b1-78ad-4789-9b1b-f247940399b4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:00.272854 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d20b30b1-78ad-4789-9b1b-f247940399b4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:00.273282 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d20b30b1-78ad-4789-9b1b-f247940399b4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:00.404462 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-d20b30b1-78ad-4789-9b1b-f247940399b4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:00.413744 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-d20b30b1-78ad-4789-9b1b-f247940399b4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.152191 Jul 11 11:33:00.414794 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 511/1022] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:33:00 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:33:00.811769 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-39488d4e-28fc-47f3-8e79-d4376826c59e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:00.812691 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-39488d4e-28fc-47f3-8e79-d4376826c59e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:00.819010 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-39488d4e-28fc-47f3-8e79-d4376826c59e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:00.819495 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-39488d4e-28fc-47f3-8e79-d4376826c59e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:00.820248 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-39488d4e-28fc-47f3-8e79-d4376826c59e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:00.820681 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-39488d4e-28fc-47f3-8e79-d4376826c59e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:00.850249 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-39488d4e-28fc-47f3-8e79-d4376826c59e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043023 Jul 11 11:33:00.850793 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 512/1023] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:00 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:33:00.988006 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-00b5ac32-b89a-4148-9a08-cdd742c74028 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:00.996148 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-00b5ac32-b89a-4148-9a08-cdd742c74028 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:00.996148 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-00b5ac32-b89a-4148-9a08-cdd742c74028 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:00.996148 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-00b5ac32-b89a-4148-9a08-cdd742c74028 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:00.996460 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-00b5ac32-b89a-4148-9a08-cdd742c74028 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:00.996852 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-00b5ac32-b89a-4148-9a08-cdd742c74028 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:01.090724 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-4f000062-e55a-4464-80dc-088ec07a73bb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:01.091782 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-4f000062-e55a-4464-80dc-088ec07a73bb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:01.098453 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4f000062-e55a-4464-80dc-088ec07a73bb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:01.098907 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4f000062-e55a-4464-80dc-088ec07a73bb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:01.099744 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4f000062-e55a-4464-80dc-088ec07a73bb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:01.100184 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4f000062-e55a-4464-80dc-088ec07a73bb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:01.123822 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-00b5ac32-b89a-4148-9a08-cdd742c74028 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:01.125608 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=100 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:33:01.130153 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-4f000062-e55a-4464-80dc-088ec07a73bb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043371 Jul 11 11:33:01.130725 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 513/1024] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:01 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:33:01.132092 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-00b5ac32-b89a-4148-9a08-cdd742c74028 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:01.133607 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-00b5ac32-b89a-4148-9a08-cdd742c74028 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:01.134806 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-00b5ac32-b89a-4148-9a08-cdd742c74028 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.150763 Jul 11 11:33:01.135358 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 512/1025] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:33:00 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:33:01.431427 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-2ba75c86-8f8e-45a0-b14f-c34f7948c842 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:01.432060 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-2ba75c86-8f8e-45a0-b14f-c34f7948c842 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:01.439094 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2ba75c86-8f8e-45a0-b14f-c34f7948c842 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:01.439827 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2ba75c86-8f8e-45a0-b14f-c34f7948c842 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:01.440586 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2ba75c86-8f8e-45a0-b14f-c34f7948c842 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:01.441023 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2ba75c86-8f8e-45a0-b14f-c34f7948c842 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:01.564551 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-2ba75c86-8f8e-45a0-b14f-c34f7948c842 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:01.572348 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-2ba75c86-8f8e-45a0-b14f-c34f7948c842 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.144744 Jul 11 11:33:01.572914 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 514/1026] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:33:01 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:33:01.862453 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-66b19411-dfbc-4d51-83b1-b66d255580bf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:01.864369 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-66b19411-dfbc-4d51-83b1-b66d255580bf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:01.870396 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-66b19411-dfbc-4d51-83b1-b66d255580bf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:01.870837 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-66b19411-dfbc-4d51-83b1-b66d255580bf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:01.871611 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-66b19411-dfbc-4d51-83b1-b66d255580bf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:01.872043 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-66b19411-dfbc-4d51-83b1-b66d255580bf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:01.895568 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=100 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:33:01.900132 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-66b19411-dfbc-4d51-83b1-b66d255580bf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041667 Jul 11 11:33:01.900686 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 513/1027] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:01 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:33:02.142395 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-6214b832-d640-480c-a4bc-34c8508a4848 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:02.143241 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-6214b832-d640-480c-a4bc-34c8508a4848 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:02.149785 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6214b832-d640-480c-a4bc-34c8508a4848 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:02.150227 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6214b832-d640-480c-a4bc-34c8508a4848 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:02.150980 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6214b832-d640-480c-a4bc-34c8508a4848 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:02.151441 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6214b832-d640-480c-a4bc-34c8508a4848 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:02.156897 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-5c1c7440-62b2-4da0-8e76-ffd0a9143fe1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:02.157513 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-5c1c7440-62b2-4da0-8e76-ffd0a9143fe1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:02.163975 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5c1c7440-62b2-4da0-8e76-ffd0a9143fe1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:02.164423 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5c1c7440-62b2-4da0-8e76-ffd0a9143fe1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:02.165187 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5c1c7440-62b2-4da0-8e76-ffd0a9143fe1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:02.165660 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5c1c7440-62b2-4da0-8e76-ffd0a9143fe1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:02.180786 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-6214b832-d640-480c-a4bc-34c8508a4848 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043054 Jul 11 11:33:02.181340 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 515/1028] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:02 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:33:02.300578 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-5c1c7440-62b2-4da0-8e76-ffd0a9143fe1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:02.308932 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-5c1c7440-62b2-4da0-8e76-ffd0a9143fe1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:02.311020 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-5c1c7440-62b2-4da0-8e76-ffd0a9143fe1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:02.312202 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-5c1c7440-62b2-4da0-8e76-ffd0a9143fe1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.160288 Jul 11 11:33:02.312771 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 514/1029] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:33:02 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 11:33:02.589023 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-521f2d84-92a6-4196-8af0-ac6da3e52c79 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:02.589651 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-521f2d84-92a6-4196-8af0-ac6da3e52c79 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:02.595628 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-521f2d84-92a6-4196-8af0-ac6da3e52c79 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:02.596070 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-521f2d84-92a6-4196-8af0-ac6da3e52c79 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:02.596817 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-521f2d84-92a6-4196-8af0-ac6da3e52c79 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:02.597246 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-521f2d84-92a6-4196-8af0-ac6da3e52c79 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:02.725986 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-521f2d84-92a6-4196-8af0-ac6da3e52c79 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:02.734192 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-521f2d84-92a6-4196-8af0-ac6da3e52c79 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.148952 Jul 11 11:33:02.734752 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 516/1030] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:33:02 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:33:02.912560 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-e37c42a4-7916-466c-a253-4a317760dbda tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:02.913489 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-e37c42a4-7916-466c-a253-4a317760dbda tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:02.921427 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e37c42a4-7916-466c-a253-4a317760dbda tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:02.921881 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e37c42a4-7916-466c-a253-4a317760dbda tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:02.922649 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e37c42a4-7916-466c-a253-4a317760dbda tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:02.923081 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e37c42a4-7916-466c-a253-4a317760dbda tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:02.956543 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-e37c42a4-7916-466c-a253-4a317760dbda tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047824 Jul 11 11:33:02.957020 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 515/1031] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:02 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:33:03.192727 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-df01206a-6238-4824-a423-54f5efce5399 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:03.193640 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-df01206a-6238-4824-a423-54f5efce5399 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:03.200060 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-df01206a-6238-4824-a423-54f5efce5399 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:03.200512 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-df01206a-6238-4824-a423-54f5efce5399 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:03.201330 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-df01206a-6238-4824-a423-54f5efce5399 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:03.201760 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-df01206a-6238-4824-a423-54f5efce5399 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:03.230637 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-df01206a-6238-4824-a423-54f5efce5399 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042022 Jul 11 11:33:03.231102 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 517/1032] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:03 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:33:03.331936 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-01f452c7-51a3-4f3f-af9b-2e3d11d360f5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:03.333054 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-01f452c7-51a3-4f3f-af9b-2e3d11d360f5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:03.340194 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-01f452c7-51a3-4f3f-af9b-2e3d11d360f5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:03.340644 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-01f452c7-51a3-4f3f-af9b-2e3d11d360f5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:03.341926 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-01f452c7-51a3-4f3f-af9b-2e3d11d360f5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:03.342359 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-01f452c7-51a3-4f3f-af9b-2e3d11d360f5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:03.478994 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-01f452c7-51a3-4f3f-af9b-2e3d11d360f5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:03.488058 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-01f452c7-51a3-4f3f-af9b-2e3d11d360f5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:03.489782 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-01f452c7-51a3-4f3f-af9b-2e3d11d360f5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:03.491135 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-01f452c7-51a3-4f3f-af9b-2e3d11d360f5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.165137 Jul 11 11:33:03.491792 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 516/1033] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:33:03 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:33:03.751176 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-231c514b-50b4-4e6a-bcb9-ce818ba7ce38 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:03.751722 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-231c514b-50b4-4e6a-bcb9-ce818ba7ce38 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:03.757720 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-231c514b-50b4-4e6a-bcb9-ce818ba7ce38 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:03.758173 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-231c514b-50b4-4e6a-bcb9-ce818ba7ce38 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:03.758931 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-231c514b-50b4-4e6a-bcb9-ce818ba7ce38 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:03.759392 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-231c514b-50b4-4e6a-bcb9-ce818ba7ce38 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:03.884460 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-231c514b-50b4-4e6a-bcb9-ce818ba7ce38 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:03.892895 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-231c514b-50b4-4e6a-bcb9-ce818ba7ce38 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.145676 Jul 11 11:33:03.893459 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 518/1034] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:33:03 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:33:03.968032 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-aa5d791e-0182-488b-a15e-4aaaba330482 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:03.968960 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-aa5d791e-0182-488b-a15e-4aaaba330482 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:03.974876 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-aa5d791e-0182-488b-a15e-4aaaba330482 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:03.975366 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-aa5d791e-0182-488b-a15e-4aaaba330482 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:03.976125 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-aa5d791e-0182-488b-a15e-4aaaba330482 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:03.976558 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-aa5d791e-0182-488b-a15e-4aaaba330482 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:04.004876 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-aa5d791e-0182-488b-a15e-4aaaba330482 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040740 Jul 11 11:33:04.005361 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 517/1035] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:03 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:33:04.241930 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-2f8a35d5-6967-49aa-ad92-503f07beeff5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:04.242865 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-2f8a35d5-6967-49aa-ad92-503f07beeff5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:04.249939 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2f8a35d5-6967-49aa-ad92-503f07beeff5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:04.250385 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2f8a35d5-6967-49aa-ad92-503f07beeff5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:04.251143 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2f8a35d5-6967-49aa-ad92-503f07beeff5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:04.251602 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2f8a35d5-6967-49aa-ad92-503f07beeff5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:04.279119 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-2f8a35d5-6967-49aa-ad92-503f07beeff5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041068 Jul 11 11:33:04.279625 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 519/1036] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:04 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:33:04.509822 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-993c81f6-ca7b-4758-a31e-bc2b974fa1ea tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:04.510426 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-993c81f6-ca7b-4758-a31e-bc2b974fa1ea tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:04.517117 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-993c81f6-ca7b-4758-a31e-bc2b974fa1ea tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:04.517348 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-993c81f6-ca7b-4758-a31e-bc2b974fa1ea tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:04.518100 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-993c81f6-ca7b-4758-a31e-bc2b974fa1ea tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:04.518533 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-993c81f6-ca7b-4758-a31e-bc2b974fa1ea tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:04.882102 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-993c81f6-ca7b-4758-a31e-bc2b974fa1ea tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:04.882102 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-993c81f6-ca7b-4758-a31e-bc2b974fa1ea tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:04.882396 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-993c81f6-ca7b-4758-a31e-bc2b974fa1ea tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:04.882396 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-993c81f6-ca7b-4758-a31e-bc2b974fa1ea tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.361003 Jul 11 11:33:04.882396 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 518/1037] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:33:04 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:33:04.909332 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-24b2837a-08a9-4435-b3b3-7db6d5a96627 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:04.909942 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-24b2837a-08a9-4435-b3b3-7db6d5a96627 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:04.915991 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-24b2837a-08a9-4435-b3b3-7db6d5a96627 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:04.916442 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-24b2837a-08a9-4435-b3b3-7db6d5a96627 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:04.917194 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-24b2837a-08a9-4435-b3b3-7db6d5a96627 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:04.917628 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-24b2837a-08a9-4435-b3b3-7db6d5a96627 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:05.016364 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-f819875a-0288-421f-a1ca-4afea18ecb4a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:05.017292 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-f819875a-0288-421f-a1ca-4afea18ecb4a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:05.023296 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f819875a-0288-421f-a1ca-4afea18ecb4a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:05.023747 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f819875a-0288-421f-a1ca-4afea18ecb4a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:05.024513 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f819875a-0288-421f-a1ca-4afea18ecb4a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:05.024949 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f819875a-0288-421f-a1ca-4afea18ecb4a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:05.047204 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-24b2837a-08a9-4435-b3b3-7db6d5a96627 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:05.054070 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-f819875a-0288-421f-a1ca-4afea18ecb4a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042139 Jul 11 11:33:05.054964 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 519/1038] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:05 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:33:05.055131 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-24b2837a-08a9-4435-b3b3-7db6d5a96627 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.149501 Jul 11 11:33:05.055869 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 520/1039] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:33:04 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:33:05.290560 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-cebb2c62-7ddc-418d-baa6-f28184359ff5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:05.291507 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-cebb2c62-7ddc-418d-baa6-f28184359ff5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:05.297418 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cebb2c62-7ddc-418d-baa6-f28184359ff5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:05.297870 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cebb2c62-7ddc-418d-baa6-f28184359ff5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:05.298627 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cebb2c62-7ddc-418d-baa6-f28184359ff5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:05.299062 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cebb2c62-7ddc-418d-baa6-f28184359ff5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:05.328013 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-cebb2c62-7ddc-418d-baa6-f28184359ff5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041395 Jul 11 11:33:05.328554 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 520/1040] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:05 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:33:05.897810 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-579fd9b7-ddfa-4c4d-b3b8-e0a95bbadf8d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:05.898413 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-579fd9b7-ddfa-4c4d-b3b8-e0a95bbadf8d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:05.904845 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-579fd9b7-ddfa-4c4d-b3b8-e0a95bbadf8d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:05.905285 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-579fd9b7-ddfa-4c4d-b3b8-e0a95bbadf8d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:05.906033 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-579fd9b7-ddfa-4c4d-b3b8-e0a95bbadf8d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:05.906459 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-579fd9b7-ddfa-4c4d-b3b8-e0a95bbadf8d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:06.032578 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-579fd9b7-ddfa-4c4d-b3b8-e0a95bbadf8d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:06.041076 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-579fd9b7-ddfa-4c4d-b3b8-e0a95bbadf8d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:06.042556 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-579fd9b7-ddfa-4c4d-b3b8-e0a95bbadf8d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:06.043729 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-579fd9b7-ddfa-4c4d-b3b8-e0a95bbadf8d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.149805 Jul 11 11:33:06.044280 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 521/1041] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:33:05 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 11:33:06.066417 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-127e631e-4f9f-4587-84f0-cc152ffe2c85 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:06.067449 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-127e631e-4f9f-4587-84f0-cc152ffe2c85 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:06.071517 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-729c19d8-79d3-4009-9da7-f3e5a912253b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:06.072545 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-729c19d8-79d3-4009-9da7-f3e5a912253b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:06.075731 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-127e631e-4f9f-4587-84f0-cc152ffe2c85 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:06.076188 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-127e631e-4f9f-4587-84f0-cc152ffe2c85 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:06.077119 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-127e631e-4f9f-4587-84f0-cc152ffe2c85 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:06.077562 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-127e631e-4f9f-4587-84f0-cc152ffe2c85 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:06.078112 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-729c19d8-79d3-4009-9da7-f3e5a912253b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:06.078559 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-729c19d8-79d3-4009-9da7-f3e5a912253b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:06.079335 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-729c19d8-79d3-4009-9da7-f3e5a912253b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:06.079773 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-729c19d8-79d3-4009-9da7-f3e5a912253b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:06.108334 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-127e631e-4f9f-4587-84f0-cc152ffe2c85 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046083 Jul 11 11:33:06.108900 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 521/1042] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:06 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:33:06.206950 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-729c19d8-79d3-4009-9da7-f3e5a912253b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:06.214843 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-729c19d8-79d3-4009-9da7-f3e5a912253b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.147020 Jul 11 11:33:06.221424 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 522/1043] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:33:06 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:33:06.339435 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-ae0b9a35-62a1-4659-829c-ea79784904ec tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:06.340358 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-ae0b9a35-62a1-4659-829c-ea79784904ec tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:06.346808 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ae0b9a35-62a1-4659-829c-ea79784904ec tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:06.347286 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ae0b9a35-62a1-4659-829c-ea79784904ec tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:06.348050 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ae0b9a35-62a1-4659-829c-ea79784904ec tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:06.348518 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ae0b9a35-62a1-4659-829c-ea79784904ec tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:06.377662 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-ae0b9a35-62a1-4659-829c-ea79784904ec tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042165 Jul 11 11:33:06.378206 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 522/1044] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:06 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:33:07.062445 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-9e7564d7-d632-4f7c-9d8d-f629d0da795e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:07.063046 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-9e7564d7-d632-4f7c-9d8d-f629d0da795e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:07.069891 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9e7564d7-d632-4f7c-9d8d-f629d0da795e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:07.070338 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9e7564d7-d632-4f7c-9d8d-f629d0da795e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:07.071097 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9e7564d7-d632-4f7c-9d8d-f629d0da795e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:07.071559 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9e7564d7-d632-4f7c-9d8d-f629d0da795e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:07.119859 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-0259560e-f5e8-4021-9990-417904cd272e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:07.120774 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-0259560e-f5e8-4021-9990-417904cd272e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:07.127599 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0259560e-f5e8-4021-9990-417904cd272e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:07.128044 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0259560e-f5e8-4021-9990-417904cd272e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:07.128796 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0259560e-f5e8-4021-9990-417904cd272e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:07.129227 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0259560e-f5e8-4021-9990-417904cd272e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:07.158099 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-0259560e-f5e8-4021-9990-417904cd272e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042100 Jul 11 11:33:07.158663 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 523/1045] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:07 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:33:07.198463 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-9e7564d7-d632-4f7c-9d8d-f629d0da795e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:07.206774 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-9e7564d7-d632-4f7c-9d8d-f629d0da795e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:07.208363 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-9e7564d7-d632-4f7c-9d8d-f629d0da795e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:07.209503 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-9e7564d7-d632-4f7c-9d8d-f629d0da795e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.151460 Jul 11 11:33:07.210058 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 523/1046] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:33:07 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:33:07.232277 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-38c80666-0434-4a55-973f-b9823ee08ad4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:07.232910 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-38c80666-0434-4a55-973f-b9823ee08ad4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:07.239518 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-38c80666-0434-4a55-973f-b9823ee08ad4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:07.239961 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-38c80666-0434-4a55-973f-b9823ee08ad4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:07.240711 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-38c80666-0434-4a55-973f-b9823ee08ad4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:07.241145 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-38c80666-0434-4a55-973f-b9823ee08ad4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:07.365011 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-38c80666-0434-4a55-973f-b9823ee08ad4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:07.372859 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-38c80666-0434-4a55-973f-b9823ee08ad4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.144612 Jul 11 11:33:07.373419 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 524/1047] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:33:07 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:33:07.389161 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-3c0ddf00-0997-4b2c-8106-9ee5fcad85b8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:07.390079 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-3c0ddf00-0997-4b2c-8106-9ee5fcad85b8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:07.396037 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3c0ddf00-0997-4b2c-8106-9ee5fcad85b8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:07.396483 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3c0ddf00-0997-4b2c-8106-9ee5fcad85b8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:07.397240 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3c0ddf00-0997-4b2c-8106-9ee5fcad85b8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:07.397674 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3c0ddf00-0997-4b2c-8106-9ee5fcad85b8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:07.425867 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-3c0ddf00-0997-4b2c-8106-9ee5fcad85b8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040661 Jul 11 11:33:07.426398 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 524/1048] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:07 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:33:08.169943 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-19562abe-4fbe-4a46-94e7-11a372410459 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:08.170874 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-19562abe-4fbe-4a46-94e7-11a372410459 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:08.177356 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-19562abe-4fbe-4a46-94e7-11a372410459 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:08.177799 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-19562abe-4fbe-4a46-94e7-11a372410459 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:08.178554 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-19562abe-4fbe-4a46-94e7-11a372410459 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:08.178985 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-19562abe-4fbe-4a46-94e7-11a372410459 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:08.207916 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-19562abe-4fbe-4a46-94e7-11a372410459 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042246 Jul 11 11:33:08.208471 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 525/1049] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:08 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:33:08.227403 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-1309c038-d669-484c-848b-f9838893e8c0 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:08.228012 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-1309c038-d669-484c-848b-f9838893e8c0 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:08.234637 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1309c038-d669-484c-848b-f9838893e8c0 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:08.235075 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1309c038-d669-484c-848b-f9838893e8c0 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:08.235887 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1309c038-d669-484c-848b-f9838893e8c0 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:08.236318 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1309c038-d669-484c-848b-f9838893e8c0 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:08.367791 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-1309c038-d669-484c-848b-f9838893e8c0 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:08.378713 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-1309c038-d669-484c-848b-f9838893e8c0 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:08.380244 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-1309c038-d669-484c-848b-f9838893e8c0 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:08.381389 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-1309c038-d669-484c-848b-f9838893e8c0 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.157837 Jul 11 11:33:08.381946 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 525/1050] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:33:08 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:33:08.389792 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-07c39b17-284b-4f00-8bf7-13e30fba5c6c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:08.390430 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-07c39b17-284b-4f00-8bf7-13e30fba5c6c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:08.397082 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-07c39b17-284b-4f00-8bf7-13e30fba5c6c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:08.397525 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-07c39b17-284b-4f00-8bf7-13e30fba5c6c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:08.398282 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-07c39b17-284b-4f00-8bf7-13e30fba5c6c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:08.398718 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-07c39b17-284b-4f00-8bf7-13e30fba5c6c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:08.437138 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-e5f7fd48-d9b6-436e-a971-22d2922c120a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:08.440717 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-e5f7fd48-d9b6-436e-a971-22d2922c120a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:08.448270 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e5f7fd48-d9b6-436e-a971-22d2922c120a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:08.448717 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e5f7fd48-d9b6-436e-a971-22d2922c120a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:08.449482 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e5f7fd48-d9b6-436e-a971-22d2922c120a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:08.449910 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e5f7fd48-d9b6-436e-a971-22d2922c120a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:08.479199 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-e5f7fd48-d9b6-436e-a971-22d2922c120a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045889 Jul 11 11:33:08.479673 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 526/1051] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:08 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:33:08.531119 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-07c39b17-284b-4f00-8bf7-13e30fba5c6c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:08.539113 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-07c39b17-284b-4f00-8bf7-13e30fba5c6c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.153199 Jul 11 11:33:08.539712 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 526/1052] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:33:08 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:33:09.219924 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-a62962c5-a83a-45c7-a37e-392f303b5bdd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:09.220842 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-a62962c5-a83a-45c7-a37e-392f303b5bdd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:09.226837 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a62962c5-a83a-45c7-a37e-392f303b5bdd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:09.227311 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a62962c5-a83a-45c7-a37e-392f303b5bdd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:09.228063 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a62962c5-a83a-45c7-a37e-392f303b5bdd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:09.228580 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a62962c5-a83a-45c7-a37e-392f303b5bdd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:09.268724 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-a62962c5-a83a-45c7-a37e-392f303b5bdd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053222 Jul 11 11:33:09.269296 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 527/1053] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:09 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:33:09.400073 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-85addad0-cb7b-40d0-a56f-e89fefb39132 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:09.400653 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-85addad0-cb7b-40d0-a56f-e89fefb39132 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:09.407506 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-85addad0-cb7b-40d0-a56f-e89fefb39132 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:09.407953 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-85addad0-cb7b-40d0-a56f-e89fefb39132 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:09.408746 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-85addad0-cb7b-40d0-a56f-e89fefb39132 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:09.409184 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-85addad0-cb7b-40d0-a56f-e89fefb39132 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:09.490639 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-cb98f94c-0858-40dc-8153-e2bd92b2d447 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:09.491669 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-cb98f94c-0858-40dc-8153-e2bd92b2d447 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:09.497669 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-cb98f94c-0858-40dc-8153-e2bd92b2d447 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:09.498111 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-cb98f94c-0858-40dc-8153-e2bd92b2d447 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:09.498900 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-cb98f94c-0858-40dc-8153-e2bd92b2d447 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:09.499356 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-cb98f94c-0858-40dc-8153-e2bd92b2d447 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:09.528466 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-cb98f94c-0858-40dc-8153-e2bd92b2d447 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042315 Jul 11 11:33:09.532855 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 528/1054] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:09 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:33:09.534451 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-85addad0-cb7b-40d0-a56f-e89fefb39132 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:09.543000 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-85addad0-cb7b-40d0-a56f-e89fefb39132 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:09.544526 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-85addad0-cb7b-40d0-a56f-e89fefb39132 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:09.545670 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-85addad0-cb7b-40d0-a56f-e89fefb39132 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.149628 Jul 11 11:33:09.546229 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 527/1055] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:33:09 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:33:09.555306 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-63bd3da6-9518-4159-b03f-069a9d1ce2fe tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:09.556038 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-63bd3da6-9518-4159-b03f-069a9d1ce2fe tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:09.562107 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-63bd3da6-9518-4159-b03f-069a9d1ce2fe tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:09.566341 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-63bd3da6-9518-4159-b03f-069a9d1ce2fe tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:09.566341 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-63bd3da6-9518-4159-b03f-069a9d1ce2fe tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:09.566341 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-63bd3da6-9518-4159-b03f-069a9d1ce2fe tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:09.692685 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-63bd3da6-9518-4159-b03f-069a9d1ce2fe tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:09.700516 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-63bd3da6-9518-4159-b03f-069a9d1ce2fe tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.148994 Jul 11 11:33:09.701074 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 529/1056] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:33:09 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:33:10.282054 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-0031dead-0da2-4cbd-916e-0f50888f7ded tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:10.282967 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-0031dead-0da2-4cbd-916e-0f50888f7ded tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:10.288952 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0031dead-0da2-4cbd-916e-0f50888f7ded tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:10.289393 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0031dead-0da2-4cbd-916e-0f50888f7ded tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:10.290141 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0031dead-0da2-4cbd-916e-0f50888f7ded tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:10.290569 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0031dead-0da2-4cbd-916e-0f50888f7ded tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:10.319348 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-0031dead-0da2-4cbd-916e-0f50888f7ded tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041240 Jul 11 11:33:10.319880 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 528/1057] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:10 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:33:10.540723 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-aa6dff3f-0662-4303-b2f4-16435d8823a5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:10.541643 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-aa6dff3f-0662-4303-b2f4-16435d8823a5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:10.548777 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-aa6dff3f-0662-4303-b2f4-16435d8823a5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:10.549229 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-aa6dff3f-0662-4303-b2f4-16435d8823a5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:10.549989 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-aa6dff3f-0662-4303-b2f4-16435d8823a5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:10.550425 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-aa6dff3f-0662-4303-b2f4-16435d8823a5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:10.563602 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-b752e682-abfa-4727-a908-47e1d00857a2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:10.564289 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-b752e682-abfa-4727-a908-47e1d00857a2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:10.567205 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=100 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:33:10.571483 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b752e682-abfa-4727-a908-47e1d00857a2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:10.571939 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b752e682-abfa-4727-a908-47e1d00857a2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:10.572709 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b752e682-abfa-4727-a908-47e1d00857a2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:10.573147 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b752e682-abfa-4727-a908-47e1d00857a2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:10.579849 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-aa6dff3f-0662-4303-b2f4-16435d8823a5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043053 Jul 11 11:33:10.583910 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 530/1058] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:10 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:33:10.699098 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-b752e682-abfa-4727-a908-47e1d00857a2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:10.707411 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-b752e682-abfa-4727-a908-47e1d00857a2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:10.708916 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-b752e682-abfa-4727-a908-47e1d00857a2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:10.710055 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-b752e682-abfa-4727-a908-47e1d00857a2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.150314 Jul 11 11:33:10.710610 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 529/1059] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:33:10 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 11:33:10.717573 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-8d4f567a-6145-4d55-bf03-cc3ee3e46255 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:10.718216 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-8d4f567a-6145-4d55-bf03-cc3ee3e46255 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:10.725204 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8d4f567a-6145-4d55-bf03-cc3ee3e46255 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:10.725650 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8d4f567a-6145-4d55-bf03-cc3ee3e46255 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:10.726408 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8d4f567a-6145-4d55-bf03-cc3ee3e46255 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:10.726839 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8d4f567a-6145-4d55-bf03-cc3ee3e46255 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:10.852343 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-8d4f567a-6145-4d55-bf03-cc3ee3e46255 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:10.860771 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-8d4f567a-6145-4d55-bf03-cc3ee3e46255 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.146940 Jul 11 11:33:10.861342 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 531/1060] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:33:10 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:33:11.331448 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-7ebefef1-cb91-4e98-99f0-33ba0518f512 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:11.332294 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-7ebefef1-cb91-4e98-99f0-33ba0518f512 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:11.338345 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7ebefef1-cb91-4e98-99f0-33ba0518f512 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:11.338787 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7ebefef1-cb91-4e98-99f0-33ba0518f512 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:11.339579 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7ebefef1-cb91-4e98-99f0-33ba0518f512 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:11.339998 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7ebefef1-cb91-4e98-99f0-33ba0518f512 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:11.356275 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=100 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:33:11.368162 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-7ebefef1-cb91-4e98-99f0-33ba0518f512 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041417 Jul 11 11:33:11.370095 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 530/1061] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:11 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:33:11.593617 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-c576882b-0fd6-4037-8c07-c86884ca1f29 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:11.594467 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-c576882b-0fd6-4037-8c07-c86884ca1f29 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:11.601034 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c576882b-0fd6-4037-8c07-c86884ca1f29 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:11.601494 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c576882b-0fd6-4037-8c07-c86884ca1f29 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:11.602251 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c576882b-0fd6-4037-8c07-c86884ca1f29 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:11.602688 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c576882b-0fd6-4037-8c07-c86884ca1f29 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:11.631029 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-c576882b-0fd6-4037-8c07-c86884ca1f29 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041451 Jul 11 11:33:11.631606 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 532/1062] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:11 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:33:11.729187 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-800f2c1f-b825-4fe7-9b71-d4ab46084d01 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:11.729800 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-800f2c1f-b825-4fe7-9b71-d4ab46084d01 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:11.737575 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-800f2c1f-b825-4fe7-9b71-d4ab46084d01 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:11.738023 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-800f2c1f-b825-4fe7-9b71-d4ab46084d01 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:11.738778 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-800f2c1f-b825-4fe7-9b71-d4ab46084d01 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:11.739211 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-800f2c1f-b825-4fe7-9b71-d4ab46084d01 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:11.867661 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-800f2c1f-b825-4fe7-9b71-d4ab46084d01 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:11.876607 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-800f2c1f-b825-4fe7-9b71-d4ab46084d01 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:11.878069 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-d04221f0-d01a-455f-8866-e0d45ed8181e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:11.878232 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-800f2c1f-b825-4fe7-9b71-d4ab46084d01 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:11.879221 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-800f2c1f-b825-4fe7-9b71-d4ab46084d01 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.154250 Jul 11 11:33:11.880031 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 531/1063] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:33:11 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:33:11.880151 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-d04221f0-d01a-455f-8866-e0d45ed8181e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:11.886151 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d04221f0-d01a-455f-8866-e0d45ed8181e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:11.886657 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d04221f0-d01a-455f-8866-e0d45ed8181e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:11.887876 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d04221f0-d01a-455f-8866-e0d45ed8181e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:11.887876 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d04221f0-d01a-455f-8866-e0d45ed8181e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:12.022792 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-d04221f0-d01a-455f-8866-e0d45ed8181e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:12.027429 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-d04221f0-d01a-455f-8866-e0d45ed8181e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.153741 Jul 11 11:33:12.027990 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 533/1064] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:33:11 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:33:12.379735 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-5c3317ae-0bcc-47e0-911c-cc5ed8141feb tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:12.380656 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-5c3317ae-0bcc-47e0-911c-cc5ed8141feb tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:12.386659 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5c3317ae-0bcc-47e0-911c-cc5ed8141feb tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:12.387106 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5c3317ae-0bcc-47e0-911c-cc5ed8141feb tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:12.387904 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5c3317ae-0bcc-47e0-911c-cc5ed8141feb tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:12.388340 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5c3317ae-0bcc-47e0-911c-cc5ed8141feb tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:12.417030 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-5c3317ae-0bcc-47e0-911c-cc5ed8141feb tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041322 Jul 11 11:33:12.417578 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 532/1065] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:12 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:33:12.643131 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-80cf9c70-0e77-4dfa-b101-e663133ea4b8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:12.643993 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-80cf9c70-0e77-4dfa-b101-e663133ea4b8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:12.650565 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-80cf9c70-0e77-4dfa-b101-e663133ea4b8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:12.651012 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-80cf9c70-0e77-4dfa-b101-e663133ea4b8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:12.651813 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-80cf9c70-0e77-4dfa-b101-e663133ea4b8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:12.652247 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-80cf9c70-0e77-4dfa-b101-e663133ea4b8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:12.680458 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-80cf9c70-0e77-4dfa-b101-e663133ea4b8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041838 Jul 11 11:33:12.680990 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 534/1066] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:12 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:33:12.897754 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-4525b737-7c58-4fd8-ba63-18cc76efe3fe tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:12.898306 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-4525b737-7c58-4fd8-ba63-18cc76efe3fe tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:12.904750 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4525b737-7c58-4fd8-ba63-18cc76efe3fe tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:12.905197 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4525b737-7c58-4fd8-ba63-18cc76efe3fe tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:12.905951 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4525b737-7c58-4fd8-ba63-18cc76efe3fe tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:12.906389 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4525b737-7c58-4fd8-ba63-18cc76efe3fe tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:13.037298 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-4525b737-7c58-4fd8-ba63-18cc76efe3fe tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:13.044304 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-72aafa1d-8ead-4ef2-b732-b8d354f3fa84 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:13.044919 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-72aafa1d-8ead-4ef2-b732-b8d354f3fa84 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:13.045714 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-4525b737-7c58-4fd8-ba63-18cc76efe3fe tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:13.047869 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-4525b737-7c58-4fd8-ba63-18cc76efe3fe tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:13.049026 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-4525b737-7c58-4fd8-ba63-18cc76efe3fe tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.155263 Jul 11 11:33:13.054881 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 533/1067] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:33:12 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:33:13.055006 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-72aafa1d-8ead-4ef2-b732-b8d354f3fa84 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:13.055006 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-72aafa1d-8ead-4ef2-b732-b8d354f3fa84 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:13.055006 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-72aafa1d-8ead-4ef2-b732-b8d354f3fa84 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:13.055006 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-72aafa1d-8ead-4ef2-b732-b8d354f3fa84 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:13.177449 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-72aafa1d-8ead-4ef2-b732-b8d354f3fa84 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:13.185134 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-72aafa1d-8ead-4ef2-b732-b8d354f3fa84 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.144640 Jul 11 11:33:13.185693 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 535/1068] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:33:13 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:33:13.428739 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-45d99526-b7da-4419-9549-056918dc59e1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:13.429632 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-45d99526-b7da-4419-9549-056918dc59e1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:13.435607 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-45d99526-b7da-4419-9549-056918dc59e1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:13.436052 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-45d99526-b7da-4419-9549-056918dc59e1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:13.436802 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-45d99526-b7da-4419-9549-056918dc59e1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:13.437236 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-45d99526-b7da-4419-9549-056918dc59e1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:13.466024 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-45d99526-b7da-4419-9549-056918dc59e1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041291 Jul 11 11:33:13.466591 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 534/1069] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:13 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:33:13.692772 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-8a018003-9ecd-46e6-9d49-f106222058f2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:13.693663 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-8a018003-9ecd-46e6-9d49-f106222058f2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:13.700002 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8a018003-9ecd-46e6-9d49-f106222058f2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:13.700448 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8a018003-9ecd-46e6-9d49-f106222058f2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:13.701193 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8a018003-9ecd-46e6-9d49-f106222058f2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:13.701620 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8a018003-9ecd-46e6-9d49-f106222058f2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:13.730055 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-8a018003-9ecd-46e6-9d49-f106222058f2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042041 Jul 11 11:33:13.730602 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 536/1070] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:13 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:33:14.067154 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-f7c48f64-6905-4bf5-85db-8f2ddb712b17 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:14.067807 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-f7c48f64-6905-4bf5-85db-8f2ddb712b17 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:14.074334 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f7c48f64-6905-4bf5-85db-8f2ddb712b17 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:14.074786 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f7c48f64-6905-4bf5-85db-8f2ddb712b17 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:14.075598 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f7c48f64-6905-4bf5-85db-8f2ddb712b17 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:14.076036 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f7c48f64-6905-4bf5-85db-8f2ddb712b17 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:14.201974 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-61532c8d-579b-47fa-b30f-75fc8b3aea76 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:14.202595 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-61532c8d-579b-47fa-b30f-75fc8b3aea76 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:14.204814 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-f7c48f64-6905-4bf5-85db-8f2ddb712b17 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:14.208675 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-61532c8d-579b-47fa-b30f-75fc8b3aea76 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:14.209318 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-61532c8d-579b-47fa-b30f-75fc8b3aea76 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:14.210198 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-61532c8d-579b-47fa-b30f-75fc8b3aea76 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:14.210529 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-61532c8d-579b-47fa-b30f-75fc8b3aea76 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:14.213230 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-f7c48f64-6905-4bf5-85db-8f2ddb712b17 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:14.214738 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-f7c48f64-6905-4bf5-85db-8f2ddb712b17 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:14.216035 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-f7c48f64-6905-4bf5-85db-8f2ddb712b17 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.153584 Jul 11 11:33:14.216602 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 535/1071] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:33:14 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:33:14.335517 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-61532c8d-579b-47fa-b30f-75fc8b3aea76 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:14.343189 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-61532c8d-579b-47fa-b30f-75fc8b3aea76 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.145124 Jul 11 11:33:14.343777 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 537/1072] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:33:14 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:33:14.483910 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-63ac711a-b860-4700-a243-7d0ba8ee21a0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:14.484849 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-63ac711a-b860-4700-a243-7d0ba8ee21a0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:14.491709 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-63ac711a-b860-4700-a243-7d0ba8ee21a0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:14.492156 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-63ac711a-b860-4700-a243-7d0ba8ee21a0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:14.493129 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-63ac711a-b860-4700-a243-7d0ba8ee21a0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:14.493564 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-63ac711a-b860-4700-a243-7d0ba8ee21a0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:14.521373 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-63ac711a-b860-4700-a243-7d0ba8ee21a0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046369 Jul 11 11:33:14.521853 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 536/1073] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:14 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:33:14.740904 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-ad584ae3-48f0-45a6-a150-43b0256d4081 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:14.741829 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-ad584ae3-48f0-45a6-a150-43b0256d4081 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:14.748326 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ad584ae3-48f0-45a6-a150-43b0256d4081 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:14.748809 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ad584ae3-48f0-45a6-a150-43b0256d4081 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:14.749570 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ad584ae3-48f0-45a6-a150-43b0256d4081 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:14.750009 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ad584ae3-48f0-45a6-a150-43b0256d4081 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:14.778200 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-ad584ae3-48f0-45a6-a150-43b0256d4081 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041191 Jul 11 11:33:14.778676 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 538/1074] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:14 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:33:15.234417 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-ebae2f62-d9ba-45e0-ad65-0c212029d069 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:15.235125 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-ebae2f62-d9ba-45e0-ad65-0c212029d069 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:15.241683 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ebae2f62-d9ba-45e0-ad65-0c212029d069 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:15.242132 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ebae2f62-d9ba-45e0-ad65-0c212029d069 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:15.242892 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ebae2f62-d9ba-45e0-ad65-0c212029d069 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:15.243355 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ebae2f62-d9ba-45e0-ad65-0c212029d069 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:15.361584 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-432f7104-53d8-428f-9611-4cb53dee9031 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:15.362437 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-432f7104-53d8-428f-9611-4cb53dee9031 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:15.367545 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-ebae2f62-d9ba-45e0-ad65-0c212029d069 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:15.368741 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-432f7104-53d8-428f-9611-4cb53dee9031 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:15.369184 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-432f7104-53d8-428f-9611-4cb53dee9031 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:15.369946 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-432f7104-53d8-428f-9611-4cb53dee9031 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:15.370447 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-432f7104-53d8-428f-9611-4cb53dee9031 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:15.377248 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-ebae2f62-d9ba-45e0-ad65-0c212029d069 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:15.378749 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-ebae2f62-d9ba-45e0-ad65-0c212029d069 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:15.379929 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-ebae2f62-d9ba-45e0-ad65-0c212029d069 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.149381 Jul 11 11:33:15.380494 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 537/1075] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:33:15 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:33:15.503589 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-432f7104-53d8-428f-9611-4cb53dee9031 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:15.511474 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-432f7104-53d8-428f-9611-4cb53dee9031 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.154208 Jul 11 11:33:15.512068 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 539/1076] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:33:15 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:33:15.532672 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-ead1ba0e-7d81-4681-b381-c8ccb62a41f6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:15.533598 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-ead1ba0e-7d81-4681-b381-c8ccb62a41f6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:15.539431 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ead1ba0e-7d81-4681-b381-c8ccb62a41f6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:15.539882 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ead1ba0e-7d81-4681-b381-c8ccb62a41f6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:15.540643 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ead1ba0e-7d81-4681-b381-c8ccb62a41f6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:15.541079 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ead1ba0e-7d81-4681-b381-c8ccb62a41f6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:15.570181 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-ead1ba0e-7d81-4681-b381-c8ccb62a41f6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041322 Jul 11 11:33:15.570662 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 538/1077] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:15 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:33:15.790063 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-8fa4ef66-f1a2-4a7d-823a-c49e915a0f20 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:15.790979 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-8fa4ef66-f1a2-4a7d-823a-c49e915a0f20 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:15.798101 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8fa4ef66-f1a2-4a7d-823a-c49e915a0f20 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:15.798600 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8fa4ef66-f1a2-4a7d-823a-c49e915a0f20 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:15.799411 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8fa4ef66-f1a2-4a7d-823a-c49e915a0f20 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:15.799847 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8fa4ef66-f1a2-4a7d-823a-c49e915a0f20 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:15.828383 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-8fa4ef66-f1a2-4a7d-823a-c49e915a0f20 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042244 Jul 11 11:33:15.828861 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 540/1078] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:15 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:33:16.397928 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-1130ef67-2233-4cc7-a0f4-211c9c023256 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:16.398559 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-1130ef67-2233-4cc7-a0f4-211c9c023256 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:16.405040 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1130ef67-2233-4cc7-a0f4-211c9c023256 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:16.405489 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1130ef67-2233-4cc7-a0f4-211c9c023256 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:16.406243 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1130ef67-2233-4cc7-a0f4-211c9c023256 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:16.407354 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1130ef67-2233-4cc7-a0f4-211c9c023256 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:16.527635 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-287cccf2-ce98-45ed-bf3d-226d13d2b99d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:16.528359 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-287cccf2-ce98-45ed-bf3d-226d13d2b99d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:16.534476 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-287cccf2-ce98-45ed-bf3d-226d13d2b99d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:16.534918 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-287cccf2-ce98-45ed-bf3d-226d13d2b99d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:16.535717 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-287cccf2-ce98-45ed-bf3d-226d13d2b99d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:16.536147 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-287cccf2-ce98-45ed-bf3d-226d13d2b99d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:16.536779 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-1130ef67-2233-4cc7-a0f4-211c9c023256 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:16.545227 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-1130ef67-2233-4cc7-a0f4-211c9c023256 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:16.546806 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-1130ef67-2233-4cc7-a0f4-211c9c023256 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:16.548057 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-1130ef67-2233-4cc7-a0f4-211c9c023256 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.154075 Jul 11 11:33:16.548718 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 539/1079] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:33:16 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:33:16.582328 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-7fe2f9e8-60bb-4c5a-937b-69147a17d824 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:16.583415 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-7fe2f9e8-60bb-4c5a-937b-69147a17d824 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:16.589415 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7fe2f9e8-60bb-4c5a-937b-69147a17d824 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:16.589960 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7fe2f9e8-60bb-4c5a-937b-69147a17d824 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:16.590779 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7fe2f9e8-60bb-4c5a-937b-69147a17d824 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:16.591303 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7fe2f9e8-60bb-4c5a-937b-69147a17d824 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:16.619485 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-7fe2f9e8-60bb-4c5a-937b-69147a17d824 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041510 Jul 11 11:33:16.620050 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 540/1080] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:16 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:33:16.662844 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-287cccf2-ce98-45ed-bf3d-226d13d2b99d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:16.670667 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-287cccf2-ce98-45ed-bf3d-226d13d2b99d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.146858 Jul 11 11:33:16.671227 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 541/1081] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:33:16 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:33:16.839847 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-8aa41f34-bef7-46d6-ae60-e8e8778df1d7 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:16.840764 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-8aa41f34-bef7-46d6-ae60-e8e8778df1d7 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:16.846650 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8aa41f34-bef7-46d6-ae60-e8e8778df1d7 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:16.847092 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8aa41f34-bef7-46d6-ae60-e8e8778df1d7 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:16.847874 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8aa41f34-bef7-46d6-ae60-e8e8778df1d7 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:16.848302 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8aa41f34-bef7-46d6-ae60-e8e8778df1d7 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:16.876726 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-8aa41f34-bef7-46d6-ae60-e8e8778df1d7 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040862 Jul 11 11:33:16.877258 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 541/1082] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:16 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:33:17.565827 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-736cd1af-0008-4f40-b7b4-6fbc678b8beb tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:17.566428 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-736cd1af-0008-4f40-b7b4-6fbc678b8beb tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:17.572888 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-736cd1af-0008-4f40-b7b4-6fbc678b8beb tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:17.573308 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-736cd1af-0008-4f40-b7b4-6fbc678b8beb tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:17.574055 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-736cd1af-0008-4f40-b7b4-6fbc678b8beb tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:17.574505 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-736cd1af-0008-4f40-b7b4-6fbc678b8beb tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:17.630124 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-ef0ae43f-db96-49c3-82a6-54bfddadd20e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:17.631186 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-ef0ae43f-db96-49c3-82a6-54bfddadd20e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:17.637820 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ef0ae43f-db96-49c3-82a6-54bfddadd20e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:17.638308 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ef0ae43f-db96-49c3-82a6-54bfddadd20e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:17.639015 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ef0ae43f-db96-49c3-82a6-54bfddadd20e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:17.639505 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ef0ae43f-db96-49c3-82a6-54bfddadd20e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:17.669852 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-ef0ae43f-db96-49c3-82a6-54bfddadd20e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043649 Jul 11 11:33:17.670428 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 542/1083] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:17 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:33:17.687469 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-ba9fd4a2-c9eb-4881-bd3b-7a958586385c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:17.688248 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-ba9fd4a2-c9eb-4881-bd3b-7a958586385c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:17.694477 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ba9fd4a2-c9eb-4881-bd3b-7a958586385c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:17.694854 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ba9fd4a2-c9eb-4881-bd3b-7a958586385c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:17.695637 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ba9fd4a2-c9eb-4881-bd3b-7a958586385c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:17.696073 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ba9fd4a2-c9eb-4881-bd3b-7a958586385c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:17.708724 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-736cd1af-0008-4f40-b7b4-6fbc678b8beb tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:17.717214 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-736cd1af-0008-4f40-b7b4-6fbc678b8beb tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:17.718721 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-736cd1af-0008-4f40-b7b4-6fbc678b8beb tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:17.720533 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-736cd1af-0008-4f40-b7b4-6fbc678b8beb tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.158912 Jul 11 11:33:17.721140 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 542/1084] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:33:17 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:33:17.822065 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-ba9fd4a2-c9eb-4881-bd3b-7a958586385c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:17.830581 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-ba9fd4a2-c9eb-4881-bd3b-7a958586385c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.146929 Jul 11 11:33:17.831158 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 543/1085] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:33:17 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:33:17.888000 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-0550cca4-04ed-4b84-af2d-b3f28dff0e5e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:17.888918 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-0550cca4-04ed-4b84-af2d-b3f28dff0e5e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:17.895584 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0550cca4-04ed-4b84-af2d-b3f28dff0e5e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:17.896028 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0550cca4-04ed-4b84-af2d-b3f28dff0e5e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:17.896781 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0550cca4-04ed-4b84-af2d-b3f28dff0e5e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:17.897211 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0550cca4-04ed-4b84-af2d-b3f28dff0e5e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:17.925799 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-0550cca4-04ed-4b84-af2d-b3f28dff0e5e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041617 Jul 11 11:33:17.926341 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 543/1086] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:17 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:33:18.681573 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-f4a51952-f4df-4461-b07d-3ea876acd6b1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:18.682488 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-f4a51952-f4df-4461-b07d-3ea876acd6b1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:18.688907 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f4a51952-f4df-4461-b07d-3ea876acd6b1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:18.689348 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f4a51952-f4df-4461-b07d-3ea876acd6b1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:18.690358 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f4a51952-f4df-4461-b07d-3ea876acd6b1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:18.690795 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f4a51952-f4df-4461-b07d-3ea876acd6b1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:18.718773 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-f4a51952-f4df-4461-b07d-3ea876acd6b1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041158 Jul 11 11:33:18.719988 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 544/1087] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:18 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:33:18.739109 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-99008d7e-f381-486f-9ce7-7fe84eece4c6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:18.739739 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-99008d7e-f381-486f-9ce7-7fe84eece4c6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:18.746065 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-99008d7e-f381-486f-9ce7-7fe84eece4c6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:18.746505 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-99008d7e-f381-486f-9ce7-7fe84eece4c6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:18.747266 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-99008d7e-f381-486f-9ce7-7fe84eece4c6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:18.747705 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-99008d7e-f381-486f-9ce7-7fe84eece4c6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:18.848348 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-2f25b0bb-5503-49a0-868a-968c7868bb6b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:18.848962 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-2f25b0bb-5503-49a0-868a-968c7868bb6b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:18.854943 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2f25b0bb-5503-49a0-868a-968c7868bb6b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:18.855430 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2f25b0bb-5503-49a0-868a-968c7868bb6b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:18.856199 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2f25b0bb-5503-49a0-868a-968c7868bb6b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:18.856635 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2f25b0bb-5503-49a0-868a-968c7868bb6b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:18.872022 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-99008d7e-f381-486f-9ce7-7fe84eece4c6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:18.880738 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-99008d7e-f381-486f-9ce7-7fe84eece4c6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:18.882236 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-99008d7e-f381-486f-9ce7-7fe84eece4c6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:18.883418 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-99008d7e-f381-486f-9ce7-7fe84eece4c6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.148073 Jul 11 11:33:18.884000 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 544/1088] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:33:18 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:33:18.937047 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-33a556a0-1907-4d31-9f01-636556307ef8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:18.938473 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-33a556a0-1907-4d31-9f01-636556307ef8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:18.944720 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-33a556a0-1907-4d31-9f01-636556307ef8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:18.945170 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-33a556a0-1907-4d31-9f01-636556307ef8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:18.945938 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-33a556a0-1907-4d31-9f01-636556307ef8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:18.946376 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-33a556a0-1907-4d31-9f01-636556307ef8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:18.976990 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-33a556a0-1907-4d31-9f01-636556307ef8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043668 Jul 11 11:33:18.977551 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 545/1089] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:18 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:33:18.984270 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-2f25b0bb-5503-49a0-868a-968c7868bb6b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:18.992391 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-2f25b0bb-5503-49a0-868a-968c7868bb6b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.148874 Jul 11 11:33:18.992948 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 545/1090] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:33:18 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:33:19.730041 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-6398f69a-ddd1-412f-8697-28f4c8775613 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:19.730999 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-6398f69a-ddd1-412f-8697-28f4c8775613 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:19.737832 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6398f69a-ddd1-412f-8697-28f4c8775613 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:19.738282 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6398f69a-ddd1-412f-8697-28f4c8775613 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:19.739044 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6398f69a-ddd1-412f-8697-28f4c8775613 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:19.739519 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6398f69a-ddd1-412f-8697-28f4c8775613 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:19.767208 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-6398f69a-ddd1-412f-8697-28f4c8775613 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041110 Jul 11 11:33:19.767784 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 546/1091] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:19 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:33:19.901974 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-c50778e0-52de-4225-b321-5334b8585a45 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:19.902579 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-c50778e0-52de-4225-b321-5334b8585a45 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:19.909797 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c50778e0-52de-4225-b321-5334b8585a45 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:19.911438 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c50778e0-52de-4225-b321-5334b8585a45 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:19.911438 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c50778e0-52de-4225-b321-5334b8585a45 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:19.911616 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c50778e0-52de-4225-b321-5334b8585a45 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:19.991467 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-0323130b-30b5-4708-b95c-57c270228cf2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:19.991467 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-0323130b-30b5-4708-b95c-57c270228cf2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:19.995556 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0323130b-30b5-4708-b95c-57c270228cf2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:19.996015 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0323130b-30b5-4708-b95c-57c270228cf2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:19.996792 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0323130b-30b5-4708-b95c-57c270228cf2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:19.997231 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0323130b-30b5-4708-b95c-57c270228cf2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:20.001050 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=100 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:33:20.028122 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-0323130b-30b5-4708-b95c-57c270228cf2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043732 Jul 11 11:33:20.028697 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 547/1092] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:19 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:33:20.033760 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-5829073c-2aff-4e8b-b502-6684d7160012 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:20.034367 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-5829073c-2aff-4e8b-b502-6684d7160012 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:20.040718 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5829073c-2aff-4e8b-b502-6684d7160012 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:20.041176 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5829073c-2aff-4e8b-b502-6684d7160012 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:20.041945 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5829073c-2aff-4e8b-b502-6684d7160012 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:20.042387 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5829073c-2aff-4e8b-b502-6684d7160012 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:20.047786 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-c50778e0-52de-4225-b321-5334b8585a45 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:20.056799 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-c50778e0-52de-4225-b321-5334b8585a45 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:20.058306 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-c50778e0-52de-4225-b321-5334b8585a45 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:20.059501 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-c50778e0-52de-4225-b321-5334b8585a45 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.161470 Jul 11 11:33:20.060063 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 546/1093] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:33:19 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:33:20.174224 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-5829073c-2aff-4e8b-b502-6684d7160012 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:20.182004 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-5829073c-2aff-4e8b-b502-6684d7160012 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.152382 Jul 11 11:33:20.182565 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 548/1094] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:33:20 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:33:20.778167 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-e7d51c9d-a711-439a-ac13-94310110fb94 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:20.779113 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-e7d51c9d-a711-439a-ac13-94310110fb94 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:20.785269 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e7d51c9d-a711-439a-ac13-94310110fb94 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:20.785718 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e7d51c9d-a711-439a-ac13-94310110fb94 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:20.786480 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e7d51c9d-a711-439a-ac13-94310110fb94 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:20.786913 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e7d51c9d-a711-439a-ac13-94310110fb94 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:20.790567 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=100 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:33:20.816003 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-e7d51c9d-a711-439a-ac13-94310110fb94 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041831 Jul 11 11:33:20.816565 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 547/1095] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:20 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:33:21.040617 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-006f04f7-1f2a-491e-a3ff-d8f03e974e82 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:21.041439 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-006f04f7-1f2a-491e-a3ff-d8f03e974e82 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:21.048146 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-006f04f7-1f2a-491e-a3ff-d8f03e974e82 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:21.048584 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-006f04f7-1f2a-491e-a3ff-d8f03e974e82 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:21.049479 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-006f04f7-1f2a-491e-a3ff-d8f03e974e82 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:21.049915 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-006f04f7-1f2a-491e-a3ff-d8f03e974e82 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:21.078169 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-9472cd16-8be9-44f0-8cfd-69c1b0e8c385 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:21.079451 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-9472cd16-8be9-44f0-8cfd-69c1b0e8c385 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:21.080546 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-006f04f7-1f2a-491e-a3ff-d8f03e974e82 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043925 Jul 11 11:33:21.081112 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 549/1096] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:21 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:33:21.085878 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9472cd16-8be9-44f0-8cfd-69c1b0e8c385 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:21.086319 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9472cd16-8be9-44f0-8cfd-69c1b0e8c385 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:21.087066 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9472cd16-8be9-44f0-8cfd-69c1b0e8c385 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:21.087516 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9472cd16-8be9-44f0-8cfd-69c1b0e8c385 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:21.198505 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-035143d4-e644-4738-8a41-67dc61855c36 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:21.199116 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-035143d4-e644-4738-8a41-67dc61855c36 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:21.209149 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-035143d4-e644-4738-8a41-67dc61855c36 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:21.209149 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-035143d4-e644-4738-8a41-67dc61855c36 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:21.209149 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-035143d4-e644-4738-8a41-67dc61855c36 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:21.209149 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-035143d4-e644-4738-8a41-67dc61855c36 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:21.215118 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-9472cd16-8be9-44f0-8cfd-69c1b0e8c385 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:21.231598 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-9472cd16-8be9-44f0-8cfd-69c1b0e8c385 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:21.233546 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-9472cd16-8be9-44f0-8cfd-69c1b0e8c385 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:21.234856 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-9472cd16-8be9-44f0-8cfd-69c1b0e8c385 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.160812 Jul 11 11:33:21.244796 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 548/1097] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:33:21 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 11:33:21.335725 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-035143d4-e644-4738-8a41-67dc61855c36 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:21.343716 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-035143d4-e644-4738-8a41-67dc61855c36 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.149060 Jul 11 11:33:21.344303 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 550/1098] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:33:21 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:33:21.827673 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-303bc4fa-5ee6-40e4-b03a-34f592789e1c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:21.828658 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-303bc4fa-5ee6-40e4-b03a-34f592789e1c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:21.834717 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-303bc4fa-5ee6-40e4-b03a-34f592789e1c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:21.835160 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-303bc4fa-5ee6-40e4-b03a-34f592789e1c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:21.835945 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-303bc4fa-5ee6-40e4-b03a-34f592789e1c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:21.836374 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-303bc4fa-5ee6-40e4-b03a-34f592789e1c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:21.866072 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-303bc4fa-5ee6-40e4-b03a-34f592789e1c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042343 Jul 11 11:33:21.866610 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 549/1099] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:21 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:33:22.092233 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-f18f63b2-2f36-4b75-8aea-647533e93e05 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:22.093087 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-f18f63b2-2f36-4b75-8aea-647533e93e05 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:22.099819 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f18f63b2-2f36-4b75-8aea-647533e93e05 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:22.100268 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f18f63b2-2f36-4b75-8aea-647533e93e05 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:22.101029 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f18f63b2-2f36-4b75-8aea-647533e93e05 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:22.101462 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f18f63b2-2f36-4b75-8aea-647533e93e05 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:22.129997 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-f18f63b2-2f36-4b75-8aea-647533e93e05 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041818 Jul 11 11:33:22.130551 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 551/1100] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:22 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:33:22.252972 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-08da0618-b983-4b8d-ac9e-2bc24d6a2571 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:22.253577 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-08da0618-b983-4b8d-ac9e-2bc24d6a2571 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:22.260262 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-08da0618-b983-4b8d-ac9e-2bc24d6a2571 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:22.260710 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-08da0618-b983-4b8d-ac9e-2bc24d6a2571 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:22.261458 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-08da0618-b983-4b8d-ac9e-2bc24d6a2571 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:22.261887 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-08da0618-b983-4b8d-ac9e-2bc24d6a2571 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:22.360483 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-2723fed1-73ef-4bca-8f24-9884e47cedad tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:22.361012 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-2723fed1-73ef-4bca-8f24-9884e47cedad tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:22.366853 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2723fed1-73ef-4bca-8f24-9884e47cedad tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:22.367321 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2723fed1-73ef-4bca-8f24-9884e47cedad tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:22.368077 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2723fed1-73ef-4bca-8f24-9884e47cedad tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:22.368503 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2723fed1-73ef-4bca-8f24-9884e47cedad tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:22.390440 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-08da0618-b983-4b8d-ac9e-2bc24d6a2571 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:22.399527 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-08da0618-b983-4b8d-ac9e-2bc24d6a2571 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:22.401053 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-08da0618-b983-4b8d-ac9e-2bc24d6a2571 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:22.402208 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-08da0618-b983-4b8d-ac9e-2bc24d6a2571 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.153123 Jul 11 11:33:22.402841 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 550/1101] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:33:22 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:33:22.495672 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-2723fed1-73ef-4bca-8f24-9884e47cedad tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:22.503980 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-2723fed1-73ef-4bca-8f24-9884e47cedad tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.147796 Jul 11 11:33:22.504550 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 552/1102] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:33:22 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:33:22.878284 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-a1e253c5-8dab-4d4d-869a-30e3360e2a9d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:22.897273 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-a1e253c5-8dab-4d4d-869a-30e3360e2a9d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:22.897273 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a1e253c5-8dab-4d4d-869a-30e3360e2a9d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:22.897273 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a1e253c5-8dab-4d4d-869a-30e3360e2a9d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:22.897273 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a1e253c5-8dab-4d4d-869a-30e3360e2a9d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:22.897655 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a1e253c5-8dab-4d4d-869a-30e3360e2a9d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:22.915892 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-a1e253c5-8dab-4d4d-869a-30e3360e2a9d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042125 Jul 11 11:33:22.916447 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 551/1103] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:22 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:33:23.141628 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-f6e796f5-2e2d-43e3-a22d-78cb3942ccbf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:23.142471 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-f6e796f5-2e2d-43e3-a22d-78cb3942ccbf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:23.149010 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f6e796f5-2e2d-43e3-a22d-78cb3942ccbf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:23.149438 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f6e796f5-2e2d-43e3-a22d-78cb3942ccbf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:23.150187 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f6e796f5-2e2d-43e3-a22d-78cb3942ccbf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:23.150615 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f6e796f5-2e2d-43e3-a22d-78cb3942ccbf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:23.179430 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-f6e796f5-2e2d-43e3-a22d-78cb3942ccbf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041805 Jul 11 11:33:23.179993 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 553/1104] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:23 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:33:23.420878 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-5b9a89c2-c02a-459c-a23a-547e17992167 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:23.421487 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-5b9a89c2-c02a-459c-a23a-547e17992167 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:23.428582 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5b9a89c2-c02a-459c-a23a-547e17992167 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:23.429028 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5b9a89c2-c02a-459c-a23a-547e17992167 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:23.429784 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5b9a89c2-c02a-459c-a23a-547e17992167 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:23.430216 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5b9a89c2-c02a-459c-a23a-547e17992167 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:23.520762 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-3f86cc0e-d97a-40da-8536-5a9142bac55f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:23.521376 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-3f86cc0e-d97a-40da-8536-5a9142bac55f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:23.532204 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3f86cc0e-d97a-40da-8536-5a9142bac55f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:23.532204 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3f86cc0e-d97a-40da-8536-5a9142bac55f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:23.532204 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3f86cc0e-d97a-40da-8536-5a9142bac55f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:23.532204 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3f86cc0e-d97a-40da-8536-5a9142bac55f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:23.561164 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-5b9a89c2-c02a-459c-a23a-547e17992167 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:23.569937 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-5b9a89c2-c02a-459c-a23a-547e17992167 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:23.571478 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-5b9a89c2-c02a-459c-a23a-547e17992167 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:23.572930 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-5b9a89c2-c02a-459c-a23a-547e17992167 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.155739 Jul 11 11:33:23.573503 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 552/1105] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:33:23 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:33:23.660363 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-3f86cc0e-d97a-40da-8536-5a9142bac55f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:23.670323 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-3f86cc0e-d97a-40da-8536-5a9142bac55f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.153060 Jul 11 11:33:23.671316 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 554/1106] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:33:23 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:33:23.926970 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-0aaf6046-07fa-4f20-b484-540c230710ca tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:23.927852 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-0aaf6046-07fa-4f20-b484-540c230710ca tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:23.934030 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0aaf6046-07fa-4f20-b484-540c230710ca tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:23.934488 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0aaf6046-07fa-4f20-b484-540c230710ca tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:23.935280 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0aaf6046-07fa-4f20-b484-540c230710ca tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:23.935712 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0aaf6046-07fa-4f20-b484-540c230710ca tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:23.964574 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-0aaf6046-07fa-4f20-b484-540c230710ca tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041596 Jul 11 11:33:23.965134 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 553/1107] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:23 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:33:24.192062 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-649fd5cc-72a3-4da0-87d8-afa4d90daadb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:24.192903 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-649fd5cc-72a3-4da0-87d8-afa4d90daadb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:24.199309 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-649fd5cc-72a3-4da0-87d8-afa4d90daadb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:24.202964 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-649fd5cc-72a3-4da0-87d8-afa4d90daadb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:24.202964 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-649fd5cc-72a3-4da0-87d8-afa4d90daadb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:24.202964 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-649fd5cc-72a3-4da0-87d8-afa4d90daadb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:24.233103 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-649fd5cc-72a3-4da0-87d8-afa4d90daadb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045873 Jul 11 11:33:24.233647 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 555/1108] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:24 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:33:24.590797 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-d9d2e98b-132c-440b-91df-3f3e9ee6835e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:24.591434 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-d9d2e98b-132c-440b-91df-3f3e9ee6835e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:24.597779 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d9d2e98b-132c-440b-91df-3f3e9ee6835e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:24.598219 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d9d2e98b-132c-440b-91df-3f3e9ee6835e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:24.598969 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d9d2e98b-132c-440b-91df-3f3e9ee6835e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:24.599427 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d9d2e98b-132c-440b-91df-3f3e9ee6835e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:24.688545 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-c1dafa5c-19bd-44ad-958e-4560ce3ae26d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:24.689152 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-c1dafa5c-19bd-44ad-958e-4560ce3ae26d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:24.695378 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c1dafa5c-19bd-44ad-958e-4560ce3ae26d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:24.695820 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c1dafa5c-19bd-44ad-958e-4560ce3ae26d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:24.696576 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c1dafa5c-19bd-44ad-958e-4560ce3ae26d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:24.697004 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c1dafa5c-19bd-44ad-958e-4560ce3ae26d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:24.734091 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-d9d2e98b-132c-440b-91df-3f3e9ee6835e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:24.743355 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-d9d2e98b-132c-440b-91df-3f3e9ee6835e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:24.744876 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-d9d2e98b-132c-440b-91df-3f3e9ee6835e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:24.746045 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-d9d2e98b-132c-440b-91df-3f3e9ee6835e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.159120 Jul 11 11:33:24.746609 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 554/1109] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:33:24 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:33:24.821495 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-c1dafa5c-19bd-44ad-958e-4560ce3ae26d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:24.829362 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-c1dafa5c-19bd-44ad-958e-4560ce3ae26d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.145572 Jul 11 11:33:24.829924 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 556/1110] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:33:24 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:33:24.976176 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-81a9f205-948c-4488-b00a-17c2124643b8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:24.977103 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-81a9f205-948c-4488-b00a-17c2124643b8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:24.983024 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-81a9f205-948c-4488-b00a-17c2124643b8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:24.983516 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-81a9f205-948c-4488-b00a-17c2124643b8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:24.984281 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-81a9f205-948c-4488-b00a-17c2124643b8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:24.985302 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-81a9f205-948c-4488-b00a-17c2124643b8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:25.012859 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-81a9f205-948c-4488-b00a-17c2124643b8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040646 Jul 11 11:33:25.013408 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 555/1111] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:24 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:33:25.243729 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-119f96ea-eba0-4681-8d36-7150967c7e02 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:25.244673 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-119f96ea-eba0-4681-8d36-7150967c7e02 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:25.251025 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-119f96ea-eba0-4681-8d36-7150967c7e02 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:25.251497 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-119f96ea-eba0-4681-8d36-7150967c7e02 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:25.252243 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-119f96ea-eba0-4681-8d36-7150967c7e02 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:25.252671 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-119f96ea-eba0-4681-8d36-7150967c7e02 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:25.280890 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-119f96ea-eba0-4681-8d36-7150967c7e02 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041066 Jul 11 11:33:25.281425 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 557/1112] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:25 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:33:25.764214 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-161b2114-edee-41fa-98b1-93894244e626 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:25.764826 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-161b2114-edee-41fa-98b1-93894244e626 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:25.771880 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-161b2114-edee-41fa-98b1-93894244e626 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:25.772327 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-161b2114-edee-41fa-98b1-93894244e626 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:25.773081 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-161b2114-edee-41fa-98b1-93894244e626 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:25.773515 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-161b2114-edee-41fa-98b1-93894244e626 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:25.846025 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-f71b50f9-7b88-4bbd-a28d-ae8ebc515b0b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:25.846642 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-f71b50f9-7b88-4bbd-a28d-ae8ebc515b0b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:25.852973 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f71b50f9-7b88-4bbd-a28d-ae8ebc515b0b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:25.853646 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f71b50f9-7b88-4bbd-a28d-ae8ebc515b0b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:25.854220 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f71b50f9-7b88-4bbd-a28d-ae8ebc515b0b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:25.854655 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f71b50f9-7b88-4bbd-a28d-ae8ebc515b0b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:25.906090 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-161b2114-edee-41fa-98b1-93894244e626 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:25.920570 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-161b2114-edee-41fa-98b1-93894244e626 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:25.922816 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-161b2114-edee-41fa-98b1-93894244e626 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:25.924680 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-161b2114-edee-41fa-98b1-93894244e626 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.164331 Jul 11 11:33:25.925426 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 556/1113] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:33:25 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:33:25.998638 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-f71b50f9-7b88-4bbd-a28d-ae8ebc515b0b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:26.007217 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-f71b50f9-7b88-4bbd-a28d-ae8ebc515b0b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.165050 Jul 11 11:33:26.007790 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 558/1114] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:33:25 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:33:26.023981 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-963d0590-a0b5-423b-b528-e40a238c1099 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:26.024841 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-963d0590-a0b5-423b-b528-e40a238c1099 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:26.031034 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-963d0590-a0b5-423b-b528-e40a238c1099 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:26.031548 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-963d0590-a0b5-423b-b528-e40a238c1099 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:26.032505 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-963d0590-a0b5-423b-b528-e40a238c1099 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:26.032965 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-963d0590-a0b5-423b-b528-e40a238c1099 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:26.069183 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-963d0590-a0b5-423b-b528-e40a238c1099 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049316 Jul 11 11:33:26.069752 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 557/1115] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:26 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:33:26.293568 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-05692bbf-5d6a-475a-849b-9325734d9ba0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:26.294444 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-05692bbf-5d6a-475a-849b-9325734d9ba0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:26.301590 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-05692bbf-5d6a-475a-849b-9325734d9ba0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:26.302045 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-05692bbf-5d6a-475a-849b-9325734d9ba0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:26.302807 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-05692bbf-5d6a-475a-849b-9325734d9ba0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:26.303244 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-05692bbf-5d6a-475a-849b-9325734d9ba0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:26.331514 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-05692bbf-5d6a-475a-849b-9325734d9ba0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042045 Jul 11 11:33:26.332055 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 559/1116] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:26 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:33:26.942015 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-4161a4f6-19ef-4350-bb83-790b6533662b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:26.942625 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-4161a4f6-19ef-4350-bb83-790b6533662b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:26.949098 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4161a4f6-19ef-4350-bb83-790b6533662b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:26.949548 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4161a4f6-19ef-4350-bb83-790b6533662b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:26.950301 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4161a4f6-19ef-4350-bb83-790b6533662b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:26.950732 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4161a4f6-19ef-4350-bb83-790b6533662b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:27.024259 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-5ae62aaa-e46c-42ce-a5e5-fa8dae12f1f8 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:27.024869 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-5ae62aaa-e46c-42ce-a5e5-fa8dae12f1f8 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:27.030979 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5ae62aaa-e46c-42ce-a5e5-fa8dae12f1f8 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:27.031466 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5ae62aaa-e46c-42ce-a5e5-fa8dae12f1f8 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:27.032230 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5ae62aaa-e46c-42ce-a5e5-fa8dae12f1f8 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:27.032671 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5ae62aaa-e46c-42ce-a5e5-fa8dae12f1f8 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:27.078377 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-4161a4f6-19ef-4350-bb83-790b6533662b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:27.087166 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-4161a4f6-19ef-4350-bb83-790b6533662b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:27.088681 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-4161a4f6-19ef-4350-bb83-790b6533662b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:27.089815 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-4161a4f6-19ef-4350-bb83-790b6533662b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.151969 Jul 11 11:33:27.090399 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 558/1117] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:33:26 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:33:27.094770 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-76114975-90d5-4c5f-a9d9-7c656bb5b470 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:27.095709 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-76114975-90d5-4c5f-a9d9-7c656bb5b470 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:27.100162 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_api:SELECT=100 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:33:27.101959 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-76114975-90d5-4c5f-a9d9-7c656bb5b470 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:27.102400 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-76114975-90d5-4c5f-a9d9-7c656bb5b470 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:27.103158 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-76114975-90d5-4c5f-a9d9-7c656bb5b470 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:27.103613 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-76114975-90d5-4c5f-a9d9-7c656bb5b470 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:27.132972 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-76114975-90d5-4c5f-a9d9-7c656bb5b470 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041544 Jul 11 11:33:27.133539 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 559/1118] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:27 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:33:27.163857 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-5ae62aaa-e46c-42ce-a5e5-fa8dae12f1f8 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:27.171623 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-5ae62aaa-e46c-42ce-a5e5-fa8dae12f1f8 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.151167 Jul 11 11:33:27.172177 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 560/1119] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:33:27 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:33:27.342184 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-2761024a-0208-4142-88e6-3227e1cd823b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:27.343028 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-2761024a-0208-4142-88e6-3227e1cd823b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:27.348983 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2761024a-0208-4142-88e6-3227e1cd823b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:27.349424 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2761024a-0208-4142-88e6-3227e1cd823b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:27.350166 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2761024a-0208-4142-88e6-3227e1cd823b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:27.350597 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2761024a-0208-4142-88e6-3227e1cd823b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:27.379428 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-2761024a-0208-4142-88e6-3227e1cd823b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041294 Jul 11 11:33:27.379965 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 560/1120] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:27 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:33:28.107965 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-8d97ee1f-bb09-4765-b8dd-fa252f33f4ca tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:28.108575 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-8d97ee1f-bb09-4765-b8dd-fa252f33f4ca tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:28.112020 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_api:SELECT=100 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:33:28.115422 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8d97ee1f-bb09-4765-b8dd-fa252f33f4ca tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:28.115869 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8d97ee1f-bb09-4765-b8dd-fa252f33f4ca tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:28.116622 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8d97ee1f-bb09-4765-b8dd-fa252f33f4ca tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:28.117053 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8d97ee1f-bb09-4765-b8dd-fa252f33f4ca tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:28.144919 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-62d1c800-91c2-4856-b0b4-d55fbd771a8d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:28.145832 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-62d1c800-91c2-4856-b0b4-d55fbd771a8d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:28.152349 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-62d1c800-91c2-4856-b0b4-d55fbd771a8d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:28.152794 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-62d1c800-91c2-4856-b0b4-d55fbd771a8d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:28.153545 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-62d1c800-91c2-4856-b0b4-d55fbd771a8d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:28.153971 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-62d1c800-91c2-4856-b0b4-d55fbd771a8d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:28.182951 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-62d1c800-91c2-4856-b0b4-d55fbd771a8d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042387 Jul 11 11:33:28.183531 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 561/1121] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:28 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:33:28.188625 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-516bea06-d747-491b-8034-ff2942f3620a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:28.189236 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-516bea06-d747-491b-8034-ff2942f3620a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:28.195356 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-516bea06-d747-491b-8034-ff2942f3620a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:28.195813 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-516bea06-d747-491b-8034-ff2942f3620a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:28.196575 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-516bea06-d747-491b-8034-ff2942f3620a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:28.197011 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-516bea06-d747-491b-8034-ff2942f3620a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:28.244483 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-8d97ee1f-bb09-4765-b8dd-fa252f33f4ca tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:28.252901 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-8d97ee1f-bb09-4765-b8dd-fa252f33f4ca tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:28.254380 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-8d97ee1f-bb09-4765-b8dd-fa252f33f4ca tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:28.255554 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-8d97ee1f-bb09-4765-b8dd-fa252f33f4ca tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.151439 Jul 11 11:33:28.256252 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 561/1122] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:33:28 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:33:28.326225 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-516bea06-d747-491b-8034-ff2942f3620a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:28.334499 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-516bea06-d747-491b-8034-ff2942f3620a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.149470 Jul 11 11:33:28.335061 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 562/1123] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:33:28 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:33:28.391130 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-06cc95aa-ac17-4ee0-827c-b22cb1624a3a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:28.392620 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-06cc95aa-ac17-4ee0-827c-b22cb1624a3a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:28.398509 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-06cc95aa-ac17-4ee0-827c-b22cb1624a3a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:28.398958 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-06cc95aa-ac17-4ee0-827c-b22cb1624a3a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:28.399757 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-06cc95aa-ac17-4ee0-827c-b22cb1624a3a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:28.400203 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-06cc95aa-ac17-4ee0-827c-b22cb1624a3a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:28.428165 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-06cc95aa-ac17-4ee0-827c-b22cb1624a3a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041060 Jul 11 11:33:28.428705 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 562/1124] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:28 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:33:29.195704 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-917b70c9-0496-4321-b07d-182ac7ff55a9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:29.196657 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-917b70c9-0496-4321-b07d-182ac7ff55a9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:29.203076 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-917b70c9-0496-4321-b07d-182ac7ff55a9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:29.203556 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-917b70c9-0496-4321-b07d-182ac7ff55a9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:29.204317 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-917b70c9-0496-4321-b07d-182ac7ff55a9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:29.204754 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-917b70c9-0496-4321-b07d-182ac7ff55a9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:29.229000 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=100 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:33:29.233348 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-917b70c9-0496-4321-b07d-182ac7ff55a9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041660 Jul 11 11:33:29.233899 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 563/1125] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:29 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:33:29.273583 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-377f607f-d241-48c4-b342-fd7689773091 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:29.274213 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-377f607f-d241-48c4-b342-fd7689773091 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:29.280662 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-377f607f-d241-48c4-b342-fd7689773091 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:29.281102 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-377f607f-d241-48c4-b342-fd7689773091 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:29.281853 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-377f607f-d241-48c4-b342-fd7689773091 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:29.282295 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-377f607f-d241-48c4-b342-fd7689773091 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:29.352313 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-0a1fe7c5-d135-4ff9-a2b0-b8a8f5e779ee tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:29.352852 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-0a1fe7c5-d135-4ff9-a2b0-b8a8f5e779ee tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:29.358771 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0a1fe7c5-d135-4ff9-a2b0-b8a8f5e779ee tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:29.359213 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0a1fe7c5-d135-4ff9-a2b0-b8a8f5e779ee tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:29.360059 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0a1fe7c5-d135-4ff9-a2b0-b8a8f5e779ee tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:29.360405 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0a1fe7c5-d135-4ff9-a2b0-b8a8f5e779ee tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:29.410883 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-377f607f-d241-48c4-b342-fd7689773091 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:29.414270 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=100 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:33:29.419409 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-377f607f-d241-48c4-b342-fd7689773091 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:29.421183 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-377f607f-d241-48c4-b342-fd7689773091 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:29.425692 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-377f607f-d241-48c4-b342-fd7689773091 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.152595 Jul 11 11:33:29.425692 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 563/1126] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:33:29 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:33:29.439662 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-e82d3c9b-c383-494e-bd3f-833484ab4785 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:29.440927 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-e82d3c9b-c383-494e-bd3f-833484ab4785 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:29.447426 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e82d3c9b-c383-494e-bd3f-833484ab4785 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:29.447896 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e82d3c9b-c383-494e-bd3f-833484ab4785 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:29.448632 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e82d3c9b-c383-494e-bd3f-833484ab4785 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:29.449063 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e82d3c9b-c383-494e-bd3f-833484ab4785 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:29.477535 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-e82d3c9b-c383-494e-bd3f-833484ab4785 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041783 Jul 11 11:33:29.478087 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 564/1127] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:29 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:33:29.490789 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-0a1fe7c5-d135-4ff9-a2b0-b8a8f5e779ee tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:29.498592 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-0a1fe7c5-d135-4ff9-a2b0-b8a8f5e779ee tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.150628 Jul 11 11:33:29.499148 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 564/1128] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:33:29 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:33:30.245491 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-847a7673-269f-4f55-b2bf-e77ceec98606 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:30.246407 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-847a7673-269f-4f55-b2bf-e77ceec98606 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:30.252966 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-847a7673-269f-4f55-b2bf-e77ceec98606 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:30.253405 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-847a7673-269f-4f55-b2bf-e77ceec98606 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:30.254152 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-847a7673-269f-4f55-b2bf-e77ceec98606 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:30.254575 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-847a7673-269f-4f55-b2bf-e77ceec98606 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:30.284028 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-847a7673-269f-4f55-b2bf-e77ceec98606 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042473 Jul 11 11:33:30.284667 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 565/1129] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:30 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:33:30.441656 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-9438a291-a42e-445f-b09d-68bdaf2a7d83 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:30.442270 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-9438a291-a42e-445f-b09d-68bdaf2a7d83 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:30.449348 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9438a291-a42e-445f-b09d-68bdaf2a7d83 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:30.449798 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9438a291-a42e-445f-b09d-68bdaf2a7d83 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:30.450551 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9438a291-a42e-445f-b09d-68bdaf2a7d83 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:30.450980 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9438a291-a42e-445f-b09d-68bdaf2a7d83 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:30.489576 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-98c09f87-3029-4fbf-8d4e-6c6f7de8841f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:30.490500 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-98c09f87-3029-4fbf-8d4e-6c6f7de8841f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:30.496438 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-98c09f87-3029-4fbf-8d4e-6c6f7de8841f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:30.496879 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-98c09f87-3029-4fbf-8d4e-6c6f7de8841f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:30.497640 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-98c09f87-3029-4fbf-8d4e-6c6f7de8841f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:30.498071 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-98c09f87-3029-4fbf-8d4e-6c6f7de8841f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:30.527183 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-98c09f87-3029-4fbf-8d4e-6c6f7de8841f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041979 Jul 11 11:33:30.527674 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 566/1130] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:30 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:33:30.532120 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-976e4723-c9a2-4100-8e11-496ae864518e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:30.532716 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-976e4723-c9a2-4100-8e11-496ae864518e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:30.542397 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-976e4723-c9a2-4100-8e11-496ae864518e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:30.542839 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-976e4723-c9a2-4100-8e11-496ae864518e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:30.543636 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-976e4723-c9a2-4100-8e11-496ae864518e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:30.544068 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-976e4723-c9a2-4100-8e11-496ae864518e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:30.582427 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-9438a291-a42e-445f-b09d-68bdaf2a7d83 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:30.591108 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-9438a291-a42e-445f-b09d-68bdaf2a7d83 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:30.592649 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-9438a291-a42e-445f-b09d-68bdaf2a7d83 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:30.593789 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-9438a291-a42e-445f-b09d-68bdaf2a7d83 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.156837 Jul 11 11:33:30.594356 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 565/1131] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:33:30 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:33:30.670778 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-976e4723-c9a2-4100-8e11-496ae864518e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:30.679146 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-976e4723-c9a2-4100-8e11-496ae864518e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.150553 Jul 11 11:33:30.679731 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 567/1132] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:33:30 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:33:31.295459 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-21690436-4c5d-4404-99c8-5e8e8dc861c9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:31.296383 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-21690436-4c5d-4404-99c8-5e8e8dc861c9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:31.302398 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-21690436-4c5d-4404-99c8-5e8e8dc861c9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:31.302841 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-21690436-4c5d-4404-99c8-5e8e8dc861c9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:31.303625 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-21690436-4c5d-4404-99c8-5e8e8dc861c9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:31.304053 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-21690436-4c5d-4404-99c8-5e8e8dc861c9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:31.332144 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-21690436-4c5d-4404-99c8-5e8e8dc861c9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040675 Jul 11 11:33:31.332676 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 566/1133] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:31 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:33:31.538676 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-95039941-739a-48de-bfed-175f279656cf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:31.539536 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-95039941-739a-48de-bfed-175f279656cf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:31.546052 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-95039941-739a-48de-bfed-175f279656cf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:31.546500 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-95039941-739a-48de-bfed-175f279656cf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:31.547272 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-95039941-739a-48de-bfed-175f279656cf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:31.547705 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-95039941-739a-48de-bfed-175f279656cf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:31.576125 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-95039941-739a-48de-bfed-175f279656cf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041526 Jul 11 11:33:31.576660 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 568/1134] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:31 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:33:31.611855 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-0ef5bf7b-231a-44b1-b50d-26b2c7727b28 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:31.612483 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-0ef5bf7b-231a-44b1-b50d-26b2c7727b28 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:31.618808 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0ef5bf7b-231a-44b1-b50d-26b2c7727b28 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:31.619261 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0ef5bf7b-231a-44b1-b50d-26b2c7727b28 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:31.620032 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0ef5bf7b-231a-44b1-b50d-26b2c7727b28 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:31.620461 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0ef5bf7b-231a-44b1-b50d-26b2c7727b28 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:31.696603 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-071ef7fb-1ca9-42e2-b7f6-69eaaef54df9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:31.696777 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-071ef7fb-1ca9-42e2-b7f6-69eaaef54df9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:31.702643 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-071ef7fb-1ca9-42e2-b7f6-69eaaef54df9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:31.703080 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-071ef7fb-1ca9-42e2-b7f6-69eaaef54df9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:31.703886 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-071ef7fb-1ca9-42e2-b7f6-69eaaef54df9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:31.704312 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-071ef7fb-1ca9-42e2-b7f6-69eaaef54df9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:31.746720 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-0ef5bf7b-231a-44b1-b50d-26b2c7727b28 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:31.755610 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-0ef5bf7b-231a-44b1-b50d-26b2c7727b28 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:31.757156 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-0ef5bf7b-231a-44b1-b50d-26b2c7727b28 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:31.758350 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-0ef5bf7b-231a-44b1-b50d-26b2c7727b28 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.150275 Jul 11 11:33:31.758911 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 567/1135] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:33:31 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 11:33:31.832541 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-071ef7fb-1ca9-42e2-b7f6-69eaaef54df9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:31.840335 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-071ef7fb-1ca9-42e2-b7f6-69eaaef54df9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.147973 Jul 11 11:33:31.840897 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 569/1136] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:33:31 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:33:32.343231 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-c49703e3-a9c5-499a-8592-e64303fa50d5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:32.344186 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-c49703e3-a9c5-499a-8592-e64303fa50d5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:32.351008 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c49703e3-a9c5-499a-8592-e64303fa50d5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:32.351497 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c49703e3-a9c5-499a-8592-e64303fa50d5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:32.352261 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c49703e3-a9c5-499a-8592-e64303fa50d5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:32.352702 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c49703e3-a9c5-499a-8592-e64303fa50d5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:32.381200 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-c49703e3-a9c5-499a-8592-e64303fa50d5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041936 Jul 11 11:33:32.381740 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 568/1137] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:32 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:33:32.588412 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-90096d6f-7f6f-4f1d-b8ff-2bd0c1be80dc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:32.589321 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-90096d6f-7f6f-4f1d-b8ff-2bd0c1be80dc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:32.596449 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-90096d6f-7f6f-4f1d-b8ff-2bd0c1be80dc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:32.596833 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-90096d6f-7f6f-4f1d-b8ff-2bd0c1be80dc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:32.597583 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-90096d6f-7f6f-4f1d-b8ff-2bd0c1be80dc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:32.598007 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-90096d6f-7f6f-4f1d-b8ff-2bd0c1be80dc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:32.625376 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-90096d6f-7f6f-4f1d-b8ff-2bd0c1be80dc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040959 Jul 11 11:33:32.625913 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 570/1138] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:32 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:33:32.777271 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-4541140a-a5d7-42ca-b7d1-20528572a5c3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:32.777872 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-4541140a-a5d7-42ca-b7d1-20528572a5c3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:32.784899 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4541140a-a5d7-42ca-b7d1-20528572a5c3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:32.785342 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4541140a-a5d7-42ca-b7d1-20528572a5c3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:32.786088 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4541140a-a5d7-42ca-b7d1-20528572a5c3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:32.786515 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4541140a-a5d7-42ca-b7d1-20528572a5c3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:32.856906 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-436456b5-b03c-43c3-b709-993b9a5f3698 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:32.857426 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-436456b5-b03c-43c3-b709-993b9a5f3698 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:32.863393 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-436456b5-b03c-43c3-b709-993b9a5f3698 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:32.863837 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-436456b5-b03c-43c3-b709-993b9a5f3698 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:32.864586 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-436456b5-b03c-43c3-b709-993b9a5f3698 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:32.865014 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-436456b5-b03c-43c3-b709-993b9a5f3698 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:32.913498 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-4541140a-a5d7-42ca-b7d1-20528572a5c3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:32.922013 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-4541140a-a5d7-42ca-b7d1-20528572a5c3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:32.923586 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-4541140a-a5d7-42ca-b7d1-20528572a5c3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:32.924750 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-4541140a-a5d7-42ca-b7d1-20528572a5c3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.151377 Jul 11 11:33:32.925453 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 569/1139] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:33:32 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:33:32.998798 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-436456b5-b03c-43c3-b709-993b9a5f3698 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:33.010891 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-436456b5-b03c-43c3-b709-993b9a5f3698 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.157835 Jul 11 11:33:33.011498 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 571/1140] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:33:32 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:33:33.392782 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-560a0607-75a2-42ce-a143-5534ffc8a01d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:33.393713 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-560a0607-75a2-42ce-a143-5534ffc8a01d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:33.399700 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-560a0607-75a2-42ce-a143-5534ffc8a01d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:33.400147 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-560a0607-75a2-42ce-a143-5534ffc8a01d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:33.400909 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-560a0607-75a2-42ce-a143-5534ffc8a01d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:33.401348 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-560a0607-75a2-42ce-a143-5534ffc8a01d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:33.429359 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-560a0607-75a2-42ce-a143-5534ffc8a01d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040589 Jul 11 11:33:33.429901 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 570/1141] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:33 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:33:33.636101 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-7fb3bc66-6e92-4b5a-b37e-a461174ac871 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:33.637020 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-7fb3bc66-6e92-4b5a-b37e-a461174ac871 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:33.643539 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7fb3bc66-6e92-4b5a-b37e-a461174ac871 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:33.643929 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7fb3bc66-6e92-4b5a-b37e-a461174ac871 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:33.644673 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7fb3bc66-6e92-4b5a-b37e-a461174ac871 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:33.645101 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7fb3bc66-6e92-4b5a-b37e-a461174ac871 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:33.673796 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-7fb3bc66-6e92-4b5a-b37e-a461174ac871 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041108 Jul 11 11:33:33.674428 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 572/1142] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:33 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:33:33.943208 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-b1727b21-ce0f-4a55-aab9-6ea535984e57 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:33.943837 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-b1727b21-ce0f-4a55-aab9-6ea535984e57 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:33.950278 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b1727b21-ce0f-4a55-aab9-6ea535984e57 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:33.950727 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b1727b21-ce0f-4a55-aab9-6ea535984e57 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:33.951512 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b1727b21-ce0f-4a55-aab9-6ea535984e57 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:33.951943 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b1727b21-ce0f-4a55-aab9-6ea535984e57 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:34.029664 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-eb31d5e8-8a56-43cc-a68e-b74b9b27300d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:34.030729 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-eb31d5e8-8a56-43cc-a68e-b74b9b27300d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:34.037052 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-eb31d5e8-8a56-43cc-a68e-b74b9b27300d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:34.037428 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-eb31d5e8-8a56-43cc-a68e-b74b9b27300d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:34.038196 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-eb31d5e8-8a56-43cc-a68e-b74b9b27300d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:34.038618 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-eb31d5e8-8a56-43cc-a68e-b74b9b27300d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:34.098716 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-b1727b21-ce0f-4a55-aab9-6ea535984e57 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:34.107459 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-b1727b21-ce0f-4a55-aab9-6ea535984e57 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:34.108961 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-b1727b21-ce0f-4a55-aab9-6ea535984e57 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:34.110206 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-b1727b21-ce0f-4a55-aab9-6ea535984e57 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.171137 Jul 11 11:33:34.110765 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 571/1143] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:33:33 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:33:34.182116 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-eb31d5e8-8a56-43cc-a68e-b74b9b27300d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:34.190233 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-eb31d5e8-8a56-43cc-a68e-b74b9b27300d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.164029 Jul 11 11:33:34.192121 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 573/1144] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:33:34 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:33:34.441271 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-e8a6bff8-7732-43a3-b450-a71d5bf29e73 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:34.442112 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-e8a6bff8-7732-43a3-b450-a71d5bf29e73 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:34.448134 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e8a6bff8-7732-43a3-b450-a71d5bf29e73 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:34.448582 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e8a6bff8-7732-43a3-b450-a71d5bf29e73 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:34.449337 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e8a6bff8-7732-43a3-b450-a71d5bf29e73 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:34.449773 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e8a6bff8-7732-43a3-b450-a71d5bf29e73 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:34.478705 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-e8a6bff8-7732-43a3-b450-a71d5bf29e73 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041727 Jul 11 11:33:34.479267 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 572/1145] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:34 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:33:34.685442 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-440f05de-a306-4625-8d00-102f3a4ac104 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:34.686361 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-440f05de-a306-4625-8d00-102f3a4ac104 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:34.693618 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-440f05de-a306-4625-8d00-102f3a4ac104 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:34.694003 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-440f05de-a306-4625-8d00-102f3a4ac104 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:34.694862 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-440f05de-a306-4625-8d00-102f3a4ac104 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:34.695449 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-440f05de-a306-4625-8d00-102f3a4ac104 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:34.724108 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-440f05de-a306-4625-8d00-102f3a4ac104 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042538 Jul 11 11:33:34.724661 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 574/1146] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:34 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:33:35.128463 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-a0830177-1a2a-43d8-b150-c5219ecb4f6b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:35.129074 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-a0830177-1a2a-43d8-b150-c5219ecb4f6b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:35.135539 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a0830177-1a2a-43d8-b150-c5219ecb4f6b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:35.135985 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a0830177-1a2a-43d8-b150-c5219ecb4f6b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:35.136742 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a0830177-1a2a-43d8-b150-c5219ecb4f6b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:35.137179 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a0830177-1a2a-43d8-b150-c5219ecb4f6b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:35.207278 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-6081c386-2d47-4dd5-bb48-804463556ba2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:35.207890 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-6081c386-2d47-4dd5-bb48-804463556ba2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:35.213785 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6081c386-2d47-4dd5-bb48-804463556ba2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:35.214225 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6081c386-2d47-4dd5-bb48-804463556ba2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:35.214970 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6081c386-2d47-4dd5-bb48-804463556ba2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:35.215428 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6081c386-2d47-4dd5-bb48-804463556ba2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:35.262568 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-a0830177-1a2a-43d8-b150-c5219ecb4f6b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:35.270847 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-a0830177-1a2a-43d8-b150-c5219ecb4f6b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:35.272433 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-a0830177-1a2a-43d8-b150-c5219ecb4f6b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:35.273618 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-a0830177-1a2a-43d8-b150-c5219ecb4f6b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.149691 Jul 11 11:33:35.274178 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 573/1147] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:33:35 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:33:35.340610 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-6081c386-2d47-4dd5-bb48-804463556ba2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:35.348803 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-6081c386-2d47-4dd5-bb48-804463556ba2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.145355 Jul 11 11:33:35.349359 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 575/1148] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:33:35 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:33:35.490590 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-67af87f0-9672-47cd-a504-25977c203e00 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:35.491628 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-67af87f0-9672-47cd-a504-25977c203e00 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:35.497889 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-67af87f0-9672-47cd-a504-25977c203e00 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:35.498341 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-67af87f0-9672-47cd-a504-25977c203e00 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:35.499111 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-67af87f0-9672-47cd-a504-25977c203e00 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:35.499585 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-67af87f0-9672-47cd-a504-25977c203e00 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:35.527464 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-67af87f0-9672-47cd-a504-25977c203e00 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041374 Jul 11 11:33:35.528398 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 574/1149] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:35 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:33:35.735607 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-14fde33e-195c-4aa8-b3b8-897cd9f6954b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:35.736555 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-14fde33e-195c-4aa8-b3b8-897cd9f6954b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:35.743316 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-14fde33e-195c-4aa8-b3b8-897cd9f6954b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:35.743772 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-14fde33e-195c-4aa8-b3b8-897cd9f6954b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:35.744531 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-14fde33e-195c-4aa8-b3b8-897cd9f6954b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:35.744964 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-14fde33e-195c-4aa8-b3b8-897cd9f6954b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:35.773453 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-14fde33e-195c-4aa8-b3b8-897cd9f6954b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041908 Jul 11 11:33:35.773999 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 576/1150] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:35 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:33:36.292761 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-9cea721a-dfe4-4f55-846d-194215d60a1d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:36.293386 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-9cea721a-dfe4-4f55-846d-194215d60a1d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:36.299900 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9cea721a-dfe4-4f55-846d-194215d60a1d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:36.300379 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9cea721a-dfe4-4f55-846d-194215d60a1d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:36.301171 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9cea721a-dfe4-4f55-846d-194215d60a1d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:36.301609 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9cea721a-dfe4-4f55-846d-194215d60a1d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:36.366267 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-b54340ae-b86d-4d2c-b18b-4062d3ba48c6 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:36.366876 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-b54340ae-b86d-4d2c-b18b-4062d3ba48c6 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:36.373479 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b54340ae-b86d-4d2c-b18b-4062d3ba48c6 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:36.373973 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b54340ae-b86d-4d2c-b18b-4062d3ba48c6 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:36.374799 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b54340ae-b86d-4d2c-b18b-4062d3ba48c6 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:36.375235 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b54340ae-b86d-4d2c-b18b-4062d3ba48c6 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:36.437442 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-9cea721a-dfe4-4f55-846d-194215d60a1d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:36.446885 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-9cea721a-dfe4-4f55-846d-194215d60a1d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:36.448403 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-9cea721a-dfe4-4f55-846d-194215d60a1d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:36.449572 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-9cea721a-dfe4-4f55-846d-194215d60a1d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.160803 Jul 11 11:33:36.450123 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 575/1151] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:33:36 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:33:36.503947 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-b54340ae-b86d-4d2c-b18b-4062d3ba48c6 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:36.511791 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-b54340ae-b86d-4d2c-b18b-4062d3ba48c6 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.149442 Jul 11 11:33:36.512350 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 577/1152] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:33:36 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:33:36.539103 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-35825759-7925-4b76-ba10-b23d161e55fd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:36.540069 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-35825759-7925-4b76-ba10-b23d161e55fd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:36.545896 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-35825759-7925-4b76-ba10-b23d161e55fd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:36.546344 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-35825759-7925-4b76-ba10-b23d161e55fd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:36.547089 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-35825759-7925-4b76-ba10-b23d161e55fd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:36.547555 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-35825759-7925-4b76-ba10-b23d161e55fd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:36.583780 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-35825759-7925-4b76-ba10-b23d161e55fd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048076 Jul 11 11:33:36.584796 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 576/1153] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:36 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:33:36.785452 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-c893284f-9f4f-4b93-aad2-4302b0f62143 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:36.786361 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-c893284f-9f4f-4b93-aad2-4302b0f62143 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:36.792804 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c893284f-9f4f-4b93-aad2-4302b0f62143 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:36.793246 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c893284f-9f4f-4b93-aad2-4302b0f62143 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:36.793994 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c893284f-9f4f-4b93-aad2-4302b0f62143 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:36.794423 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c893284f-9f4f-4b93-aad2-4302b0f62143 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:36.822774 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-c893284f-9f4f-4b93-aad2-4302b0f62143 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041755 Jul 11 11:33:36.823322 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 578/1154] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:36 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:33:37.467192 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-da8894db-a2b8-4e4b-9806-31ed66e5248f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:37.471485 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-da8894db-a2b8-4e4b-9806-31ed66e5248f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:37.474884 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-da8894db-a2b8-4e4b-9806-31ed66e5248f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:37.475360 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-da8894db-a2b8-4e4b-9806-31ed66e5248f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:37.476107 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-da8894db-a2b8-4e4b-9806-31ed66e5248f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:37.476538 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-da8894db-a2b8-4e4b-9806-31ed66e5248f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:37.528806 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-bb67b2de-9c1d-4ecc-90bb-dc4899c3b648 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:37.529285 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-bb67b2de-9c1d-4ecc-90bb-dc4899c3b648 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:37.535313 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bb67b2de-9c1d-4ecc-90bb-dc4899c3b648 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:37.535765 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bb67b2de-9c1d-4ecc-90bb-dc4899c3b648 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:37.536526 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bb67b2de-9c1d-4ecc-90bb-dc4899c3b648 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:37.536961 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bb67b2de-9c1d-4ecc-90bb-dc4899c3b648 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:37.610162 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-da8894db-a2b8-4e4b-9806-31ed66e5248f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:37.618576 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-da8894db-a2b8-4e4b-9806-31ed66e5248f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:37.620117 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-da8894db-a2b8-4e4b-9806-31ed66e5248f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:37.621279 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-da8894db-a2b8-4e4b-9806-31ed66e5248f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.158218 Jul 11 11:33:37.621840 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 577/1155] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:33:37 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:33:37.627015 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-62e91c70-33f9-409f-94b0-19c42ceb66b2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:37.628018 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-62e91c70-33f9-409f-94b0-19c42ceb66b2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:37.634064 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-62e91c70-33f9-409f-94b0-19c42ceb66b2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:37.634535 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-62e91c70-33f9-409f-94b0-19c42ceb66b2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:37.635357 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-62e91c70-33f9-409f-94b0-19c42ceb66b2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:37.635809 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-62e91c70-33f9-409f-94b0-19c42ceb66b2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:37.665380 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-62e91c70-33f9-409f-94b0-19c42ceb66b2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042504 Jul 11 11:33:37.667659 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 578/1156] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:37 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:33:37.668605 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-bb67b2de-9c1d-4ecc-90bb-dc4899c3b648 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:37.676373 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-bb67b2de-9c1d-4ecc-90bb-dc4899c3b648 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.151552 Jul 11 11:33:37.680190 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 579/1157] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:33:37 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:33:37.834553 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-40c75f9e-d6d1-4629-b5a6-6c36e3ed1a87 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:37.835432 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-40c75f9e-d6d1-4629-b5a6-6c36e3ed1a87 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:37.841545 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-40c75f9e-d6d1-4629-b5a6-6c36e3ed1a87 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:37.841995 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-40c75f9e-d6d1-4629-b5a6-6c36e3ed1a87 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:37.842760 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-40c75f9e-d6d1-4629-b5a6-6c36e3ed1a87 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:37.843199 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-40c75f9e-d6d1-4629-b5a6-6c36e3ed1a87 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:37.871505 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-40c75f9e-d6d1-4629-b5a6-6c36e3ed1a87 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040946 Jul 11 11:33:37.872049 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 579/1158] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:37 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:33:38.640202 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-8adba061-166a-4af1-b262-d8e08efb1775 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:38.640790 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-8adba061-166a-4af1-b262-d8e08efb1775 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:38.647291 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8adba061-166a-4af1-b262-d8e08efb1775 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:38.647741 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8adba061-166a-4af1-b262-d8e08efb1775 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:38.648497 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8adba061-166a-4af1-b262-d8e08efb1775 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:38.648928 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8adba061-166a-4af1-b262-d8e08efb1775 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:38.666322 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=100 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:33:38.678502 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-b7f6d3c6-835a-43a5-9af4-b54a1aba21cc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:38.683969 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-b7f6d3c6-835a-43a5-9af4-b54a1aba21cc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:38.685989 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b7f6d3c6-835a-43a5-9af4-b54a1aba21cc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:38.686433 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b7f6d3c6-835a-43a5-9af4-b54a1aba21cc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:38.687188 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b7f6d3c6-835a-43a5-9af4-b54a1aba21cc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:38.687642 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b7f6d3c6-835a-43a5-9af4-b54a1aba21cc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:38.705461 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=100 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:33:38.717747 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-b7f6d3c6-835a-43a5-9af4-b54a1aba21cc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043124 Jul 11 11:33:38.718308 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 580/1159] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:38 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:33:38.722946 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-e3d83214-ff5f-4800-acc0-091f5a2a4212 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:38.723599 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-e3d83214-ff5f-4800-acc0-091f5a2a4212 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:38.729434 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e3d83214-ff5f-4800-acc0-091f5a2a4212 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:38.729880 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e3d83214-ff5f-4800-acc0-091f5a2a4212 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:38.730631 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e3d83214-ff5f-4800-acc0-091f5a2a4212 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:38.731058 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e3d83214-ff5f-4800-acc0-091f5a2a4212 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:38.778955 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-8adba061-166a-4af1-b262-d8e08efb1775 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:38.787788 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-8adba061-166a-4af1-b262-d8e08efb1775 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:38.789295 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-8adba061-166a-4af1-b262-d8e08efb1775 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:38.790453 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-8adba061-166a-4af1-b262-d8e08efb1775 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.154334 Jul 11 11:33:38.791022 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 580/1160] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:33:38 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:33:38.874248 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-e3d83214-ff5f-4800-acc0-091f5a2a4212 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:38.882779 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-e3d83214-ff5f-4800-acc0-091f5a2a4212 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.163501 Jul 11 11:33:38.883106 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-ed56966e-fbfd-493a-aaab-a117747c7443 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:38.883364 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 581/1161] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:33:38 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:33:38.884062 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-ed56966e-fbfd-493a-aaab-a117747c7443 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:38.890718 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ed56966e-fbfd-493a-aaab-a117747c7443 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:38.891369 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ed56966e-fbfd-493a-aaab-a117747c7443 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:38.892260 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ed56966e-fbfd-493a-aaab-a117747c7443 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:38.892693 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ed56966e-fbfd-493a-aaab-a117747c7443 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:38.920494 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-ed56966e-fbfd-493a-aaab-a117747c7443 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041702 Jul 11 11:33:38.921042 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 581/1162] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:38 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:33:39.729686 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-5b19d599-ad72-4f92-8a8e-b90b47765388 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:39.730666 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-5b19d599-ad72-4f92-8a8e-b90b47765388 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:39.737222 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5b19d599-ad72-4f92-8a8e-b90b47765388 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:39.737710 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5b19d599-ad72-4f92-8a8e-b90b47765388 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:39.738848 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5b19d599-ad72-4f92-8a8e-b90b47765388 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:39.739602 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5b19d599-ad72-4f92-8a8e-b90b47765388 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:39.774474 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-5b19d599-ad72-4f92-8a8e-b90b47765388 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048798 Jul 11 11:33:39.775045 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 582/1163] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:39 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:33:39.809866 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-75a2a53d-f757-4407-af5e-8a58b3a36a15 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:39.810481 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-75a2a53d-f757-4407-af5e-8a58b3a36a15 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:39.817962 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-75a2a53d-f757-4407-af5e-8a58b3a36a15 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:39.818416 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-75a2a53d-f757-4407-af5e-8a58b3a36a15 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:39.819184 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-75a2a53d-f757-4407-af5e-8a58b3a36a15 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:39.819655 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-75a2a53d-f757-4407-af5e-8a58b3a36a15 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:39.899430 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-0d978ea8-0c2a-4957-bf4d-1bc98186df20 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:39.900118 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-0d978ea8-0c2a-4957-bf4d-1bc98186df20 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:39.906565 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0d978ea8-0c2a-4957-bf4d-1bc98186df20 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:39.907024 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0d978ea8-0c2a-4957-bf4d-1bc98186df20 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:39.907832 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0d978ea8-0c2a-4957-bf4d-1bc98186df20 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:39.908267 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0d978ea8-0c2a-4957-bf4d-1bc98186df20 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:39.957564 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-75a2a53d-f757-4407-af5e-8a58b3a36a15 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:39.966222 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-75a2a53d-f757-4407-af5e-8a58b3a36a15 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:39.967767 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-75a2a53d-f757-4407-af5e-8a58b3a36a15 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:39.968913 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-75a2a53d-f757-4407-af5e-8a58b3a36a15 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.163426 Jul 11 11:33:39.969470 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 582/1164] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:33:39 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:33:39.974501 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-f89061fd-058a-4e65-b395-cca57c04bc8d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:39.974881 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-f89061fd-058a-4e65-b395-cca57c04bc8d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:39.980647 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f89061fd-058a-4e65-b395-cca57c04bc8d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:39.981098 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f89061fd-058a-4e65-b395-cca57c04bc8d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:39.981892 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f89061fd-058a-4e65-b395-cca57c04bc8d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:39.982325 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f89061fd-058a-4e65-b395-cca57c04bc8d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:40.012254 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-f89061fd-058a-4e65-b395-cca57c04bc8d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041750 Jul 11 11:33:40.012825 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 583/1165] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:39 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:33:40.043786 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-0d978ea8-0c2a-4957-bf4d-1bc98186df20 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:40.055073 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-0d978ea8-0c2a-4957-bf4d-1bc98186df20 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.158304 Jul 11 11:33:40.055716 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 583/1166] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:33:39 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:33:40.786364 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-b072fe81-f47c-49ed-baf7-702bebff1a8b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:40.787293 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-b072fe81-f47c-49ed-baf7-702bebff1a8b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:40.793934 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b072fe81-f47c-49ed-baf7-702bebff1a8b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:40.794410 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b072fe81-f47c-49ed-baf7-702bebff1a8b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:40.795179 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b072fe81-f47c-49ed-baf7-702bebff1a8b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:40.795653 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b072fe81-f47c-49ed-baf7-702bebff1a8b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:40.825293 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-b072fe81-f47c-49ed-baf7-702bebff1a8b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043143 Jul 11 11:33:40.825950 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 584/1167] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:40 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:33:40.988060 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-fb3ae9db-fda7-4bb8-a18d-75cc61b68c05 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:40.994737 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-fb3ae9db-fda7-4bb8-a18d-75cc61b68c05 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:40.996345 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fb3ae9db-fda7-4bb8-a18d-75cc61b68c05 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:40.996984 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fb3ae9db-fda7-4bb8-a18d-75cc61b68c05 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:40.997749 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fb3ae9db-fda7-4bb8-a18d-75cc61b68c05 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:40.998185 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fb3ae9db-fda7-4bb8-a18d-75cc61b68c05 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:41.023928 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-765fa5b2-15f6-4e34-90c7-e4b3a323ba64 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:41.029034 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-765fa5b2-15f6-4e34-90c7-e4b3a323ba64 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:41.031035 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-765fa5b2-15f6-4e34-90c7-e4b3a323ba64 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:41.031521 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-765fa5b2-15f6-4e34-90c7-e4b3a323ba64 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:41.032354 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-765fa5b2-15f6-4e34-90c7-e4b3a323ba64 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:41.032778 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-765fa5b2-15f6-4e34-90c7-e4b3a323ba64 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:41.063047 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-765fa5b2-15f6-4e34-90c7-e4b3a323ba64 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042901 Jul 11 11:33:41.063562 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 585/1168] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:41 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:33:41.071862 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-c3386749-d6f5-43a5-bf9d-f2ef77ea1eb2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:41.072463 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-c3386749-d6f5-43a5-bf9d-f2ef77ea1eb2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:41.078452 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c3386749-d6f5-43a5-bf9d-f2ef77ea1eb2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:41.078892 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c3386749-d6f5-43a5-bf9d-f2ef77ea1eb2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:41.079681 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c3386749-d6f5-43a5-bf9d-f2ef77ea1eb2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:41.080108 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c3386749-d6f5-43a5-bf9d-f2ef77ea1eb2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:41.148206 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-fb3ae9db-fda7-4bb8-a18d-75cc61b68c05 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:41.157585 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-fb3ae9db-fda7-4bb8-a18d-75cc61b68c05 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:41.159092 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-fb3ae9db-fda7-4bb8-a18d-75cc61b68c05 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:41.160282 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-fb3ae9db-fda7-4bb8-a18d-75cc61b68c05 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.176699 Jul 11 11:33:41.160847 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 584/1169] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:33:40 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:33:41.221115 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-c3386749-d6f5-43a5-bf9d-f2ef77ea1eb2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:41.229151 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-c3386749-d6f5-43a5-bf9d-f2ef77ea1eb2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.161018 Jul 11 11:33:41.229731 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 586/1170] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:33:41 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:33:41.836780 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-04de215e-6d05-45b5-ad39-22855711a81e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:41.837720 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-04de215e-6d05-45b5-ad39-22855711a81e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:41.843780 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-04de215e-6d05-45b5-ad39-22855711a81e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:41.844234 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-04de215e-6d05-45b5-ad39-22855711a81e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:41.845000 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-04de215e-6d05-45b5-ad39-22855711a81e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:41.846025 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-04de215e-6d05-45b5-ad39-22855711a81e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:41.873665 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-04de215e-6d05-45b5-ad39-22855711a81e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040829 Jul 11 11:33:41.874211 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 585/1171] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:41 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:33:42.075496 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-449a3833-b4fb-499d-bf48-a7c4d8c596fa tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:42.076443 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-449a3833-b4fb-499d-bf48-a7c4d8c596fa tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:42.083816 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-449a3833-b4fb-499d-bf48-a7c4d8c596fa tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:42.084266 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-449a3833-b4fb-499d-bf48-a7c4d8c596fa tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:42.085028 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-449a3833-b4fb-499d-bf48-a7c4d8c596fa tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:42.085464 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-449a3833-b4fb-499d-bf48-a7c4d8c596fa tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:42.114803 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-449a3833-b4fb-499d-bf48-a7c4d8c596fa tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043276 Jul 11 11:33:42.115299 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 587/1172] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:42 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:33:42.178162 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-947dcdd6-8bc0-424b-96f2-4d34d87f2fcd tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:42.178787 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-947dcdd6-8bc0-424b-96f2-4d34d87f2fcd tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:42.185442 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-947dcdd6-8bc0-424b-96f2-4d34d87f2fcd tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:42.185893 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-947dcdd6-8bc0-424b-96f2-4d34d87f2fcd tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:42.186650 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-947dcdd6-8bc0-424b-96f2-4d34d87f2fcd tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:42.187094 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-947dcdd6-8bc0-424b-96f2-4d34d87f2fcd tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:42.246865 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-51110bcb-e4f6-4835-85e8-75ed1205e545 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:42.247506 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-51110bcb-e4f6-4835-85e8-75ed1205e545 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:42.253960 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-51110bcb-e4f6-4835-85e8-75ed1205e545 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:42.254404 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-51110bcb-e4f6-4835-85e8-75ed1205e545 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:42.255165 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-51110bcb-e4f6-4835-85e8-75ed1205e545 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:42.255622 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-51110bcb-e4f6-4835-85e8-75ed1205e545 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:42.320435 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-947dcdd6-8bc0-424b-96f2-4d34d87f2fcd tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:42.328833 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-947dcdd6-8bc0-424b-96f2-4d34d87f2fcd tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:42.330910 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-947dcdd6-8bc0-424b-96f2-4d34d87f2fcd tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:42.332202 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-947dcdd6-8bc0-424b-96f2-4d34d87f2fcd tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.157975 Jul 11 11:33:42.332764 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 586/1173] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:33:42 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:33:42.381503 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-51110bcb-e4f6-4835-85e8-75ed1205e545 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:42.389605 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-51110bcb-e4f6-4835-85e8-75ed1205e545 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.146512 Jul 11 11:33:42.390176 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 588/1174] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:33:42 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:33:42.885101 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-e8ee7dbf-6254-46a9-9add-96eae8dfba36 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:42.886034 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-e8ee7dbf-6254-46a9-9add-96eae8dfba36 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:42.892400 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e8ee7dbf-6254-46a9-9add-96eae8dfba36 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:42.892849 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e8ee7dbf-6254-46a9-9add-96eae8dfba36 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:42.893611 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e8ee7dbf-6254-46a9-9add-96eae8dfba36 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:42.894052 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e8ee7dbf-6254-46a9-9add-96eae8dfba36 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:42.922948 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-e8ee7dbf-6254-46a9-9add-96eae8dfba36 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041873 Jul 11 11:33:42.924154 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 587/1175] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:42 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:33:43.125788 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-b079a181-d964-4ddc-a546-924fd0343f92 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:43.126742 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-b079a181-d964-4ddc-a546-924fd0343f92 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:43.133383 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b079a181-d964-4ddc-a546-924fd0343f92 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:43.133818 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b079a181-d964-4ddc-a546-924fd0343f92 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:43.134562 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b079a181-d964-4ddc-a546-924fd0343f92 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:43.134994 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b079a181-d964-4ddc-a546-924fd0343f92 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:43.164223 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-b079a181-d964-4ddc-a546-924fd0343f92 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042376 Jul 11 11:33:43.164770 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 589/1176] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:43 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:33:43.350364 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-32532e4a-c556-44ee-95cf-2e2f495a4c8a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:43.350970 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-32532e4a-c556-44ee-95cf-2e2f495a4c8a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:43.357510 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-32532e4a-c556-44ee-95cf-2e2f495a4c8a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:43.357955 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-32532e4a-c556-44ee-95cf-2e2f495a4c8a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:43.358714 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-32532e4a-c556-44ee-95cf-2e2f495a4c8a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:43.359147 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-32532e4a-c556-44ee-95cf-2e2f495a4c8a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:43.407006 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-0015b7d9-43d4-4b76-adcb-f116188e5ba2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:43.407804 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-0015b7d9-43d4-4b76-adcb-f116188e5ba2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:43.415735 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0015b7d9-43d4-4b76-adcb-f116188e5ba2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:43.416115 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0015b7d9-43d4-4b76-adcb-f116188e5ba2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:43.416917 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0015b7d9-43d4-4b76-adcb-f116188e5ba2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:43.417344 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0015b7d9-43d4-4b76-adcb-f116188e5ba2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:43.493674 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-32532e4a-c556-44ee-95cf-2e2f495a4c8a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:43.505112 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-32532e4a-c556-44ee-95cf-2e2f495a4c8a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:43.506621 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-32532e4a-c556-44ee-95cf-2e2f495a4c8a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:43.507835 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-32532e4a-c556-44ee-95cf-2e2f495a4c8a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.161422 Jul 11 11:33:43.519117 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 588/1177] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:33:43 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:33:43.561904 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-0015b7d9-43d4-4b76-adcb-f116188e5ba2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:43.571073 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-0015b7d9-43d4-4b76-adcb-f116188e5ba2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.168291 Jul 11 11:33:43.576679 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 590/1178] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:33:43 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:33:43.935296 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-13d01174-32c1-4d61-b144-7d375075e886 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:43.936226 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-13d01174-32c1-4d61-b144-7d375075e886 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:43.943166 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-13d01174-32c1-4d61-b144-7d375075e886 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:43.943646 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-13d01174-32c1-4d61-b144-7d375075e886 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:43.944407 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-13d01174-32c1-4d61-b144-7d375075e886 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:43.944841 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-13d01174-32c1-4d61-b144-7d375075e886 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:43.972676 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-13d01174-32c1-4d61-b144-7d375075e886 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041348 Jul 11 11:33:43.973231 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 589/1179] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:43 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:33:44.176738 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-07ab8385-3737-4adc-a328-30d15fdbdf44 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:44.177665 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-07ab8385-3737-4adc-a328-30d15fdbdf44 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:44.184380 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-07ab8385-3737-4adc-a328-30d15fdbdf44 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:44.185490 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-07ab8385-3737-4adc-a328-30d15fdbdf44 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:44.185644 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-07ab8385-3737-4adc-a328-30d15fdbdf44 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:44.185998 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-07ab8385-3737-4adc-a328-30d15fdbdf44 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:44.218666 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-07ab8385-3737-4adc-a328-30d15fdbdf44 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046407 Jul 11 11:33:44.219217 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 591/1180] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:44 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:33:44.526689 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-cb5f1aa9-0af3-4099-84a5-0bca8c30d06c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:44.527243 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-cb5f1aa9-0af3-4099-84a5-0bca8c30d06c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:44.534251 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cb5f1aa9-0af3-4099-84a5-0bca8c30d06c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:44.534704 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cb5f1aa9-0af3-4099-84a5-0bca8c30d06c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:44.535503 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cb5f1aa9-0af3-4099-84a5-0bca8c30d06c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:44.535947 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cb5f1aa9-0af3-4099-84a5-0bca8c30d06c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:44.594147 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-1960db81-8eae-44b6-8b9b-04554082bad9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:44.595023 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-1960db81-8eae-44b6-8b9b-04554082bad9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:44.604176 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1960db81-8eae-44b6-8b9b-04554082bad9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:44.605413 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1960db81-8eae-44b6-8b9b-04554082bad9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:44.605916 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1960db81-8eae-44b6-8b9b-04554082bad9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:44.606458 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1960db81-8eae-44b6-8b9b-04554082bad9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:44.686079 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-cb5f1aa9-0af3-4099-84a5-0bca8c30d06c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:44.695551 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-cb5f1aa9-0af3-4099-84a5-0bca8c30d06c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:44.697028 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-cb5f1aa9-0af3-4099-84a5-0bca8c30d06c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:44.698189 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-cb5f1aa9-0af3-4099-84a5-0bca8c30d06c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.175520 Jul 11 11:33:44.698747 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 590/1181] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:33:44 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:33:44.738861 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-1960db81-8eae-44b6-8b9b-04554082bad9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:44.746708 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-1960db81-8eae-44b6-8b9b-04554082bad9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.156926 Jul 11 11:33:44.747294 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 592/1182] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:33:44 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:33:44.983845 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-a466ad02-e025-4083-b0cb-c5e9fae9a18e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:44.984765 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-a466ad02-e025-4083-b0cb-c5e9fae9a18e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:44.991569 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a466ad02-e025-4083-b0cb-c5e9fae9a18e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:44.997128 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a466ad02-e025-4083-b0cb-c5e9fae9a18e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:44.997128 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a466ad02-e025-4083-b0cb-c5e9fae9a18e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:44.997128 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a466ad02-e025-4083-b0cb-c5e9fae9a18e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:45.022308 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-a466ad02-e025-4083-b0cb-c5e9fae9a18e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042328 Jul 11 11:33:45.022887 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 591/1183] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:44 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:33:45.230769 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-4f54992c-aafb-4885-a657-00344b005420 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:45.231718 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-4f54992c-aafb-4885-a657-00344b005420 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:45.238392 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4f54992c-aafb-4885-a657-00344b005420 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:45.238782 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4f54992c-aafb-4885-a657-00344b005420 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:45.239572 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4f54992c-aafb-4885-a657-00344b005420 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:45.240006 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4f54992c-aafb-4885-a657-00344b005420 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:45.269459 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-4f54992c-aafb-4885-a657-00344b005420 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042682 Jul 11 11:33:45.270013 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 593/1184] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:45 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:33:45.716417 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-ad53ac17-af5b-4a1c-9c68-f753945535c3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:45.717025 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-ad53ac17-af5b-4a1c-9c68-f753945535c3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:45.723929 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ad53ac17-af5b-4a1c-9c68-f753945535c3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:45.724403 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ad53ac17-af5b-4a1c-9c68-f753945535c3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:45.725160 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ad53ac17-af5b-4a1c-9c68-f753945535c3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:45.725587 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ad53ac17-af5b-4a1c-9c68-f753945535c3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:45.764536 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-5211c519-4afd-410d-9713-05fff3b5988d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:45.765150 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-5211c519-4afd-410d-9713-05fff3b5988d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:45.771344 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5211c519-4afd-410d-9713-05fff3b5988d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:45.771798 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5211c519-4afd-410d-9713-05fff3b5988d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:45.772570 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5211c519-4afd-410d-9713-05fff3b5988d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:45.773006 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5211c519-4afd-410d-9713-05fff3b5988d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:45.862427 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-ad53ac17-af5b-4a1c-9c68-f753945535c3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:45.871040 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-ad53ac17-af5b-4a1c-9c68-f753945535c3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:45.872558 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-ad53ac17-af5b-4a1c-9c68-f753945535c3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:45.873721 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-ad53ac17-af5b-4a1c-9c68-f753945535c3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.161315 Jul 11 11:33:45.874564 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 592/1185] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:33:45 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:33:45.907365 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-5211c519-4afd-410d-9713-05fff3b5988d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:45.916045 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-5211c519-4afd-410d-9713-05fff3b5988d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.155327 Jul 11 11:33:45.916653 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 594/1186] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:33:45 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:33:46.033750 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-82543054-7c41-4d61-903f-7e6be68f8fcc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:46.034671 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-82543054-7c41-4d61-903f-7e6be68f8fcc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:46.040780 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-82543054-7c41-4d61-903f-7e6be68f8fcc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:46.041221 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-82543054-7c41-4d61-903f-7e6be68f8fcc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:46.042084 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-82543054-7c41-4d61-903f-7e6be68f8fcc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:46.042518 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-82543054-7c41-4d61-903f-7e6be68f8fcc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:46.072366 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-82543054-7c41-4d61-903f-7e6be68f8fcc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043110 Jul 11 11:33:46.072950 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 593/1187] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:46 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:33:46.281293 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-0bed9957-d16d-4c31-9a49-efeef4a957e1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:46.282217 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-0bed9957-d16d-4c31-9a49-efeef4a957e1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:46.289304 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0bed9957-d16d-4c31-9a49-efeef4a957e1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:46.289755 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0bed9957-d16d-4c31-9a49-efeef4a957e1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:46.290526 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0bed9957-d16d-4c31-9a49-efeef4a957e1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:46.290963 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0bed9957-d16d-4c31-9a49-efeef4a957e1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:46.320125 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-0bed9957-d16d-4c31-9a49-efeef4a957e1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042819 Jul 11 11:33:46.320679 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 595/1188] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:46 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:33:46.891736 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-5653d0d1-fab1-444b-a50b-5bc5fff473c4 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:46.892371 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-5653d0d1-fab1-444b-a50b-5bc5fff473c4 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:46.898799 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5653d0d1-fab1-444b-a50b-5bc5fff473c4 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:46.899241 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5653d0d1-fab1-444b-a50b-5bc5fff473c4 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:46.900022 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5653d0d1-fab1-444b-a50b-5bc5fff473c4 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:46.900449 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5653d0d1-fab1-444b-a50b-5bc5fff473c4 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:46.933707 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-c7313ed8-20c1-4238-b61e-653732c5d457 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:46.934434 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-c7313ed8-20c1-4238-b61e-653732c5d457 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:46.942932 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c7313ed8-20c1-4238-b61e-653732c5d457 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:46.943405 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c7313ed8-20c1-4238-b61e-653732c5d457 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:46.944177 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c7313ed8-20c1-4238-b61e-653732c5d457 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:46.944609 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c7313ed8-20c1-4238-b61e-653732c5d457 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:47.032310 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-5653d0d1-fab1-444b-a50b-5bc5fff473c4 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:47.043292 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-5653d0d1-fab1-444b-a50b-5bc5fff473c4 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:47.048668 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-5653d0d1-fab1-444b-a50b-5bc5fff473c4 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:47.048668 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-5653d0d1-fab1-444b-a50b-5bc5fff473c4 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.158273 Jul 11 11:33:47.048668 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 594/1189] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:33:46 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:33:47.077518 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-c7313ed8-20c1-4238-b61e-653732c5d457 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:47.083567 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-c7313ed8-20c1-4238-b61e-653732c5d457 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.153637 Jul 11 11:33:47.084146 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 596/1190] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:33:46 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:33:47.084942 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-33fd9d6c-1b1c-4692-baec-db3cdfbbbe8a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:47.085883 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-33fd9d6c-1b1c-4692-baec-db3cdfbbbe8a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:47.092157 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-33fd9d6c-1b1c-4692-baec-db3cdfbbbe8a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:47.092608 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-33fd9d6c-1b1c-4692-baec-db3cdfbbbe8a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:47.093379 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-33fd9d6c-1b1c-4692-baec-db3cdfbbbe8a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:47.093812 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-33fd9d6c-1b1c-4692-baec-db3cdfbbbe8a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:47.123034 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-33fd9d6c-1b1c-4692-baec-db3cdfbbbe8a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042276 Jul 11 11:33:47.123655 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 595/1191] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:47 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:33:47.332445 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-bcf9f859-7323-42a5-af5f-ab441710f073 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:47.333283 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-bcf9f859-7323-42a5-af5f-ab441710f073 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:47.339793 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bcf9f859-7323-42a5-af5f-ab441710f073 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:47.340246 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bcf9f859-7323-42a5-af5f-ab441710f073 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:47.341007 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bcf9f859-7323-42a5-af5f-ab441710f073 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:47.341451 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bcf9f859-7323-42a5-af5f-ab441710f073 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:47.345109 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=100 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:33:47.370190 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-bcf9f859-7323-42a5-af5f-ab441710f073 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042439 Jul 11 11:33:47.370744 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 597/1192] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:47 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:33:48.064995 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-0bb5496f-2378-48ca-aa38-f8ab5ebea1f1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:48.065902 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-0bb5496f-2378-48ca-aa38-f8ab5ebea1f1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:48.072427 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0bb5496f-2378-48ca-aa38-f8ab5ebea1f1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:48.072877 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0bb5496f-2378-48ca-aa38-f8ab5ebea1f1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:48.074067 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0bb5496f-2378-48ca-aa38-f8ab5ebea1f1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:48.074067 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0bb5496f-2378-48ca-aa38-f8ab5ebea1f1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:48.101572 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-97665ae4-56db-4955-b73b-a96c4ef80eb6 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:48.102324 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-97665ae4-56db-4955-b73b-a96c4ef80eb6 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:48.108995 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-97665ae4-56db-4955-b73b-a96c4ef80eb6 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:48.109447 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-97665ae4-56db-4955-b73b-a96c4ef80eb6 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:48.110246 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-97665ae4-56db-4955-b73b-a96c4ef80eb6 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:48.110686 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-97665ae4-56db-4955-b73b-a96c4ef80eb6 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:48.214477 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-0bb5496f-2378-48ca-aa38-f8ab5ebea1f1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:48.223422 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-0bb5496f-2378-48ca-aa38-f8ab5ebea1f1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:48.224969 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-0bb5496f-2378-48ca-aa38-f8ab5ebea1f1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:48.226136 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-0bb5496f-2378-48ca-aa38-f8ab5ebea1f1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.165274 Jul 11 11:33:48.226708 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 596/1193] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:33:48 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:33:48.231660 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-874373ee-29a3-4841-ac8d-23e873984d06 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:48.233273 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-874373ee-29a3-4841-ac8d-23e873984d06 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:48.239741 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-874373ee-29a3-4841-ac8d-23e873984d06 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:48.240199 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-874373ee-29a3-4841-ac8d-23e873984d06 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:48.240977 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-874373ee-29a3-4841-ac8d-23e873984d06 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:48.241421 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-874373ee-29a3-4841-ac8d-23e873984d06 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:48.245096 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=100 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:33:48.252433 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-97665ae4-56db-4955-b73b-a96c4ef80eb6 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:48.260272 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-97665ae4-56db-4955-b73b-a96c4ef80eb6 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.163200 Jul 11 11:33:48.261075 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 598/1194] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:33:48 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:33:48.270508 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-874373ee-29a3-4841-ac8d-23e873984d06 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042789 Jul 11 11:33:48.271059 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 597/1195] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:48 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:33:48.382232 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-1a721fc4-782d-4c1b-91f3-c949bf8a5aad tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:48.383155 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-1a721fc4-782d-4c1b-91f3-c949bf8a5aad tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:48.389606 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1a721fc4-782d-4c1b-91f3-c949bf8a5aad tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:48.390058 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1a721fc4-782d-4c1b-91f3-c949bf8a5aad tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:48.390822 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1a721fc4-782d-4c1b-91f3-c949bf8a5aad tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:48.391281 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1a721fc4-782d-4c1b-91f3-c949bf8a5aad tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:48.420503 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-1a721fc4-782d-4c1b-91f3-c949bf8a5aad tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042403 Jul 11 11:33:48.421047 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 599/1196] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:48 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:33:49.246406 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-f01b112d-2765-424f-94fc-b7f48c3efc06 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:49.247047 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-f01b112d-2765-424f-94fc-b7f48c3efc06 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:49.254244 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f01b112d-2765-424f-94fc-b7f48c3efc06 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:49.254694 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f01b112d-2765-424f-94fc-b7f48c3efc06 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:49.255491 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f01b112d-2765-424f-94fc-b7f48c3efc06 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:49.255924 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f01b112d-2765-424f-94fc-b7f48c3efc06 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:49.277083 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-2ebeb7d7-9ad3-41ce-8654-71c1efbb0a80 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:49.277978 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-2ebeb7d7-9ad3-41ce-8654-71c1efbb0a80 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:49.284333 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2ebeb7d7-9ad3-41ce-8654-71c1efbb0a80 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:49.284886 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2ebeb7d7-9ad3-41ce-8654-71c1efbb0a80 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:49.285753 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2ebeb7d7-9ad3-41ce-8654-71c1efbb0a80 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:49.296890 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2ebeb7d7-9ad3-41ce-8654-71c1efbb0a80 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:49.386833 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-f01b112d-2765-424f-94fc-b7f48c3efc06 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:49.395318 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-f01b112d-2765-424f-94fc-b7f48c3efc06 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:49.396817 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-f01b112d-2765-424f-94fc-b7f48c3efc06 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:49.397981 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-f01b112d-2765-424f-94fc-b7f48c3efc06 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.155968 Jul 11 11:33:49.398831 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 598/1197] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:33:49 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:33:49.403445 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-fe3ebfb0-5705-45c7-87a2-eba745ffae00 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:49.404337 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-fe3ebfb0-5705-45c7-87a2-eba745ffae00 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:49.410371 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fe3ebfb0-5705-45c7-87a2-eba745ffae00 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:49.410817 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fe3ebfb0-5705-45c7-87a2-eba745ffae00 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:49.411615 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fe3ebfb0-5705-45c7-87a2-eba745ffae00 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:49.412048 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fe3ebfb0-5705-45c7-87a2-eba745ffae00 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:49.442520 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-fe3ebfb0-5705-45c7-87a2-eba745ffae00 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042468 Jul 11 11:33:49.443088 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 599/1198] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:49 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:33:49.447744 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-cc0cd6c5-535d-4735-8b15-faec79105279 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:49.448654 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-cc0cd6c5-535d-4735-8b15-faec79105279 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:49.454738 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cc0cd6c5-535d-4735-8b15-faec79105279 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:49.455179 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cc0cd6c5-535d-4735-8b15-faec79105279 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:49.455967 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cc0cd6c5-535d-4735-8b15-faec79105279 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:49.456396 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cc0cd6c5-535d-4735-8b15-faec79105279 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:49.487162 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-cc0cd6c5-535d-4735-8b15-faec79105279 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043003 Jul 11 11:33:49.487946 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 600/1199] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:49 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:33:49.502421 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-2ebeb7d7-9ad3-41ce-8654-71c1efbb0a80 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:49.511605 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-2ebeb7d7-9ad3-41ce-8654-71c1efbb0a80 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.238190 Jul 11 11:33:49.512278 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 600/1200] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:33:49 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:33:50.416119 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-91631f1f-6674-4c3b-bef4-9662de1b66d1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:50.416727 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-91631f1f-6674-4c3b-bef4-9662de1b66d1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:50.423106 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-91631f1f-6674-4c3b-bef4-9662de1b66d1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:50.423575 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-91631f1f-6674-4c3b-bef4-9662de1b66d1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:50.424323 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-91631f1f-6674-4c3b-bef4-9662de1b66d1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:50.424749 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-91631f1f-6674-4c3b-bef4-9662de1b66d1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:50.453858 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-7005a759-34a4-48d0-9e23-f47c3023e936 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:50.455404 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-7005a759-34a4-48d0-9e23-f47c3023e936 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:50.461897 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7005a759-34a4-48d0-9e23-f47c3023e936 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:50.462344 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7005a759-34a4-48d0-9e23-f47c3023e936 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:50.463104 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7005a759-34a4-48d0-9e23-f47c3023e936 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:50.463565 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7005a759-34a4-48d0-9e23-f47c3023e936 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:50.492016 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-7005a759-34a4-48d0-9e23-f47c3023e936 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041985 Jul 11 11:33:50.492579 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 601/1201] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:50 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:33:50.500149 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-0c9b07d2-0800-471c-ba4e-2179a7468dfc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:50.501056 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-0c9b07d2-0800-471c-ba4e-2179a7468dfc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:50.507679 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0c9b07d2-0800-471c-ba4e-2179a7468dfc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:50.508258 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0c9b07d2-0800-471c-ba4e-2179a7468dfc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:50.508891 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0c9b07d2-0800-471c-ba4e-2179a7468dfc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:50.509464 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0c9b07d2-0800-471c-ba4e-2179a7468dfc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:50.539172 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-0c9b07d2-0800-471c-ba4e-2179a7468dfc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042516 Jul 11 11:33:50.539762 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 602/1202] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:50 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:33:50.544124 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-623f6c8f-39cb-4079-b4fa-b43d4d640e09 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:50.544720 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-623f6c8f-39cb-4079-b4fa-b43d4d640e09 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:50.550378 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-623f6c8f-39cb-4079-b4fa-b43d4d640e09 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:50.550826 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-623f6c8f-39cb-4079-b4fa-b43d4d640e09 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:50.551627 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-623f6c8f-39cb-4079-b4fa-b43d4d640e09 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:50.552069 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-623f6c8f-39cb-4079-b4fa-b43d4d640e09 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:50.562881 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-91631f1f-6674-4c3b-bef4-9662de1b66d1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:50.571980 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-91631f1f-6674-4c3b-bef4-9662de1b66d1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:50.573470 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-91631f1f-6674-4c3b-bef4-9662de1b66d1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:50.574615 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-91631f1f-6674-4c3b-bef4-9662de1b66d1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.162378 Jul 11 11:33:50.575169 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 601/1203] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:33:50 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:33:50.679642 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-623f6c8f-39cb-4079-b4fa-b43d4d640e09 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:50.687541 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-623f6c8f-39cb-4079-b4fa-b43d4d640e09 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.146792 Jul 11 11:33:50.688106 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 603/1204] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:33:50 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:33:51.504353 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-2797368f-a376-422d-baad-20448bc1a118 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:51.505297 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-2797368f-a376-422d-baad-20448bc1a118 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:51.511674 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2797368f-a376-422d-baad-20448bc1a118 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:51.512117 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2797368f-a376-422d-baad-20448bc1a118 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:51.512866 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2797368f-a376-422d-baad-20448bc1a118 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:51.513295 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2797368f-a376-422d-baad-20448bc1a118 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:51.546732 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-2797368f-a376-422d-baad-20448bc1a118 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046797 Jul 11 11:33:51.547311 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 602/1205] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:51 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:33:51.550409 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-0e7db0d2-4d09-4ce5-a29c-be8e12e28b09 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:51.551371 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-0e7db0d2-4d09-4ce5-a29c-be8e12e28b09 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:51.557871 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0e7db0d2-4d09-4ce5-a29c-be8e12e28b09 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:51.558324 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0e7db0d2-4d09-4ce5-a29c-be8e12e28b09 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:51.559089 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0e7db0d2-4d09-4ce5-a29c-be8e12e28b09 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:51.559557 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0e7db0d2-4d09-4ce5-a29c-be8e12e28b09 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:51.588676 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-0e7db0d2-4d09-4ce5-a29c-be8e12e28b09 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042762 Jul 11 11:33:51.589377 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 604/1206] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:51 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:33:51.593391 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-e8f8b4f3-2455-48da-a60c-0b447a4c1f1a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:51.594025 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-e8f8b4f3-2455-48da-a60c-0b447a4c1f1a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:51.599959 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e8f8b4f3-2455-48da-a60c-0b447a4c1f1a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:51.600404 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e8f8b4f3-2455-48da-a60c-0b447a4c1f1a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:51.601161 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e8f8b4f3-2455-48da-a60c-0b447a4c1f1a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:51.601592 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e8f8b4f3-2455-48da-a60c-0b447a4c1f1a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:51.705465 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-3aa6122b-e018-4b11-bbc5-d7b4d5a467f9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:51.706061 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-3aa6122b-e018-4b11-bbc5-d7b4d5a467f9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:51.712039 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3aa6122b-e018-4b11-bbc5-d7b4d5a467f9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:51.712485 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3aa6122b-e018-4b11-bbc5-d7b4d5a467f9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:51.713233 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3aa6122b-e018-4b11-bbc5-d7b4d5a467f9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:51.713662 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3aa6122b-e018-4b11-bbc5-d7b4d5a467f9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:51.727201 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-e8f8b4f3-2455-48da-a60c-0b447a4c1f1a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:51.735558 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-e8f8b4f3-2455-48da-a60c-0b447a4c1f1a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:51.737658 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-e8f8b4f3-2455-48da-a60c-0b447a4c1f1a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:51.738818 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-e8f8b4f3-2455-48da-a60c-0b447a4c1f1a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.149326 Jul 11 11:33:51.739588 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 603/1207] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:33:51 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 11:33:51.838360 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-3aa6122b-e018-4b11-bbc5-d7b4d5a467f9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:51.846730 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-3aa6122b-e018-4b11-bbc5-d7b4d5a467f9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.145155 Jul 11 11:33:51.847302 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 605/1208] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:33:51 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:33:52.558786 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-36e8b158-45c4-4235-8fa5-6a4e059bb257 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:52.559776 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-36e8b158-45c4-4235-8fa5-6a4e059bb257 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:52.567050 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-36e8b158-45c4-4235-8fa5-6a4e059bb257 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:52.567532 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-36e8b158-45c4-4235-8fa5-6a4e059bb257 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:52.568293 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-36e8b158-45c4-4235-8fa5-6a4e059bb257 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:52.568751 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-36e8b158-45c4-4235-8fa5-6a4e059bb257 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:52.597189 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-36e8b158-45c4-4235-8fa5-6a4e059bb257 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042290 Jul 11 11:33:52.597749 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 604/1209] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:52 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:33:52.600166 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-fbbaeb34-2c3b-4d3a-a89e-cf6051076819 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:52.601074 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-fbbaeb34-2c3b-4d3a-a89e-cf6051076819 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:52.607146 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fbbaeb34-2c3b-4d3a-a89e-cf6051076819 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:52.607618 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fbbaeb34-2c3b-4d3a-a89e-cf6051076819 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:52.608365 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fbbaeb34-2c3b-4d3a-a89e-cf6051076819 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:52.608793 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fbbaeb34-2c3b-4d3a-a89e-cf6051076819 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:52.637455 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-fbbaeb34-2c3b-4d3a-a89e-cf6051076819 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041318 Jul 11 11:33:52.637998 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 606/1210] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:52 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:33:52.756998 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-647eac1d-37de-4ecc-a5ea-5929cbadf357 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:52.757600 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-647eac1d-37de-4ecc-a5ea-5929cbadf357 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:52.763578 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-647eac1d-37de-4ecc-a5ea-5929cbadf357 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:52.764015 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-647eac1d-37de-4ecc-a5ea-5929cbadf357 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:52.764762 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-647eac1d-37de-4ecc-a5ea-5929cbadf357 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:52.765192 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-647eac1d-37de-4ecc-a5ea-5929cbadf357 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:52.863765 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-7d807011-92ee-46d1-8c52-211f45e722f9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:52.864369 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-7d807011-92ee-46d1-8c52-211f45e722f9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:52.870255 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7d807011-92ee-46d1-8c52-211f45e722f9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:52.870700 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7d807011-92ee-46d1-8c52-211f45e722f9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:52.871509 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7d807011-92ee-46d1-8c52-211f45e722f9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:52.871937 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7d807011-92ee-46d1-8c52-211f45e722f9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:52.890844 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-647eac1d-37de-4ecc-a5ea-5929cbadf357 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:52.899848 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-647eac1d-37de-4ecc-a5ea-5929cbadf357 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:52.901360 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-647eac1d-37de-4ecc-a5ea-5929cbadf357 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:52.902524 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-647eac1d-37de-4ecc-a5ea-5929cbadf357 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.149439 Jul 11 11:33:52.903294 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 605/1211] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:33:52 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:33:53.003876 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-7d807011-92ee-46d1-8c52-211f45e722f9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:53.012233 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-7d807011-92ee-46d1-8c52-211f45e722f9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.152192 Jul 11 11:33:53.012803 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 607/1212] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:33:52 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:33:53.608754 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-7dc2f3aa-3066-42d3-ac71-07a1e8bb5dcd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:53.609679 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-7dc2f3aa-3066-42d3-ac71-07a1e8bb5dcd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:53.616634 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7dc2f3aa-3066-42d3-ac71-07a1e8bb5dcd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:53.617103 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7dc2f3aa-3066-42d3-ac71-07a1e8bb5dcd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:53.617856 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7dc2f3aa-3066-42d3-ac71-07a1e8bb5dcd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:53.618290 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7dc2f3aa-3066-42d3-ac71-07a1e8bb5dcd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:53.646669 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-7dc2f3aa-3066-42d3-ac71-07a1e8bb5dcd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041910 Jul 11 11:33:53.647223 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 606/1213] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:53 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:33:53.648943 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-bd48cc44-fad0-42dd-824f-4a392e617ac0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:53.649872 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-bd48cc44-fad0-42dd-824f-4a392e617ac0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:53.656354 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bd48cc44-fad0-42dd-824f-4a392e617ac0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:53.656805 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bd48cc44-fad0-42dd-824f-4a392e617ac0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:53.657570 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bd48cc44-fad0-42dd-824f-4a392e617ac0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:53.658010 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bd48cc44-fad0-42dd-824f-4a392e617ac0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:53.686395 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-bd48cc44-fad0-42dd-824f-4a392e617ac0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041540 Jul 11 11:33:53.686943 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 608/1214] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:53 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:33:53.921502 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-459d82ab-ec2b-4b46-af9a-ccb0e10c7d70 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:53.922113 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-459d82ab-ec2b-4b46-af9a-ccb0e10c7d70 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:53.930826 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-459d82ab-ec2b-4b46-af9a-ccb0e10c7d70 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:53.931297 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-459d82ab-ec2b-4b46-af9a-ccb0e10c7d70 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:53.932091 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-459d82ab-ec2b-4b46-af9a-ccb0e10c7d70 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:53.932548 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-459d82ab-ec2b-4b46-af9a-ccb0e10c7d70 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:54.030058 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-f3dd7abe-8c40-45f0-863a-7db8793e7531 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:54.030681 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-f3dd7abe-8c40-45f0-863a-7db8793e7531 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:54.038169 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f3dd7abe-8c40-45f0-863a-7db8793e7531 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:54.038628 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f3dd7abe-8c40-45f0-863a-7db8793e7531 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:54.039591 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f3dd7abe-8c40-45f0-863a-7db8793e7531 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:54.040030 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f3dd7abe-8c40-45f0-863a-7db8793e7531 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:54.078250 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-459d82ab-ec2b-4b46-af9a-ccb0e10c7d70 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:54.087424 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-459d82ab-ec2b-4b46-af9a-ccb0e10c7d70 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:54.088934 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-459d82ab-ec2b-4b46-af9a-ccb0e10c7d70 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:54.090116 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-459d82ab-ec2b-4b46-af9a-ccb0e10c7d70 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.172500 Jul 11 11:33:54.101517 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 607/1215] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:33:53 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:33:54.174481 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-f3dd7abe-8c40-45f0-863a-7db8793e7531 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:54.182267 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-f3dd7abe-8c40-45f0-863a-7db8793e7531 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.156282 Jul 11 11:33:54.182826 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 609/1216] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:33:54 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:33:54.658813 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-4491f53b-db42-48e3-97e0-7b2a8149828a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:54.659673 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-4491f53b-db42-48e3-97e0-7b2a8149828a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:54.666220 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4491f53b-db42-48e3-97e0-7b2a8149828a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:54.666668 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4491f53b-db42-48e3-97e0-7b2a8149828a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:54.667453 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4491f53b-db42-48e3-97e0-7b2a8149828a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:54.667887 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4491f53b-db42-48e3-97e0-7b2a8149828a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:54.698155 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-6f609e0f-47ac-426d-a5c4-e5e48053fcc3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:54.698711 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-4491f53b-db42-48e3-97e0-7b2a8149828a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044249 Jul 11 11:33:54.699155 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 608/1217] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:54 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:33:54.699336 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-6f609e0f-47ac-426d-a5c4-e5e48053fcc3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:54.706214 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6f609e0f-47ac-426d-a5c4-e5e48053fcc3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:54.706664 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6f609e0f-47ac-426d-a5c4-e5e48053fcc3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:54.707457 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6f609e0f-47ac-426d-a5c4-e5e48053fcc3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:54.707893 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6f609e0f-47ac-426d-a5c4-e5e48053fcc3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:54.740702 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-6f609e0f-47ac-426d-a5c4-e5e48053fcc3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046589 Jul 11 11:33:54.741265 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 610/1218] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:54 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:33:55.108545 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-ba348001-0872-4fd4-841c-40e3ded9b62b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:55.109162 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-ba348001-0872-4fd4-841c-40e3ded9b62b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:55.112759 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_api:SELECT=100 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:33:55.116610 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ba348001-0872-4fd4-841c-40e3ded9b62b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:55.117059 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ba348001-0872-4fd4-841c-40e3ded9b62b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:55.117838 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ba348001-0872-4fd4-841c-40e3ded9b62b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:55.118276 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ba348001-0872-4fd4-841c-40e3ded9b62b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:55.199561 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-c9764e28-2190-4fac-90d9-4a8ca2b8f247 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:55.200261 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-c9764e28-2190-4fac-90d9-4a8ca2b8f247 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:55.203282 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_api:SELECT=100 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:33:55.206656 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c9764e28-2190-4fac-90d9-4a8ca2b8f247 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:55.207167 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c9764e28-2190-4fac-90d9-4a8ca2b8f247 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:55.207944 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c9764e28-2190-4fac-90d9-4a8ca2b8f247 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:55.208374 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c9764e28-2190-4fac-90d9-4a8ca2b8f247 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:55.268706 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-ba348001-0872-4fd4-841c-40e3ded9b62b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:55.276973 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-ba348001-0872-4fd4-841c-40e3ded9b62b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:55.278485 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-ba348001-0872-4fd4-841c-40e3ded9b62b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:55.279673 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-ba348001-0872-4fd4-841c-40e3ded9b62b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.174994 Jul 11 11:33:55.280231 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 609/1219] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:33:55 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:33:55.334825 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-c9764e28-2190-4fac-90d9-4a8ca2b8f247 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:55.342655 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-c9764e28-2190-4fac-90d9-4a8ca2b8f247 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.146873 Jul 11 11:33:55.343225 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 611/1220] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:33:55 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:33:55.709872 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-69c3d0dc-e850-4e71-863c-546655c722d1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:55.710794 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-69c3d0dc-e850-4e71-863c-546655c722d1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:55.717143 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-69c3d0dc-e850-4e71-863c-546655c722d1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:55.717590 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-69c3d0dc-e850-4e71-863c-546655c722d1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:55.718340 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-69c3d0dc-e850-4e71-863c-546655c722d1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:55.718769 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-69c3d0dc-e850-4e71-863c-546655c722d1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:55.747941 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-69c3d0dc-e850-4e71-863c-546655c722d1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041998 Jul 11 11:33:55.748549 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 610/1221] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:55 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:33:55.752274 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-6fbad527-b4a9-4e8b-be75-d9c7817a62d0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:55.753200 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-6fbad527-b4a9-4e8b-be75-d9c7817a62d0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:55.759696 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6fbad527-b4a9-4e8b-be75-d9c7817a62d0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:55.760145 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6fbad527-b4a9-4e8b-be75-d9c7817a62d0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:55.760911 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6fbad527-b4a9-4e8b-be75-d9c7817a62d0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:55.761351 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6fbad527-b4a9-4e8b-be75-d9c7817a62d0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:55.790035 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-6fbad527-b4a9-4e8b-be75-d9c7817a62d0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041595 Jul 11 11:33:55.790808 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 612/1222] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:55 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:33:56.297503 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-5f217653-54f7-433a-9d06-9b3d74871c0f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:56.298154 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-5f217653-54f7-433a-9d06-9b3d74871c0f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:56.304649 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5f217653-54f7-433a-9d06-9b3d74871c0f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:56.305105 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5f217653-54f7-433a-9d06-9b3d74871c0f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:56.305865 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5f217653-54f7-433a-9d06-9b3d74871c0f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:56.306305 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5f217653-54f7-433a-9d06-9b3d74871c0f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:56.359459 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-68c307a5-4d48-4552-b86e-06f7995936f6 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:56.359987 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-68c307a5-4d48-4552-b86e-06f7995936f6 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:56.366524 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-68c307a5-4d48-4552-b86e-06f7995936f6 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:56.366978 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-68c307a5-4d48-4552-b86e-06f7995936f6 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:56.367767 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-68c307a5-4d48-4552-b86e-06f7995936f6 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:56.368203 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-68c307a5-4d48-4552-b86e-06f7995936f6 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:56.437344 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-5f217653-54f7-433a-9d06-9b3d74871c0f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:56.445967 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-5f217653-54f7-433a-9d06-9b3d74871c0f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:56.447893 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-5f217653-54f7-433a-9d06-9b3d74871c0f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:56.448660 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-5f217653-54f7-433a-9d06-9b3d74871c0f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.155129 Jul 11 11:33:56.449222 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 611/1223] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:33:56 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:33:56.499503 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-68c307a5-4d48-4552-b86e-06f7995936f6 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:56.505009 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=100 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:33:56.510098 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-68c307a5-4d48-4552-b86e-06f7995936f6 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.154551 Jul 11 11:33:56.510668 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 613/1224] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:33:56 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:33:56.758519 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-e3b38632-ca9b-4a59-95ad-eb9385b153f8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:56.759458 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-e3b38632-ca9b-4a59-95ad-eb9385b153f8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:56.765824 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e3b38632-ca9b-4a59-95ad-eb9385b153f8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:56.766267 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e3b38632-ca9b-4a59-95ad-eb9385b153f8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:56.767598 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e3b38632-ca9b-4a59-95ad-eb9385b153f8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:56.768033 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e3b38632-ca9b-4a59-95ad-eb9385b153f8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:56.796697 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-e3b38632-ca9b-4a59-95ad-eb9385b153f8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042062 Jul 11 11:33:56.797429 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 612/1225] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:56 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:33:56.802156 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-fe0a87dd-b151-4374-a4a7-e830548db462 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:56.803439 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-fe0a87dd-b151-4374-a4a7-e830548db462 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:56.810130 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fe0a87dd-b151-4374-a4a7-e830548db462 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:56.810652 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fe0a87dd-b151-4374-a4a7-e830548db462 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:56.811455 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fe0a87dd-b151-4374-a4a7-e830548db462 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:56.811890 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fe0a87dd-b151-4374-a4a7-e830548db462 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:56.843027 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-fe0a87dd-b151-4374-a4a7-e830548db462 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045160 Jul 11 11:33:56.843840 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 614/1226] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:56 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:33:57.465988 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-f98a9bc1-2ba3-47ec-8c3b-5a513de1b2b8 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:57.466594 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-f98a9bc1-2ba3-47ec-8c3b-5a513de1b2b8 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:57.472578 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f98a9bc1-2ba3-47ec-8c3b-5a513de1b2b8 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:57.473016 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f98a9bc1-2ba3-47ec-8c3b-5a513de1b2b8 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:57.473761 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f98a9bc1-2ba3-47ec-8c3b-5a513de1b2b8 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:57.474191 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f98a9bc1-2ba3-47ec-8c3b-5a513de1b2b8 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:57.535184 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-f6e792e0-dcd8-48c9-b1a1-7a6fe68fd69b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:57.535818 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-f6e792e0-dcd8-48c9-b1a1-7a6fe68fd69b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:57.542105 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f6e792e0-dcd8-48c9-b1a1-7a6fe68fd69b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:57.542681 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f6e792e0-dcd8-48c9-b1a1-7a6fe68fd69b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:57.543502 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f6e792e0-dcd8-48c9-b1a1-7a6fe68fd69b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:57.543972 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f6e792e0-dcd8-48c9-b1a1-7a6fe68fd69b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:57.602770 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-f98a9bc1-2ba3-47ec-8c3b-5a513de1b2b8 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:57.606248 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=100 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:33:57.611964 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-f98a9bc1-2ba3-47ec-8c3b-5a513de1b2b8 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:57.613460 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-f98a9bc1-2ba3-47ec-8c3b-5a513de1b2b8 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:57.614625 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-f98a9bc1-2ba3-47ec-8c3b-5a513de1b2b8 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.152491 Jul 11 11:33:57.615454 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 613/1227] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:33:57 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:33:57.680104 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-f6e792e0-dcd8-48c9-b1a1-7a6fe68fd69b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:57.688251 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-f6e792e0-dcd8-48c9-b1a1-7a6fe68fd69b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.156938 Jul 11 11:33:57.689464 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 615/1228] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:33:57 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:33:57.807889 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-e2ae1087-7b52-4368-8083-f956d4992370 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:57.808744 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-e2ae1087-7b52-4368-8083-f956d4992370 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:57.815763 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e2ae1087-7b52-4368-8083-f956d4992370 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:57.816220 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e2ae1087-7b52-4368-8083-f956d4992370 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:57.816984 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e2ae1087-7b52-4368-8083-f956d4992370 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:57.817422 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e2ae1087-7b52-4368-8083-f956d4992370 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:57.845710 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-e2ae1087-7b52-4368-8083-f956d4992370 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041409 Jul 11 11:33:57.846260 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 614/1229] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:57 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:33:57.854316 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-2cf05d6d-7e3e-40cc-a796-cacf5b7811a9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:57.855286 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-2cf05d6d-7e3e-40cc-a796-cacf5b7811a9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:57.862363 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2cf05d6d-7e3e-40cc-a796-cacf5b7811a9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:57.862804 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2cf05d6d-7e3e-40cc-a796-cacf5b7811a9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:57.863608 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2cf05d6d-7e3e-40cc-a796-cacf5b7811a9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:57.864043 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2cf05d6d-7e3e-40cc-a796-cacf5b7811a9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:57.891852 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-2cf05d6d-7e3e-40cc-a796-cacf5b7811a9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041278 Jul 11 11:33:57.892290 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 616/1230] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:57 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:33:58.633273 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-9122e56f-da5f-47b7-8fc7-e868726e4508 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:58.633807 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-9122e56f-da5f-47b7-8fc7-e868726e4508 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:58.639967 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9122e56f-da5f-47b7-8fc7-e868726e4508 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:58.640412 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9122e56f-da5f-47b7-8fc7-e868726e4508 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:58.641227 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9122e56f-da5f-47b7-8fc7-e868726e4508 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:58.641659 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9122e56f-da5f-47b7-8fc7-e868726e4508 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:58.706612 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-02571015-5c59-4368-8cb8-926451dd8f09 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:58.707273 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-02571015-5c59-4368-8cb8-926451dd8f09 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:58.713233 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-02571015-5c59-4368-8cb8-926451dd8f09 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:58.713679 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-02571015-5c59-4368-8cb8-926451dd8f09 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:58.714445 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-02571015-5c59-4368-8cb8-926451dd8f09 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:58.714878 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-02571015-5c59-4368-8cb8-926451dd8f09 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:58.779679 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-9122e56f-da5f-47b7-8fc7-e868726e4508 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:58.787989 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-9122e56f-da5f-47b7-8fc7-e868726e4508 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:58.789488 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-9122e56f-da5f-47b7-8fc7-e868726e4508 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:58.790629 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-9122e56f-da5f-47b7-8fc7-e868726e4508 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.161360 Jul 11 11:33:58.791179 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 615/1231] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:33:58 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:33:58.849840 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-02571015-5c59-4368-8cb8-926451dd8f09 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:58.857384 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-5f84f62e-5323-475e-b02b-dc5e35dd5097 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:58.857869 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-02571015-5c59-4368-8cb8-926451dd8f09 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.155583 Jul 11 11:33:58.858316 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 617/1232] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:33:58 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:33:58.858429 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-5f84f62e-5323-475e-b02b-dc5e35dd5097 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:58.865242 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5f84f62e-5323-475e-b02b-dc5e35dd5097 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:58.865681 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5f84f62e-5323-475e-b02b-dc5e35dd5097 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:58.866434 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5f84f62e-5323-475e-b02b-dc5e35dd5097 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:58.866861 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5f84f62e-5323-475e-b02b-dc5e35dd5097 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:58.896099 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-5f84f62e-5323-475e-b02b-dc5e35dd5097 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042585 Jul 11 11:33:58.896592 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 616/1233] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:58 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:33:58.902690 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-751fdecf-3aa1-4cc7-90c2-e09427b9a5cb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:58.903717 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-751fdecf-3aa1-4cc7-90c2-e09427b9a5cb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:58.910133 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-751fdecf-3aa1-4cc7-90c2-e09427b9a5cb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:58.910624 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-751fdecf-3aa1-4cc7-90c2-e09427b9a5cb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:58.911415 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-751fdecf-3aa1-4cc7-90c2-e09427b9a5cb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:58.911856 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-751fdecf-3aa1-4cc7-90c2-e09427b9a5cb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:58.940903 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-751fdecf-3aa1-4cc7-90c2-e09427b9a5cb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041900 Jul 11 11:33:58.941445 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 618/1234] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:58 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:33:59.809622 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-9afd21b0-3150-4e86-80fe-7cf8d993757b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:59.812500 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-9afd21b0-3150-4e86-80fe-7cf8d993757b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:59.816570 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9afd21b0-3150-4e86-80fe-7cf8d993757b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:59.817021 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9afd21b0-3150-4e86-80fe-7cf8d993757b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:59.817802 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9afd21b0-3150-4e86-80fe-7cf8d993757b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:59.818236 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9afd21b0-3150-4e86-80fe-7cf8d993757b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:59.875518 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-7c9bc963-d259-48e6-abf6-47c85adf8ef5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:59.876131 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-7c9bc963-d259-48e6-abf6-47c85adf8ef5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:59.882248 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7c9bc963-d259-48e6-abf6-47c85adf8ef5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:59.882769 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7c9bc963-d259-48e6-abf6-47c85adf8ef5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:59.883625 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7c9bc963-d259-48e6-abf6-47c85adf8ef5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:59.884362 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7c9bc963-d259-48e6-abf6-47c85adf8ef5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:59.947400 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-9afd21b0-3150-4e86-80fe-7cf8d993757b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:59.955914 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-9afd21b0-3150-4e86-80fe-7cf8d993757b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:59.957435 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-9afd21b0-3150-4e86-80fe-7cf8d993757b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:33:59.958589 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-9afd21b0-3150-4e86-80fe-7cf8d993757b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.152916 Jul 11 11:33:59.959153 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 617/1235] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:33:59 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:33:59.964477 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-73af134c-045f-4c72-a2f7-f132083b76db tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:33:59.965396 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-73af134c-045f-4c72-a2f7-f132083b76db tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:33:59.971857 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-73af134c-045f-4c72-a2f7-f132083b76db tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:59.972303 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-73af134c-045f-4c72-a2f7-f132083b76db tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:33:59.973065 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-73af134c-045f-4c72-a2f7-f132083b76db tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:33:59.973499 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-73af134c-045f-4c72-a2f7-f132083b76db tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:00.003523 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-73af134c-045f-4c72-a2f7-f132083b76db tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043206 Jul 11 11:34:00.004125 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 618/1236] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:33:59 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:00.009259 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-19b33fe4-265b-4a12-acd4-6b6dd9e5aaca tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:00.010238 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-19b33fe4-265b-4a12-acd4-6b6dd9e5aaca tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:00.016578 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-19b33fe4-265b-4a12-acd4-6b6dd9e5aaca tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:00.017616 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-19b33fe4-265b-4a12-acd4-6b6dd9e5aaca tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:00.018431 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-19b33fe4-265b-4a12-acd4-6b6dd9e5aaca tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:00.018889 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-19b33fe4-265b-4a12-acd4-6b6dd9e5aaca tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:00.022727 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-7c9bc963-d259-48e6-abf6-47c85adf8ef5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:00.033647 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-7c9bc963-d259-48e6-abf6-47c85adf8ef5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.161941 Jul 11 11:34:00.034400 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 619/1237] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:33:59 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:34:00.048290 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-19b33fe4-265b-4a12-acd4-6b6dd9e5aaca tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043020 Jul 11 11:34:00.048797 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 619/1238] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:00 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:00.977087 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-9543bbbe-61ce-416b-ae36-c6c68c33a2db tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:00.977680 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-9543bbbe-61ce-416b-ae36-c6c68c33a2db tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:00.984215 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9543bbbe-61ce-416b-ae36-c6c68c33a2db tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:00.984666 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9543bbbe-61ce-416b-ae36-c6c68c33a2db tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:00.985430 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9543bbbe-61ce-416b-ae36-c6c68c33a2db tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:00.986438 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9543bbbe-61ce-416b-ae36-c6c68c33a2db tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:01.016272 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-7c124fa9-8d61-48f1-bca9-1098c698f778 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:01.017190 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-7c124fa9-8d61-48f1-bca9-1098c698f778 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:01.023724 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7c124fa9-8d61-48f1-bca9-1098c698f778 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:01.024172 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7c124fa9-8d61-48f1-bca9-1098c698f778 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:01.024933 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7c124fa9-8d61-48f1-bca9-1098c698f778 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:01.025421 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7c124fa9-8d61-48f1-bca9-1098c698f778 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:01.056675 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-7c124fa9-8d61-48f1-bca9-1098c698f778 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044220 Jul 11 11:34:01.057352 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 620/1239] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:01 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:34:01.061801 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-16419617-e466-4390-9902-7fa2765e8bd0 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:01.062398 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-16419617-e466-4390-9902-7fa2765e8bd0 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:01.069458 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-16419617-e466-4390-9902-7fa2765e8bd0 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:01.069906 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-16419617-e466-4390-9902-7fa2765e8bd0 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:01.070669 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-16419617-e466-4390-9902-7fa2765e8bd0 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:01.071127 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-16419617-e466-4390-9902-7fa2765e8bd0 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:01.121312 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-9543bbbe-61ce-416b-ae36-c6c68c33a2db tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:01.129766 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-9543bbbe-61ce-416b-ae36-c6c68c33a2db tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:01.131279 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-9543bbbe-61ce-416b-ae36-c6c68c33a2db tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:01.132429 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-9543bbbe-61ce-416b-ae36-c6c68c33a2db tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.159349 Jul 11 11:34:01.132990 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 620/1240] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:34:00 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:34:01.137565 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-2a4a2bbe-4251-4425-aa50-3bbe61ac760b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:01.138473 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-2a4a2bbe-4251-4425-aa50-3bbe61ac760b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:01.144720 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2a4a2bbe-4251-4425-aa50-3bbe61ac760b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:01.145168 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2a4a2bbe-4251-4425-aa50-3bbe61ac760b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:01.145927 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2a4a2bbe-4251-4425-aa50-3bbe61ac760b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:01.146359 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2a4a2bbe-4251-4425-aa50-3bbe61ac760b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:01.175175 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-2a4a2bbe-4251-4425-aa50-3bbe61ac760b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041131 Jul 11 11:34:01.175764 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 621/1241] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:01 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:01.200084 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-16419617-e466-4390-9902-7fa2765e8bd0 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:01.208455 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-16419617-e466-4390-9902-7fa2765e8bd0 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.150173 Jul 11 11:34:01.209011 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 621/1242] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:34:01 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:34:02.069167 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-6c6f499e-066f-453d-9039-9657dea2bb8d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:02.070078 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-6c6f499e-066f-453d-9039-9657dea2bb8d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:02.076722 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6c6f499e-066f-453d-9039-9657dea2bb8d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:02.077162 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6c6f499e-066f-453d-9039-9657dea2bb8d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:02.077920 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6c6f499e-066f-453d-9039-9657dea2bb8d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:02.078351 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6c6f499e-066f-453d-9039-9657dea2bb8d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:02.106060 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-6c6f499e-066f-453d-9039-9657dea2bb8d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041135 Jul 11 11:34:02.106603 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 622/1243] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:02 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:02.150956 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-773aeb95-36cf-4603-8dbe-29a177c2f697 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:02.151633 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-773aeb95-36cf-4603-8dbe-29a177c2f697 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:02.158020 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-773aeb95-36cf-4603-8dbe-29a177c2f697 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:02.158456 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-773aeb95-36cf-4603-8dbe-29a177c2f697 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:02.159204 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-773aeb95-36cf-4603-8dbe-29a177c2f697 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:02.159656 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-773aeb95-36cf-4603-8dbe-29a177c2f697 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:02.185968 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-128ef837-381b-4cf7-8f64-b702ce242feb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:02.186867 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-128ef837-381b-4cf7-8f64-b702ce242feb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:02.194028 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-128ef837-381b-4cf7-8f64-b702ce242feb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:02.194716 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-128ef837-381b-4cf7-8f64-b702ce242feb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:02.195501 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-128ef837-381b-4cf7-8f64-b702ce242feb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:02.195934 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-128ef837-381b-4cf7-8f64-b702ce242feb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:02.242956 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-128ef837-381b-4cf7-8f64-b702ce242feb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060920 Jul 11 11:34:02.244598 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 623/1244] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:02 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:34:02.249840 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-45043568-36a6-436b-9afb-103832c9c0aa tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:02.250436 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-45043568-36a6-436b-9afb-103832c9c0aa tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:02.256405 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-45043568-36a6-436b-9afb-103832c9c0aa tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:02.256845 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-45043568-36a6-436b-9afb-103832c9c0aa tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:02.257600 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-45043568-36a6-436b-9afb-103832c9c0aa tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:02.258029 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-45043568-36a6-436b-9afb-103832c9c0aa tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:02.293755 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-773aeb95-36cf-4603-8dbe-29a177c2f697 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:02.302823 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-773aeb95-36cf-4603-8dbe-29a177c2f697 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:02.304381 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-773aeb95-36cf-4603-8dbe-29a177c2f697 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:02.305549 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-773aeb95-36cf-4603-8dbe-29a177c2f697 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.158502 Jul 11 11:34:02.306113 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 622/1245] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:34:02 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:34:02.385695 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-45043568-36a6-436b-9afb-103832c9c0aa tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:02.393590 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-45043568-36a6-436b-9afb-103832c9c0aa tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.147280 Jul 11 11:34:02.394159 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 624/1246] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:34:02 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:34:03.117641 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-af0cbc73-2862-4e46-b94c-82f306a39b69 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:03.118575 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-af0cbc73-2862-4e46-b94c-82f306a39b69 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:03.124741 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-af0cbc73-2862-4e46-b94c-82f306a39b69 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:03.125189 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-af0cbc73-2862-4e46-b94c-82f306a39b69 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:03.125947 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-af0cbc73-2862-4e46-b94c-82f306a39b69 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:03.126875 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-af0cbc73-2862-4e46-b94c-82f306a39b69 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:03.157357 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-af0cbc73-2862-4e46-b94c-82f306a39b69 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043606 Jul 11 11:34:03.158030 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 623/1247] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:03 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:03.255221 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-fda830b6-c5d4-4f22-a9ab-82bec2d69ad8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:03.256165 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-fda830b6-c5d4-4f22-a9ab-82bec2d69ad8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:03.264077 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fda830b6-c5d4-4f22-a9ab-82bec2d69ad8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:03.264547 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fda830b6-c5d4-4f22-a9ab-82bec2d69ad8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:03.265322 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fda830b6-c5d4-4f22-a9ab-82bec2d69ad8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:03.265754 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fda830b6-c5d4-4f22-a9ab-82bec2d69ad8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:03.297696 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-fda830b6-c5d4-4f22-a9ab-82bec2d69ad8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046860 Jul 11 11:34:03.298262 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 625/1248] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:03 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:03.324340 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-48121037-a523-4111-9e40-7b8256e877dd tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:03.324873 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-48121037-a523-4111-9e40-7b8256e877dd tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:03.331572 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-48121037-a523-4111-9e40-7b8256e877dd tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:03.331991 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-48121037-a523-4111-9e40-7b8256e877dd tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:03.332780 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-48121037-a523-4111-9e40-7b8256e877dd tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:03.333215 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-48121037-a523-4111-9e40-7b8256e877dd tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:03.411653 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-a3157e71-2948-4ce3-bc05-3b7460255262 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:03.412242 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-a3157e71-2948-4ce3-bc05-3b7460255262 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:03.419784 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a3157e71-2948-4ce3-bc05-3b7460255262 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:03.426613 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a3157e71-2948-4ce3-bc05-3b7460255262 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:03.426613 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a3157e71-2948-4ce3-bc05-3b7460255262 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:03.426613 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a3157e71-2948-4ce3-bc05-3b7460255262 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:03.465135 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-48121037-a523-4111-9e40-7b8256e877dd tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:03.474272 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-48121037-a523-4111-9e40-7b8256e877dd tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:03.475907 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-48121037-a523-4111-9e40-7b8256e877dd tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:03.477072 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-48121037-a523-4111-9e40-7b8256e877dd tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.156691 Jul 11 11:34:03.477633 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 624/1249] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:34:03 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:34:03.559015 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-a3157e71-2948-4ce3-bc05-3b7460255262 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:03.571299 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-a3157e71-2948-4ce3-bc05-3b7460255262 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.163513 Jul 11 11:34:03.571914 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 626/1250] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:34:03 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:34:04.169543 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-fd0038d4-f774-4df2-82e7-1849335343b4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:04.170402 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-fd0038d4-f774-4df2-82e7-1849335343b4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:04.177057 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fd0038d4-f774-4df2-82e7-1849335343b4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:04.177509 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fd0038d4-f774-4df2-82e7-1849335343b4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:04.178305 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fd0038d4-f774-4df2-82e7-1849335343b4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:04.178746 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fd0038d4-f774-4df2-82e7-1849335343b4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:04.208136 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-fd0038d4-f774-4df2-82e7-1849335343b4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042731 Jul 11 11:34:04.208743 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 625/1251] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:04 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:04.309461 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-e8adef7d-30a0-4edf-b3fc-ed86c5ee3aa2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:04.310380 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-e8adef7d-30a0-4edf-b3fc-ed86c5ee3aa2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:04.317182 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e8adef7d-30a0-4edf-b3fc-ed86c5ee3aa2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:04.317629 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e8adef7d-30a0-4edf-b3fc-ed86c5ee3aa2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:04.318384 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e8adef7d-30a0-4edf-b3fc-ed86c5ee3aa2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:04.318827 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e8adef7d-30a0-4edf-b3fc-ed86c5ee3aa2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:04.347958 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-e8adef7d-30a0-4edf-b3fc-ed86c5ee3aa2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042515 Jul 11 11:34:04.348515 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 627/1252] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:04 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:04.496032 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-edc0d689-5664-43bc-9b12-9f36293b8aad tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:04.496592 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-edc0d689-5664-43bc-9b12-9f36293b8aad tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:04.503093 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-edc0d689-5664-43bc-9b12-9f36293b8aad tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:04.503576 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-edc0d689-5664-43bc-9b12-9f36293b8aad tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:04.504337 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-edc0d689-5664-43bc-9b12-9f36293b8aad tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:04.504776 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-edc0d689-5664-43bc-9b12-9f36293b8aad tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:04.589732 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-c4c99745-5fe7-4bc6-8722-444514b331b2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:04.590446 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-c4c99745-5fe7-4bc6-8722-444514b331b2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:04.597003 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c4c99745-5fe7-4bc6-8722-444514b331b2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:04.597526 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c4c99745-5fe7-4bc6-8722-444514b331b2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:04.598359 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c4c99745-5fe7-4bc6-8722-444514b331b2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:04.598888 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c4c99745-5fe7-4bc6-8722-444514b331b2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:04.637003 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-edc0d689-5664-43bc-9b12-9f36293b8aad tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:04.655830 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-edc0d689-5664-43bc-9b12-9f36293b8aad tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:04.655830 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-edc0d689-5664-43bc-9b12-9f36293b8aad tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:04.656053 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-edc0d689-5664-43bc-9b12-9f36293b8aad tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.163730 Jul 11 11:34:04.656913 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 626/1253] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:34:04 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:34:04.737138 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-c4c99745-5fe7-4bc6-8722-444514b331b2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:04.744899 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-c4c99745-5fe7-4bc6-8722-444514b331b2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.159027 Jul 11 11:34:04.745455 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 628/1254] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:34:04 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:34:05.220398 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-09c975c1-5eeb-4412-ab09-743149b093c1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:05.221353 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-09c975c1-5eeb-4412-ab09-743149b093c1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:05.227848 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-09c975c1-5eeb-4412-ab09-743149b093c1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:05.228299 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-09c975c1-5eeb-4412-ab09-743149b093c1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:05.229064 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-09c975c1-5eeb-4412-ab09-743149b093c1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:05.229505 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-09c975c1-5eeb-4412-ab09-743149b093c1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:05.260109 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-09c975c1-5eeb-4412-ab09-743149b093c1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044151 Jul 11 11:34:05.263042 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 627/1255] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:05 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:05.359239 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-55ce3020-74c6-4e2f-938a-618d79a55e40 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:05.360123 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-55ce3020-74c6-4e2f-938a-618d79a55e40 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:05.367177 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-55ce3020-74c6-4e2f-938a-618d79a55e40 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:05.367654 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-55ce3020-74c6-4e2f-938a-618d79a55e40 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:05.368399 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-55ce3020-74c6-4e2f-938a-618d79a55e40 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:05.368829 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-55ce3020-74c6-4e2f-938a-618d79a55e40 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:05.396371 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-55ce3020-74c6-4e2f-938a-618d79a55e40 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041152 Jul 11 11:34:05.396909 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 629/1256] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:05 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:05.674564 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-6f086e6e-f7e5-403b-9523-f5edf1c58cf9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:05.675314 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-6f086e6e-f7e5-403b-9523-f5edf1c58cf9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:05.681197 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6f086e6e-f7e5-403b-9523-f5edf1c58cf9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:05.681754 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6f086e6e-f7e5-403b-9523-f5edf1c58cf9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:05.682519 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6f086e6e-f7e5-403b-9523-f5edf1c58cf9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:05.682956 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6f086e6e-f7e5-403b-9523-f5edf1c58cf9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:05.765708 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-7454bc35-c814-4769-b728-ec2b7c4df110 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:05.766577 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-7454bc35-c814-4769-b728-ec2b7c4df110 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:05.773306 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7454bc35-c814-4769-b728-ec2b7c4df110 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:05.773756 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7454bc35-c814-4769-b728-ec2b7c4df110 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:05.774518 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7454bc35-c814-4769-b728-ec2b7c4df110 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:05.774954 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7454bc35-c814-4769-b728-ec2b7c4df110 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:05.793577 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=100 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:34:05.812873 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-6f086e6e-f7e5-403b-9523-f5edf1c58cf9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:05.821784 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-6f086e6e-f7e5-403b-9523-f5edf1c58cf9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:05.823388 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-6f086e6e-f7e5-403b-9523-f5edf1c58cf9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:05.824555 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-6f086e6e-f7e5-403b-9523-f5edf1c58cf9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.154157 Jul 11 11:34:05.825119 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 628/1257] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:34:05 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:34:05.903738 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-7454bc35-c814-4769-b728-ec2b7c4df110 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:05.912216 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-7454bc35-c814-4769-b728-ec2b7c4df110 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.150389 Jul 11 11:34:05.912776 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 630/1258] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:34:05 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:34:06.274521 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-66523a8d-13ea-43f1-899c-8e500ca86cd3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:06.275502 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-66523a8d-13ea-43f1-899c-8e500ca86cd3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:06.281989 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-66523a8d-13ea-43f1-899c-8e500ca86cd3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:06.282442 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-66523a8d-13ea-43f1-899c-8e500ca86cd3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:06.283206 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-66523a8d-13ea-43f1-899c-8e500ca86cd3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:06.283671 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-66523a8d-13ea-43f1-899c-8e500ca86cd3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:06.312843 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-66523a8d-13ea-43f1-899c-8e500ca86cd3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042274 Jul 11 11:34:06.313400 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 629/1259] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:06 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:06.407902 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-0f7e31c7-39c5-45a0-babf-95074c6746e0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:06.408847 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-0f7e31c7-39c5-45a0-babf-95074c6746e0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:06.415277 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0f7e31c7-39c5-45a0-babf-95074c6746e0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:06.415738 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0f7e31c7-39c5-45a0-babf-95074c6746e0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:06.416485 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0f7e31c7-39c5-45a0-babf-95074c6746e0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:06.416910 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0f7e31c7-39c5-45a0-babf-95074c6746e0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:06.447378 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-0f7e31c7-39c5-45a0-babf-95074c6746e0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043309 Jul 11 11:34:06.447945 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 631/1260] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:06 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:06.843084 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-8effc599-d3bf-4ac7-98ab-b9b1c558d0b1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:06.843720 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-8effc599-d3bf-4ac7-98ab-b9b1c558d0b1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:06.850187 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8effc599-d3bf-4ac7-98ab-b9b1c558d0b1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:06.850639 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8effc599-d3bf-4ac7-98ab-b9b1c558d0b1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:06.851419 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8effc599-d3bf-4ac7-98ab-b9b1c558d0b1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:06.851856 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8effc599-d3bf-4ac7-98ab-b9b1c558d0b1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:06.869840 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=100 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:34:06.929796 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-d4c64bdf-e046-457f-b97c-3a2b8dd6bcca tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:06.930398 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-d4c64bdf-e046-457f-b97c-3a2b8dd6bcca tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:06.938566 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d4c64bdf-e046-457f-b97c-3a2b8dd6bcca tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:06.939014 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d4c64bdf-e046-457f-b97c-3a2b8dd6bcca tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:06.939806 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d4c64bdf-e046-457f-b97c-3a2b8dd6bcca tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:06.940239 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d4c64bdf-e046-457f-b97c-3a2b8dd6bcca tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:06.985604 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-8effc599-d3bf-4ac7-98ab-b9b1c558d0b1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:06.994714 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-8effc599-d3bf-4ac7-98ab-b9b1c558d0b1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:06.998689 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-8effc599-d3bf-4ac7-98ab-b9b1c558d0b1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:06.998689 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-8effc599-d3bf-4ac7-98ab-b9b1c558d0b1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.158313 Jul 11 11:34:06.998689 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 630/1261] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:34:06 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:34:07.075499 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-d4c64bdf-e046-457f-b97c-3a2b8dd6bcca tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:07.083790 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-d4c64bdf-e046-457f-b97c-3a2b8dd6bcca tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.157923 Jul 11 11:34:07.084339 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 632/1262] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:34:06 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:34:07.325367 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-fab4feba-31fa-42f0-872d-37a85dadc4cf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:07.326298 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-fab4feba-31fa-42f0-872d-37a85dadc4cf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:07.332745 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fab4feba-31fa-42f0-872d-37a85dadc4cf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:07.333189 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fab4feba-31fa-42f0-872d-37a85dadc4cf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:07.333942 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fab4feba-31fa-42f0-872d-37a85dadc4cf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:07.334374 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fab4feba-31fa-42f0-872d-37a85dadc4cf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:07.362450 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-fab4feba-31fa-42f0-872d-37a85dadc4cf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041049 Jul 11 11:34:07.362994 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 631/1263] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:07 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:07.458923 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-b4d4806d-ac71-4f3b-a543-967041335dc8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:07.459872 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-b4d4806d-ac71-4f3b-a543-967041335dc8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:07.466328 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b4d4806d-ac71-4f3b-a543-967041335dc8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:07.466778 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b4d4806d-ac71-4f3b-a543-967041335dc8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:07.467563 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b4d4806d-ac71-4f3b-a543-967041335dc8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:07.467998 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b4d4806d-ac71-4f3b-a543-967041335dc8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:07.497648 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-b4d4806d-ac71-4f3b-a543-967041335dc8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042632 Jul 11 11:34:07.498214 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 633/1264] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:07 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:08.015612 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-b4b5aeaa-7d44-4638-b486-e0f8e23f65ea tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:08.016218 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-b4b5aeaa-7d44-4638-b486-e0f8e23f65ea tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:08.022800 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b4b5aeaa-7d44-4638-b486-e0f8e23f65ea tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:08.023244 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b4b5aeaa-7d44-4638-b486-e0f8e23f65ea tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:08.024044 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b4b5aeaa-7d44-4638-b486-e0f8e23f65ea tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:08.024477 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b4b5aeaa-7d44-4638-b486-e0f8e23f65ea tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:08.100952 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-8ffd073b-3dc3-4f67-be84-bcd45cbfcd67 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:08.101694 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-8ffd073b-3dc3-4f67-be84-bcd45cbfcd67 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:08.107877 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8ffd073b-3dc3-4f67-be84-bcd45cbfcd67 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:08.108399 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8ffd073b-3dc3-4f67-be84-bcd45cbfcd67 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:08.109230 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8ffd073b-3dc3-4f67-be84-bcd45cbfcd67 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:08.109737 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8ffd073b-3dc3-4f67-be84-bcd45cbfcd67 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:08.154359 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-b4b5aeaa-7d44-4638-b486-e0f8e23f65ea tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:08.163278 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-b4b5aeaa-7d44-4638-b486-e0f8e23f65ea tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:08.164783 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-b4b5aeaa-7d44-4638-b486-e0f8e23f65ea tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:08.165935 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-b4b5aeaa-7d44-4638-b486-e0f8e23f65ea tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.154274 Jul 11 11:34:08.166498 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 632/1265] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:34:08 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:34:08.235058 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-8ffd073b-3dc3-4f67-be84-bcd45cbfcd67 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:08.243086 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-8ffd073b-3dc3-4f67-be84-bcd45cbfcd67 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.146056 Jul 11 11:34:08.243691 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 634/1266] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:34:08 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:34:08.373939 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-34253888-5f34-44dd-b943-b8f3027f4991 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:08.374822 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-34253888-5f34-44dd-b943-b8f3027f4991 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:08.381741 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-34253888-5f34-44dd-b943-b8f3027f4991 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:08.382186 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-34253888-5f34-44dd-b943-b8f3027f4991 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:08.382942 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-34253888-5f34-44dd-b943-b8f3027f4991 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:08.383453 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-34253888-5f34-44dd-b943-b8f3027f4991 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:08.413534 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-34253888-5f34-44dd-b943-b8f3027f4991 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043646 Jul 11 11:34:08.414087 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 633/1267] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:08 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:08.508250 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-cba002cb-c301-4b57-a701-ebe77887def0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:08.509172 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-cba002cb-c301-4b57-a701-ebe77887def0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:08.515644 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-cba002cb-c301-4b57-a701-ebe77887def0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:08.516090 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-cba002cb-c301-4b57-a701-ebe77887def0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:08.517418 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-cba002cb-c301-4b57-a701-ebe77887def0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:08.517851 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-cba002cb-c301-4b57-a701-ebe77887def0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:08.545936 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-cba002cb-c301-4b57-a701-ebe77887def0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041606 Jul 11 11:34:08.546484 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 635/1268] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:08 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:09.184280 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-f51085c0-4267-436a-a437-a10e3718ed03 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:09.184893 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-f51085c0-4267-436a-a437-a10e3718ed03 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:09.191130 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f51085c0-4267-436a-a437-a10e3718ed03 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:09.191692 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f51085c0-4267-436a-a437-a10e3718ed03 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:09.197771 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f51085c0-4267-436a-a437-a10e3718ed03 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:09.197771 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f51085c0-4267-436a-a437-a10e3718ed03 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:09.260646 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-6b2f7f5b-d166-4701-82be-0b183eb328c6 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:09.261279 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-6b2f7f5b-d166-4701-82be-0b183eb328c6 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:09.267196 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6b2f7f5b-d166-4701-82be-0b183eb328c6 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:09.267860 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6b2f7f5b-d166-4701-82be-0b183eb328c6 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:09.268425 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6b2f7f5b-d166-4701-82be-0b183eb328c6 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:09.268864 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6b2f7f5b-d166-4701-82be-0b183eb328c6 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:09.323548 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-f51085c0-4267-436a-a437-a10e3718ed03 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:09.333933 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-f51085c0-4267-436a-a437-a10e3718ed03 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:09.335641 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-f51085c0-4267-436a-a437-a10e3718ed03 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:09.336924 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-f51085c0-4267-436a-a437-a10e3718ed03 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.156615 Jul 11 11:34:09.337497 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 634/1269] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:34:09 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:34:09.398862 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-6b2f7f5b-d166-4701-82be-0b183eb328c6 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:09.406659 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-6b2f7f5b-d166-4701-82be-0b183eb328c6 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.149937 Jul 11 11:34:09.407311 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 636/1270] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:34:09 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:34:09.424893 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-c6ec9061-6587-4580-90a2-6a9ba8b8f8ac tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:09.425820 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-c6ec9061-6587-4580-90a2-6a9ba8b8f8ac tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:09.431808 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c6ec9061-6587-4580-90a2-6a9ba8b8f8ac tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:09.432254 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c6ec9061-6587-4580-90a2-6a9ba8b8f8ac tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:09.433011 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c6ec9061-6587-4580-90a2-6a9ba8b8f8ac tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:09.433442 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c6ec9061-6587-4580-90a2-6a9ba8b8f8ac tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:09.461892 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-c6ec9061-6587-4580-90a2-6a9ba8b8f8ac tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040915 Jul 11 11:34:09.462429 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 635/1271] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:09 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:09.557430 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-95b3446b-2df1-4b7a-8851-77508bd8591f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:09.558348 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-95b3446b-2df1-4b7a-8851-77508bd8591f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:09.564839 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-95b3446b-2df1-4b7a-8851-77508bd8591f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:09.565290 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-95b3446b-2df1-4b7a-8851-77508bd8591f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:09.566343 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-95b3446b-2df1-4b7a-8851-77508bd8591f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:09.566782 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-95b3446b-2df1-4b7a-8851-77508bd8591f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:09.596376 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-95b3446b-2df1-4b7a-8851-77508bd8591f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043047 Jul 11 11:34:09.596931 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 637/1272] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:09 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:10.355784 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-94e81967-5e7e-47e7-96d0-77af9a401a9d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:10.356347 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-94e81967-5e7e-47e7-96d0-77af9a401a9d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:10.363367 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-94e81967-5e7e-47e7-96d0-77af9a401a9d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:10.363822 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-94e81967-5e7e-47e7-96d0-77af9a401a9d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:10.364582 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-94e81967-5e7e-47e7-96d0-77af9a401a9d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:10.365022 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-94e81967-5e7e-47e7-96d0-77af9a401a9d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:10.424261 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-3b17be91-5f02-4d4d-852d-b668bcb440cb tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:10.424872 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-3b17be91-5f02-4d4d-852d-b668bcb440cb tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:10.430901 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3b17be91-5f02-4d4d-852d-b668bcb440cb tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:10.431373 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3b17be91-5f02-4d4d-852d-b668bcb440cb tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:10.432139 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3b17be91-5f02-4d4d-852d-b668bcb440cb tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:10.432558 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3b17be91-5f02-4d4d-852d-b668bcb440cb tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:10.499757 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-94e81967-5e7e-47e7-96d0-77af9a401a9d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:10.508295 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-94e81967-5e7e-47e7-96d0-77af9a401a9d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:10.509801 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-94e81967-5e7e-47e7-96d0-77af9a401a9d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:10.510962 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-94e81967-5e7e-47e7-96d0-77af9a401a9d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.159161 Jul 11 11:34:10.511568 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 636/1273] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:34:10 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:34:10.516163 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-75f8f17a-146e-4ee3-b912-ebc1682dc3b7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:10.517109 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-75f8f17a-146e-4ee3-b912-ebc1682dc3b7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:10.523062 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-75f8f17a-146e-4ee3-b912-ebc1682dc3b7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:10.523561 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-75f8f17a-146e-4ee3-b912-ebc1682dc3b7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:10.524330 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-75f8f17a-146e-4ee3-b912-ebc1682dc3b7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:10.524771 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-75f8f17a-146e-4ee3-b912-ebc1682dc3b7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:10.554355 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-75f8f17a-146e-4ee3-b912-ebc1682dc3b7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041740 Jul 11 11:34:10.554934 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 637/1274] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:10 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:10.574748 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-3b17be91-5f02-4d4d-852d-b668bcb440cb tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:10.582886 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-3b17be91-5f02-4d4d-852d-b668bcb440cb tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.162989 Jul 11 11:34:10.583480 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 638/1275] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:34:10 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:34:10.608435 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-aa40e147-ce5d-48f1-b886-429836bfe543 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:10.609282 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-aa40e147-ce5d-48f1-b886-429836bfe543 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:10.615835 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-aa40e147-ce5d-48f1-b886-429836bfe543 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:10.616278 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-aa40e147-ce5d-48f1-b886-429836bfe543 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:10.617029 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-aa40e147-ce5d-48f1-b886-429836bfe543 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:10.617458 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-aa40e147-ce5d-48f1-b886-429836bfe543 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:10.646707 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-aa40e147-ce5d-48f1-b886-429836bfe543 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042193 Jul 11 11:34:10.647471 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 638/1276] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:10 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:11.529508 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-7cec3c62-cbbb-4e3f-88cd-d6c0168282b4 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:11.530145 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-7cec3c62-cbbb-4e3f-88cd-d6c0168282b4 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:11.536227 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7cec3c62-cbbb-4e3f-88cd-d6c0168282b4 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:11.536672 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7cec3c62-cbbb-4e3f-88cd-d6c0168282b4 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:11.537429 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7cec3c62-cbbb-4e3f-88cd-d6c0168282b4 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:11.537863 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7cec3c62-cbbb-4e3f-88cd-d6c0168282b4 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:11.566593 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-75d5e3ba-9dac-413d-a215-f16640858efc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:11.567547 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-75d5e3ba-9dac-413d-a215-f16640858efc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:11.574043 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-75d5e3ba-9dac-413d-a215-f16640858efc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:11.574492 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-75d5e3ba-9dac-413d-a215-f16640858efc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:11.575278 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-75d5e3ba-9dac-413d-a215-f16640858efc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:11.575720 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-75d5e3ba-9dac-413d-a215-f16640858efc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:11.605579 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-75d5e3ba-9dac-413d-a215-f16640858efc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043534 Jul 11 11:34:11.606147 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 639/1277] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:11 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:34:11.611203 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-e78b7a75-d90e-439a-8f18-5aac53cd021d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:11.611838 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-e78b7a75-d90e-439a-8f18-5aac53cd021d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:11.617565 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e78b7a75-d90e-439a-8f18-5aac53cd021d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:11.618015 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e78b7a75-d90e-439a-8f18-5aac53cd021d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:11.618777 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e78b7a75-d90e-439a-8f18-5aac53cd021d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:11.619212 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e78b7a75-d90e-439a-8f18-5aac53cd021d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:11.669226 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-7cec3c62-cbbb-4e3f-88cd-d6c0168282b4 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:11.678031 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-7cec3c62-cbbb-4e3f-88cd-d6c0168282b4 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:11.679680 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-7cec3c62-cbbb-4e3f-88cd-d6c0168282b4 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:11.680826 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-7cec3c62-cbbb-4e3f-88cd-d6c0168282b4 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.155218 Jul 11 11:34:11.681390 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 639/1278] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:34:11 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:34:11.685895 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-f3e6b11d-aa64-46c2-8b4e-41791538f6ea tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:11.686794 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-f3e6b11d-aa64-46c2-8b4e-41791538f6ea tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:11.693474 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f3e6b11d-aa64-46c2-8b4e-41791538f6ea tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:11.693960 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f3e6b11d-aa64-46c2-8b4e-41791538f6ea tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:11.694761 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f3e6b11d-aa64-46c2-8b4e-41791538f6ea tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:11.695237 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f3e6b11d-aa64-46c2-8b4e-41791538f6ea tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:11.725013 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-f3e6b11d-aa64-46c2-8b4e-41791538f6ea tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042598 Jul 11 11:34:11.725584 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 640/1279] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:11 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:11.747884 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-e78b7a75-d90e-439a-8f18-5aac53cd021d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:11.756263 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-e78b7a75-d90e-439a-8f18-5aac53cd021d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.149196 Jul 11 11:34:11.756829 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 640/1280] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:34:11 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:34:12.061907 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-1bf7105e-c2a6-4663-b904-6fbdf7e37c6c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:12.062422 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-1bf7105e-c2a6-4663-b904-6fbdf7e37c6c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:12.068934 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1bf7105e-c2a6-4663-b904-6fbdf7e37c6c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:12.069377 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1bf7105e-c2a6-4663-b904-6fbdf7e37c6c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:12.070154 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1bf7105e-c2a6-4663-b904-6fbdf7e37c6c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:12.070580 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1bf7105e-c2a6-4663-b904-6fbdf7e37c6c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:12.149368 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.objects.instance [None req-1bf7105e-c2a6-4663-b904-6fbdf7e37c6c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lazy-loading 'services' on Instance uuid 21831efc-9278-477a-b760-33d7830c9423 {{(pid=118321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 11:34:12.370035 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-1bf7105e-c2a6-4663-b904-6fbdf7e37c6c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "DELETE /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423/os-volume_attachments/d0d2f510-a164-4910-a380-1291cccc44ad" status: 202 len: 0 microversion: 2.1 time: 0.312507 Jul 11 11:34:12.370627 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 641/1281] 10.222.0.26 () {58 vars in 1415 bytes} [Mon Jul 11 11:34:12 2022] DELETE /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423/os-volume_attachments/d0d2f510-a164-4910-a380-1291cccc44ad => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 11:34:12.616923 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-41b1c58c-81a9-44e2-be41-2726f762a66c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:12.617841 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-41b1c58c-81a9-44e2-be41-2726f762a66c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:12.624301 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-41b1c58c-81a9-44e2-be41-2726f762a66c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:12.624747 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-41b1c58c-81a9-44e2-be41-2726f762a66c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:12.625502 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-41b1c58c-81a9-44e2-be41-2726f762a66c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:12.625934 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-41b1c58c-81a9-44e2-be41-2726f762a66c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:12.654407 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-41b1c58c-81a9-44e2-be41-2726f762a66c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041412 Jul 11 11:34:12.654959 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 641/1282] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:12 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:12.701081 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-6a9bc2de-525c-4294-bb02-61c9d17923cc tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:12.701798 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-6a9bc2de-525c-4294-bb02-61c9d17923cc tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:12.708490 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6a9bc2de-525c-4294-bb02-61c9d17923cc tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:12.708962 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6a9bc2de-525c-4294-bb02-61c9d17923cc tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:12.709704 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6a9bc2de-525c-4294-bb02-61c9d17923cc tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:12.710129 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6a9bc2de-525c-4294-bb02-61c9d17923cc tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:12.736418 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-16812662-ced9-40e5-8818-c23d1d2f69dc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:12.737268 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-16812662-ced9-40e5-8818-c23d1d2f69dc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:12.743192 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-16812662-ced9-40e5-8818-c23d1d2f69dc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:12.743673 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-16812662-ced9-40e5-8818-c23d1d2f69dc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:12.744436 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-16812662-ced9-40e5-8818-c23d1d2f69dc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:12.744874 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-16812662-ced9-40e5-8818-c23d1d2f69dc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:12.774737 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-16812662-ced9-40e5-8818-c23d1d2f69dc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042216 Jul 11 11:34:12.775336 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 642/1283] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:12 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:34:12.779707 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-7503a6db-e923-4220-9d97-d9b00b86cf3f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:12.780307 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-7503a6db-e923-4220-9d97-d9b00b86cf3f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:12.786027 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7503a6db-e923-4220-9d97-d9b00b86cf3f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:12.786477 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7503a6db-e923-4220-9d97-d9b00b86cf3f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:12.787245 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7503a6db-e923-4220-9d97-d9b00b86cf3f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:12.787697 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7503a6db-e923-4220-9d97-d9b00b86cf3f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:12.845129 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-6a9bc2de-525c-4294-bb02-61c9d17923cc tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:12.853603 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-6a9bc2de-525c-4294-bb02-61c9d17923cc tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:12.855103 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-6a9bc2de-525c-4294-bb02-61c9d17923cc tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:12.856285 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-6a9bc2de-525c-4294-bb02-61c9d17923cc tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.159876 Jul 11 11:34:12.856845 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 642/1284] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:34:12 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:34:12.918193 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-7503a6db-e923-4220-9d97-d9b00b86cf3f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:12.926203 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-7503a6db-e923-4220-9d97-d9b00b86cf3f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.149916 Jul 11 11:34:12.926780 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 643/1285] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:34:12 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:34:13.666058 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-c3bed7ed-2d2b-44cf-a91b-87e4373c8d8a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:13.667036 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-c3bed7ed-2d2b-44cf-a91b-87e4373c8d8a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:13.673791 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c3bed7ed-2d2b-44cf-a91b-87e4373c8d8a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:13.674237 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c3bed7ed-2d2b-44cf-a91b-87e4373c8d8a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:13.674992 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c3bed7ed-2d2b-44cf-a91b-87e4373c8d8a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:13.675458 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c3bed7ed-2d2b-44cf-a91b-87e4373c8d8a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:13.704733 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-c3bed7ed-2d2b-44cf-a91b-87e4373c8d8a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042548 Jul 11 11:34:13.705355 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 643/1286] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:13 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:13.786415 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-d421d978-ed8d-4451-9482-16036125cec5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:13.787388 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-d421d978-ed8d-4451-9482-16036125cec5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:13.793985 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d421d978-ed8d-4451-9482-16036125cec5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:13.794440 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d421d978-ed8d-4451-9482-16036125cec5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:13.795207 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d421d978-ed8d-4451-9482-16036125cec5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:13.795677 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d421d978-ed8d-4451-9482-16036125cec5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:13.824537 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-d421d978-ed8d-4451-9482-16036125cec5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042592 Jul 11 11:34:13.825084 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 644/1287] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:13 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:13.874195 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-3fddefe9-0df8-4df4-a71a-21c11af45ec7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:13.874801 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-3fddefe9-0df8-4df4-a71a-21c11af45ec7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:13.880733 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3fddefe9-0df8-4df4-a71a-21c11af45ec7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:13.881179 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3fddefe9-0df8-4df4-a71a-21c11af45ec7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:13.881934 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3fddefe9-0df8-4df4-a71a-21c11af45ec7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:13.882364 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3fddefe9-0df8-4df4-a71a-21c11af45ec7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:13.943133 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-ad652e58-3659-4b48-882b-acfb5fbc6532 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:13.943801 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-ad652e58-3659-4b48-882b-acfb5fbc6532 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:13.949668 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ad652e58-3659-4b48-882b-acfb5fbc6532 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:13.950117 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ad652e58-3659-4b48-882b-acfb5fbc6532 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:13.950881 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ad652e58-3659-4b48-882b-acfb5fbc6532 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:13.951341 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ad652e58-3659-4b48-882b-acfb5fbc6532 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:14.010321 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-3fddefe9-0df8-4df4-a71a-21c11af45ec7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:14.019326 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-3fddefe9-0df8-4df4-a71a-21c11af45ec7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:14.020845 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-3fddefe9-0df8-4df4-a71a-21c11af45ec7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:14.022065 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-3fddefe9-0df8-4df4-a71a-21c11af45ec7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.151690 Jul 11 11:34:14.022593 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 644/1288] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:34:13 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:34:14.080151 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-ad652e58-3659-4b48-882b-acfb5fbc6532 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:14.088198 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-ad652e58-3659-4b48-882b-acfb5fbc6532 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.149189 Jul 11 11:34:14.089203 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 645/1289] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:34:13 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:34:14.716382 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-cc5267ea-267e-4db7-b196-0eddb208e4f9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:14.717278 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-cc5267ea-267e-4db7-b196-0eddb208e4f9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:14.723738 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-cc5267ea-267e-4db7-b196-0eddb208e4f9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:14.724173 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-cc5267ea-267e-4db7-b196-0eddb208e4f9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:14.724917 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-cc5267ea-267e-4db7-b196-0eddb208e4f9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:14.725371 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-cc5267ea-267e-4db7-b196-0eddb208e4f9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:14.753833 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-cc5267ea-267e-4db7-b196-0eddb208e4f9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041459 Jul 11 11:34:14.754304 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 645/1290] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:14 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:14.838313 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-db776bbc-1176-4534-8b56-4d094d30547d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:14.839341 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-db776bbc-1176-4534-8b56-4d094d30547d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:14.845745 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-db776bbc-1176-4534-8b56-4d094d30547d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:14.846188 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-db776bbc-1176-4534-8b56-4d094d30547d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:14.846945 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-db776bbc-1176-4534-8b56-4d094d30547d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:14.847412 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-db776bbc-1176-4534-8b56-4d094d30547d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:14.875867 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-db776bbc-1176-4534-8b56-4d094d30547d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042064 Jul 11 11:34:14.877095 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 646/1291] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:14 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:15.040919 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-1eb85f95-51e9-4b35-9775-b6444931855e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:15.041450 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-1eb85f95-51e9-4b35-9775-b6444931855e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:15.047393 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1eb85f95-51e9-4b35-9775-b6444931855e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:15.048425 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1eb85f95-51e9-4b35-9775-b6444931855e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:15.049229 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1eb85f95-51e9-4b35-9775-b6444931855e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:15.050114 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1eb85f95-51e9-4b35-9775-b6444931855e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:15.068510 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:34:15.105648 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-c934e2e4-4047-494d-8e48-3bcd3b9d2133 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:15.106259 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-c934e2e4-4047-494d-8e48-3bcd3b9d2133 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:15.112862 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c934e2e4-4047-494d-8e48-3bcd3b9d2133 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:15.113309 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c934e2e4-4047-494d-8e48-3bcd3b9d2133 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:15.114069 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c934e2e4-4047-494d-8e48-3bcd3b9d2133 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:15.114502 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c934e2e4-4047-494d-8e48-3bcd3b9d2133 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:15.118478 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=100 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:34:15.186519 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-1eb85f95-51e9-4b35-9775-b6444931855e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:15.195539 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-1eb85f95-51e9-4b35-9775-b6444931855e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:15.205406 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-1eb85f95-51e9-4b35-9775-b6444931855e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:15.205406 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-1eb85f95-51e9-4b35-9775-b6444931855e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.161395 Jul 11 11:34:15.205406 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 646/1292] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:34:15 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:34:15.244988 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-c934e2e4-4047-494d-8e48-3bcd3b9d2133 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:15.252885 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-c934e2e4-4047-494d-8e48-3bcd3b9d2133 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.151103 Jul 11 11:34:15.253450 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 647/1293] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:34:15 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:34:15.765224 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-d6e448b8-6e3d-42eb-a005-793bc00cb466 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:15.766139 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-d6e448b8-6e3d-42eb-a005-793bc00cb466 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:15.773161 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d6e448b8-6e3d-42eb-a005-793bc00cb466 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:15.773603 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d6e448b8-6e3d-42eb-a005-793bc00cb466 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:15.774352 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d6e448b8-6e3d-42eb-a005-793bc00cb466 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:15.774779 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d6e448b8-6e3d-42eb-a005-793bc00cb466 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:15.802629 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-d6e448b8-6e3d-42eb-a005-793bc00cb466 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041260 Jul 11 11:34:15.803124 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 647/1294] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:15 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:15.887562 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-e66b1b92-7c78-404d-920c-f07cb7ca5489 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:15.888486 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-e66b1b92-7c78-404d-920c-f07cb7ca5489 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:15.895539 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e66b1b92-7c78-404d-920c-f07cb7ca5489 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:15.895975 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e66b1b92-7c78-404d-920c-f07cb7ca5489 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:15.896735 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e66b1b92-7c78-404d-920c-f07cb7ca5489 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:15.897170 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e66b1b92-7c78-404d-920c-f07cb7ca5489 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:15.924809 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-e66b1b92-7c78-404d-920c-f07cb7ca5489 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041118 Jul 11 11:34:15.925243 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 648/1295] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:15 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:16.217384 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-b3b0893c-fa8e-4d4c-b3ea-44fb723d6ec1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:16.218009 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-b3b0893c-fa8e-4d4c-b3ea-44fb723d6ec1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:16.224101 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b3b0893c-fa8e-4d4c-b3ea-44fb723d6ec1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:16.224545 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b3b0893c-fa8e-4d4c-b3ea-44fb723d6ec1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:16.225302 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b3b0893c-fa8e-4d4c-b3ea-44fb723d6ec1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:16.225729 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b3b0893c-fa8e-4d4c-b3ea-44fb723d6ec1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:16.270886 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-26cefb5e-dc7c-4c01-af8f-15bec9582d9f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:16.272313 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-26cefb5e-dc7c-4c01-af8f-15bec9582d9f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:16.280932 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-26cefb5e-dc7c-4c01-af8f-15bec9582d9f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:16.281393 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-26cefb5e-dc7c-4c01-af8f-15bec9582d9f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:16.282205 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-26cefb5e-dc7c-4c01-af8f-15bec9582d9f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:16.282737 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-26cefb5e-dc7c-4c01-af8f-15bec9582d9f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:16.361297 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-b3b0893c-fa8e-4d4c-b3ea-44fb723d6ec1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:16.369839 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-b3b0893c-fa8e-4d4c-b3ea-44fb723d6ec1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:16.371369 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-b3b0893c-fa8e-4d4c-b3ea-44fb723d6ec1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:16.372563 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-b3b0893c-fa8e-4d4c-b3ea-44fb723d6ec1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.159889 Jul 11 11:34:16.373118 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 648/1296] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:34:16 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:34:16.414879 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-26cefb5e-dc7c-4c01-af8f-15bec9582d9f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:16.423414 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-26cefb5e-dc7c-4c01-af8f-15bec9582d9f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.155807 Jul 11 11:34:16.423980 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 649/1297] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:34:16 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:34:16.813607 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-cc54d337-b720-4c1b-a42b-da3cd44ea9b9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:16.814527 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-cc54d337-b720-4c1b-a42b-da3cd44ea9b9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:16.821212 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-cc54d337-b720-4c1b-a42b-da3cd44ea9b9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:16.821660 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-cc54d337-b720-4c1b-a42b-da3cd44ea9b9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:16.822412 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-cc54d337-b720-4c1b-a42b-da3cd44ea9b9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:16.822849 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-cc54d337-b720-4c1b-a42b-da3cd44ea9b9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:16.854097 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-cc54d337-b720-4c1b-a42b-da3cd44ea9b9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044416 Jul 11 11:34:16.854657 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 649/1298] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:16 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:16.935363 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-5fcab91b-4975-4e59-b06e-9e663818ff24 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:16.936313 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-5fcab91b-4975-4e59-b06e-9e663818ff24 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:16.942965 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5fcab91b-4975-4e59-b06e-9e663818ff24 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:16.943444 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5fcab91b-4975-4e59-b06e-9e663818ff24 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:16.944197 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5fcab91b-4975-4e59-b06e-9e663818ff24 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:16.944627 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5fcab91b-4975-4e59-b06e-9e663818ff24 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:16.973390 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-5fcab91b-4975-4e59-b06e-9e663818ff24 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042033 Jul 11 11:34:16.973935 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 650/1299] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:16 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:17.390388 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-99231bf7-5732-4095-9880-ac8b7c481c52 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:17.390997 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-99231bf7-5732-4095-9880-ac8b7c481c52 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:17.397750 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-99231bf7-5732-4095-9880-ac8b7c481c52 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:17.398194 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-99231bf7-5732-4095-9880-ac8b7c481c52 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:17.398953 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-99231bf7-5732-4095-9880-ac8b7c481c52 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:17.399425 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-99231bf7-5732-4095-9880-ac8b7c481c52 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:17.440679 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-926d798b-aab9-42d7-89f2-0f2a33d1008f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:17.441536 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-926d798b-aab9-42d7-89f2-0f2a33d1008f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:17.447529 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-926d798b-aab9-42d7-89f2-0f2a33d1008f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:17.447978 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-926d798b-aab9-42d7-89f2-0f2a33d1008f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:17.448726 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-926d798b-aab9-42d7-89f2-0f2a33d1008f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:17.449153 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-926d798b-aab9-42d7-89f2-0f2a33d1008f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:17.526675 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-99231bf7-5732-4095-9880-ac8b7c481c52 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:17.535477 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-99231bf7-5732-4095-9880-ac8b7c481c52 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:17.536990 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-99231bf7-5732-4095-9880-ac8b7c481c52 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:17.538149 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-99231bf7-5732-4095-9880-ac8b7c481c52 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.151663 Jul 11 11:34:17.539243 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 650/1300] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:34:17 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:34:17.581710 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-926d798b-aab9-42d7-89f2-0f2a33d1008f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:17.589734 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-926d798b-aab9-42d7-89f2-0f2a33d1008f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.153417 Jul 11 11:34:17.590337 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 651/1301] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:34:17 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:34:17.866438 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-3c718e3f-5d02-4c84-959b-50ab964f0a6e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:17.867321 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-3c718e3f-5d02-4c84-959b-50ab964f0a6e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:17.873725 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3c718e3f-5d02-4c84-959b-50ab964f0a6e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:17.874197 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3c718e3f-5d02-4c84-959b-50ab964f0a6e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:17.874970 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3c718e3f-5d02-4c84-959b-50ab964f0a6e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:17.875439 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3c718e3f-5d02-4c84-959b-50ab964f0a6e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:17.904044 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-3c718e3f-5d02-4c84-959b-50ab964f0a6e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041760 Jul 11 11:34:17.904593 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 651/1302] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:17 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:17.984893 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-14040bba-e2c5-45cc-bd01-9e93433232ab tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:17.986471 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-14040bba-e2c5-45cc-bd01-9e93433232ab tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:17.993038 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-14040bba-e2c5-45cc-bd01-9e93433232ab tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:18.000477 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-14040bba-e2c5-45cc-bd01-9e93433232ab tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:18.000477 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-14040bba-e2c5-45cc-bd01-9e93433232ab tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:18.000477 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-14040bba-e2c5-45cc-bd01-9e93433232ab tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:18.022800 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-14040bba-e2c5-45cc-bd01-9e93433232ab tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041820 Jul 11 11:34:18.023438 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 652/1303] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:17 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:18.555865 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-792dfdc6-a12f-46ac-8d44-e40bd02b724d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:18.556577 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-792dfdc6-a12f-46ac-8d44-e40bd02b724d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:18.562628 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-792dfdc6-a12f-46ac-8d44-e40bd02b724d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:18.563068 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-792dfdc6-a12f-46ac-8d44-e40bd02b724d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:18.564018 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-792dfdc6-a12f-46ac-8d44-e40bd02b724d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:18.564453 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-792dfdc6-a12f-46ac-8d44-e40bd02b724d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:18.606106 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-005aa335-bead-4b87-b3c0-129a4e3bd9b2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:18.606631 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-005aa335-bead-4b87-b3c0-129a4e3bd9b2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:18.612763 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-005aa335-bead-4b87-b3c0-129a4e3bd9b2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:18.613210 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-005aa335-bead-4b87-b3c0-129a4e3bd9b2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:18.614174 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-005aa335-bead-4b87-b3c0-129a4e3bd9b2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:18.614613 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-005aa335-bead-4b87-b3c0-129a4e3bd9b2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:18.698580 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-792dfdc6-a12f-46ac-8d44-e40bd02b724d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:18.708436 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-792dfdc6-a12f-46ac-8d44-e40bd02b724d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:18.710114 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-792dfdc6-a12f-46ac-8d44-e40bd02b724d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:18.711299 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-792dfdc6-a12f-46ac-8d44-e40bd02b724d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.159339 Jul 11 11:34:18.712037 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 652/1304] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:34:18 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:34:18.753687 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-005aa335-bead-4b87-b3c0-129a4e3bd9b2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:18.761575 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-005aa335-bead-4b87-b3c0-129a4e3bd9b2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.159533 Jul 11 11:34:18.762140 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 653/1305] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:34:18 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:34:18.915981 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-cbc767d1-a068-43ae-a706-fb9b720cb0b4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:18.916893 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-cbc767d1-a068-43ae-a706-fb9b720cb0b4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:18.923245 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-cbc767d1-a068-43ae-a706-fb9b720cb0b4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:18.923714 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-cbc767d1-a068-43ae-a706-fb9b720cb0b4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:18.924465 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-cbc767d1-a068-43ae-a706-fb9b720cb0b4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:18.924911 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-cbc767d1-a068-43ae-a706-fb9b720cb0b4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:18.953869 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-cbc767d1-a068-43ae-a706-fb9b720cb0b4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041868 Jul 11 11:34:18.954421 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 653/1306] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:18 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:18.980515 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 11:34:18.980709 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Mon Jul 11 11:34:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 11:34:19.034485 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-ab0ea363-9c4d-4ae2-86c4-0e46e8479bbb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:19.035469 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-ab0ea363-9c4d-4ae2-86c4-0e46e8479bbb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:19.042006 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ab0ea363-9c4d-4ae2-86c4-0e46e8479bbb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:19.042468 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ab0ea363-9c4d-4ae2-86c4-0e46e8479bbb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:19.043288 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ab0ea363-9c4d-4ae2-86c4-0e46e8479bbb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:19.043729 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ab0ea363-9c4d-4ae2-86c4-0e46e8479bbb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:19.073991 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-ab0ea363-9c4d-4ae2-86c4-0e46e8479bbb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043003 Jul 11 11:34:19.074127 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 654/1307] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:19 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:19.730277 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-046c6da5-0201-4bc7-a75c-fe1f0284b342 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:19.730881 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-046c6da5-0201-4bc7-a75c-fe1f0284b342 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:19.737924 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-046c6da5-0201-4bc7-a75c-fe1f0284b342 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:19.738360 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-046c6da5-0201-4bc7-a75c-fe1f0284b342 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:19.739109 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-046c6da5-0201-4bc7-a75c-fe1f0284b342 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:19.739561 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-046c6da5-0201-4bc7-a75c-fe1f0284b342 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:19.778946 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-d6b378d0-be52-485c-9ad1-21b578a5f5fb tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:19.780523 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-d6b378d0-be52-485c-9ad1-21b578a5f5fb tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:19.788042 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d6b378d0-be52-485c-9ad1-21b578a5f5fb tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:19.788583 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d6b378d0-be52-485c-9ad1-21b578a5f5fb tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:19.789363 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d6b378d0-be52-485c-9ad1-21b578a5f5fb tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:19.789798 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d6b378d0-be52-485c-9ad1-21b578a5f5fb tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:19.869207 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-046c6da5-0201-4bc7-a75c-fe1f0284b342 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:19.878147 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-046c6da5-0201-4bc7-a75c-fe1f0284b342 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:19.879679 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-046c6da5-0201-4bc7-a75c-fe1f0284b342 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:19.880826 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-046c6da5-0201-4bc7-a75c-fe1f0284b342 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.154533 Jul 11 11:34:19.881424 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 654/1308] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:34:19 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:34:19.926626 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-d6b378d0-be52-485c-9ad1-21b578a5f5fb tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:19.934380 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-d6b378d0-be52-485c-9ad1-21b578a5f5fb tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.159281 Jul 11 11:34:19.934941 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 655/1309] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:34:19 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:34:19.965891 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-3f033932-dbf7-40fa-add0-4c812b89fb95 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:19.966923 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-3f033932-dbf7-40fa-add0-4c812b89fb95 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:19.973420 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3f033932-dbf7-40fa-add0-4c812b89fb95 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:19.973860 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3f033932-dbf7-40fa-add0-4c812b89fb95 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:19.974603 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3f033932-dbf7-40fa-add0-4c812b89fb95 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:19.975028 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3f033932-dbf7-40fa-add0-4c812b89fb95 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:20.004453 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-3f033932-dbf7-40fa-add0-4c812b89fb95 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042409 Jul 11 11:34:20.004933 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 655/1310] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:19 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:20.084700 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-8998c68d-1d50-4fa6-9028-ceaab46f3bfa tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:20.085629 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-8998c68d-1d50-4fa6-9028-ceaab46f3bfa tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:20.092038 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8998c68d-1d50-4fa6-9028-ceaab46f3bfa tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:20.092488 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8998c68d-1d50-4fa6-9028-ceaab46f3bfa tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:20.093237 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8998c68d-1d50-4fa6-9028-ceaab46f3bfa tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:20.093671 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8998c68d-1d50-4fa6-9028-ceaab46f3bfa tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:20.122090 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-8998c68d-1d50-4fa6-9028-ceaab46f3bfa tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041340 Jul 11 11:34:20.122640 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 656/1311] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:20 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:20.899525 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-4c917eca-2c89-4f0b-b011-d88febd48752 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:20.900158 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-4c917eca-2c89-4f0b-b011-d88febd48752 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:20.906111 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4c917eca-2c89-4f0b-b011-d88febd48752 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:20.906551 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4c917eca-2c89-4f0b-b011-d88febd48752 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:20.907331 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4c917eca-2c89-4f0b-b011-d88febd48752 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:20.907760 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4c917eca-2c89-4f0b-b011-d88febd48752 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:20.951972 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-b9fe1c5d-c86e-478a-b3b6-0f183f0d1a2e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:20.952692 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-b9fe1c5d-c86e-478a-b3b6-0f183f0d1a2e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:20.958703 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b9fe1c5d-c86e-478a-b3b6-0f183f0d1a2e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:20.959221 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b9fe1c5d-c86e-478a-b3b6-0f183f0d1a2e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:20.960075 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b9fe1c5d-c86e-478a-b3b6-0f183f0d1a2e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:20.960579 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b9fe1c5d-c86e-478a-b3b6-0f183f0d1a2e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:21.045192 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-4c917eca-2c89-4f0b-b011-d88febd48752 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:21.054735 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-4c917eca-2c89-4f0b-b011-d88febd48752 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:21.056206 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-4c917eca-2c89-4f0b-b011-d88febd48752 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:21.057412 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-4c917eca-2c89-4f0b-b011-d88febd48752 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.161787 Jul 11 11:34:21.057959 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 656/1312] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:34:20 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:34:21.062605 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-aa3934f8-b9a7-40cb-83d1-69039bbe8e4e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:21.063481 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-aa3934f8-b9a7-40cb-83d1-69039bbe8e4e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:21.072156 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-aa3934f8-b9a7-40cb-83d1-69039bbe8e4e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:21.072156 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-aa3934f8-b9a7-40cb-83d1-69039bbe8e4e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:21.072156 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-aa3934f8-b9a7-40cb-83d1-69039bbe8e4e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:21.072156 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-aa3934f8-b9a7-40cb-83d1-69039bbe8e4e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:21.098858 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-b9fe1c5d-c86e-478a-b3b6-0f183f0d1a2e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:21.101634 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-aa3934f8-b9a7-40cb-83d1-69039bbe8e4e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042639 Jul 11 11:34:21.102375 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 657/1313] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:21 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:21.107099 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-b9fe1c5d-c86e-478a-b3b6-0f183f0d1a2e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.158966 Jul 11 11:34:21.107686 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 657/1314] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:34:20 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:34:21.133137 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-432a77d6-cf0e-42f9-8f8b-0480743d6810 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:21.134066 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-432a77d6-cf0e-42f9-8f8b-0480743d6810 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:21.139881 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-432a77d6-cf0e-42f9-8f8b-0480743d6810 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:21.140322 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-432a77d6-cf0e-42f9-8f8b-0480743d6810 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:21.141066 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-432a77d6-cf0e-42f9-8f8b-0480743d6810 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:21.141492 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-432a77d6-cf0e-42f9-8f8b-0480743d6810 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:21.169343 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-432a77d6-cf0e-42f9-8f8b-0480743d6810 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039922 Jul 11 11:34:21.169873 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 658/1315] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:21 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:34:21.898772 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 11:34:21.898985 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Mon Jul 11 11:34:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 11:34:22.076056 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-cd832371-1a68-4097-9f75-d5693fd4dd31 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:22.076666 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-cd832371-1a68-4097-9f75-d5693fd4dd31 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:22.082786 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cd832371-1a68-4097-9f75-d5693fd4dd31 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:22.083243 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cd832371-1a68-4097-9f75-d5693fd4dd31 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:22.084032 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cd832371-1a68-4097-9f75-d5693fd4dd31 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:22.084476 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cd832371-1a68-4097-9f75-d5693fd4dd31 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:22.113688 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-614e79ec-a142-4080-8d7c-d90b2ba70e4c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:22.115383 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-614e79ec-a142-4080-8d7c-d90b2ba70e4c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:22.122701 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-614e79ec-a142-4080-8d7c-d90b2ba70e4c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:22.123146 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-614e79ec-a142-4080-8d7c-d90b2ba70e4c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:22.123945 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-614e79ec-a142-4080-8d7c-d90b2ba70e4c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:22.124374 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-614e79ec-a142-4080-8d7c-d90b2ba70e4c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:22.154264 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-614e79ec-a142-4080-8d7c-d90b2ba70e4c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045050 Jul 11 11:34:22.154818 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 659/1316] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:22 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:34:22.159118 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-26e526ba-6495-47d4-b19b-0525ddfe0e14 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:22.159784 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-26e526ba-6495-47d4-b19b-0525ddfe0e14 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:22.165503 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-26e526ba-6495-47d4-b19b-0525ddfe0e14 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:22.165787 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-26e526ba-6495-47d4-b19b-0525ddfe0e14 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:22.166541 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-26e526ba-6495-47d4-b19b-0525ddfe0e14 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:22.166966 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-26e526ba-6495-47d4-b19b-0525ddfe0e14 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:22.216040 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-cd832371-1a68-4097-9f75-d5693fd4dd31 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:22.224545 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-cd832371-1a68-4097-9f75-d5693fd4dd31 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:22.226133 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-cd832371-1a68-4097-9f75-d5693fd4dd31 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:22.227322 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-cd832371-1a68-4097-9f75-d5693fd4dd31 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.155227 Jul 11 11:34:22.227878 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 658/1317] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:34:22 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:34:22.232319 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-7bcab85c-377e-41ac-8e07-d0e5d5aef349 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:22.233216 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-7bcab85c-377e-41ac-8e07-d0e5d5aef349 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:22.235975 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_api:SELECT=100 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:34:22.239977 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7bcab85c-377e-41ac-8e07-d0e5d5aef349 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:22.240420 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7bcab85c-377e-41ac-8e07-d0e5d5aef349 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:22.241177 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7bcab85c-377e-41ac-8e07-d0e5d5aef349 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:22.241604 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7bcab85c-377e-41ac-8e07-d0e5d5aef349 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:22.271679 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-7bcab85c-377e-41ac-8e07-d0e5d5aef349 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042713 Jul 11 11:34:22.272238 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 659/1318] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:22 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:22.295231 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-26e526ba-6495-47d4-b19b-0525ddfe0e14 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:22.303612 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-26e526ba-6495-47d4-b19b-0525ddfe0e14 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.147789 Jul 11 11:34:22.304183 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 660/1319] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:34:22 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:34:23.165939 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-9d9a4f86-f26a-4e02-902a-7a82b40e953a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:23.166786 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-9d9a4f86-f26a-4e02-902a-7a82b40e953a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:23.173605 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9d9a4f86-f26a-4e02-902a-7a82b40e953a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:23.174188 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9d9a4f86-f26a-4e02-902a-7a82b40e953a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:23.174938 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9d9a4f86-f26a-4e02-902a-7a82b40e953a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:23.175393 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9d9a4f86-f26a-4e02-902a-7a82b40e953a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:23.205743 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-9d9a4f86-f26a-4e02-902a-7a82b40e953a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043128 Jul 11 11:34:23.206313 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 660/1320] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:23 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:23.246091 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-f4d5c243-7852-45a4-8a95-615e94fdbc6e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:23.246697 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-f4d5c243-7852-45a4-8a95-615e94fdbc6e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:23.250104 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_api:SELECT=100 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:34:23.254053 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f4d5c243-7852-45a4-8a95-615e94fdbc6e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:23.254502 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f4d5c243-7852-45a4-8a95-615e94fdbc6e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:23.255274 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f4d5c243-7852-45a4-8a95-615e94fdbc6e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:23.255706 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f4d5c243-7852-45a4-8a95-615e94fdbc6e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:23.283118 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-2bb91eff-a14f-4a51-a613-23459dd8f472 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:23.284136 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-2bb91eff-a14f-4a51-a613-23459dd8f472 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:23.290333 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2bb91eff-a14f-4a51-a613-23459dd8f472 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:23.290777 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2bb91eff-a14f-4a51-a613-23459dd8f472 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:23.291566 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2bb91eff-a14f-4a51-a613-23459dd8f472 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:23.292000 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2bb91eff-a14f-4a51-a613-23459dd8f472 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:23.321704 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-2bb91eff-a14f-4a51-a613-23459dd8f472 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042572 Jul 11 11:34:23.322263 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 661/1321] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:23 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:34:23.326616 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-96292152-0967-483d-bdf7-8058d3262d7c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:23.327213 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-96292152-0967-483d-bdf7-8058d3262d7c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:23.333430 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-96292152-0967-483d-bdf7-8058d3262d7c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:23.333880 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-96292152-0967-483d-bdf7-8058d3262d7c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:23.334636 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-96292152-0967-483d-bdf7-8058d3262d7c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:23.335068 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-96292152-0967-483d-bdf7-8058d3262d7c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:23.385963 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-f4d5c243-7852-45a4-8a95-615e94fdbc6e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:23.394970 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-f4d5c243-7852-45a4-8a95-615e94fdbc6e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:23.396585 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-f4d5c243-7852-45a4-8a95-615e94fdbc6e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:23.397723 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-f4d5c243-7852-45a4-8a95-615e94fdbc6e tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.155585 Jul 11 11:34:23.398282 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 661/1322] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:34:23 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:34:23.461197 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-96292152-0967-483d-bdf7-8058d3262d7c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:23.469093 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-96292152-0967-483d-bdf7-8058d3262d7c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.145920 Jul 11 11:34:23.469652 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 662/1323] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:34:23 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:34:24.217317 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-edea9239-13fb-4e3f-b86d-0d34ccb55146 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:24.218220 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-edea9239-13fb-4e3f-b86d-0d34ccb55146 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:24.224836 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-edea9239-13fb-4e3f-b86d-0d34ccb55146 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:24.225266 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-edea9239-13fb-4e3f-b86d-0d34ccb55146 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:24.226009 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-edea9239-13fb-4e3f-b86d-0d34ccb55146 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:24.226434 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-edea9239-13fb-4e3f-b86d-0d34ccb55146 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:24.254760 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-edea9239-13fb-4e3f-b86d-0d34ccb55146 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041588 Jul 11 11:34:24.255413 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 662/1324] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:24 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:24.333641 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-f0558adf-4c1b-4ab3-bb44-3f25dedfd95d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:24.334596 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-f0558adf-4c1b-4ab3-bb44-3f25dedfd95d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:24.341163 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f0558adf-4c1b-4ab3-bb44-3f25dedfd95d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:24.341612 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f0558adf-4c1b-4ab3-bb44-3f25dedfd95d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:24.342369 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f0558adf-4c1b-4ab3-bb44-3f25dedfd95d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:24.342805 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f0558adf-4c1b-4ab3-bb44-3f25dedfd95d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:24.367166 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=100 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:34:24.371539 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-f0558adf-4c1b-4ab3-bb44-3f25dedfd95d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042342 Jul 11 11:34:24.372081 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 663/1325] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:24 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:24.416127 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-00b7562c-642c-41c5-b932-b19eb4446487 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:24.416729 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-00b7562c-642c-41c5-b932-b19eb4446487 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:24.422553 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-00b7562c-642c-41c5-b932-b19eb4446487 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:24.422990 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-00b7562c-642c-41c5-b932-b19eb4446487 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:24.423767 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-00b7562c-642c-41c5-b932-b19eb4446487 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:24.424197 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-00b7562c-642c-41c5-b932-b19eb4446487 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:24.428029 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=100 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:34:24.485194 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-19f59c9c-8e24-4b9a-9da6-8faee754efac tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:24.485711 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-19f59c9c-8e24-4b9a-9da6-8faee754efac tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:24.492069 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-19f59c9c-8e24-4b9a-9da6-8faee754efac tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:24.492525 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-19f59c9c-8e24-4b9a-9da6-8faee754efac tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:24.493285 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-19f59c9c-8e24-4b9a-9da6-8faee754efac tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:24.493718 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-19f59c9c-8e24-4b9a-9da6-8faee754efac tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:24.555895 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-00b7562c-642c-41c5-b932-b19eb4446487 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:24.564233 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-00b7562c-642c-41c5-b932-b19eb4446487 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:24.565770 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-00b7562c-642c-41c5-b932-b19eb4446487 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:24.567190 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-00b7562c-642c-41c5-b932-b19eb4446487 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.154880 Jul 11 11:34:24.577637 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 663/1326] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:34:24 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:34:24.622165 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-19f59c9c-8e24-4b9a-9da6-8faee754efac tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:24.630128 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-19f59c9c-8e24-4b9a-9da6-8faee754efac tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.148840 Jul 11 11:34:24.630688 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 664/1327] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:34:24 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:34:25.266204 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-e412faaf-2db3-417f-a7ca-4e96b63d4a81 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:25.267130 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-e412faaf-2db3-417f-a7ca-4e96b63d4a81 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:25.273665 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e412faaf-2db3-417f-a7ca-4e96b63d4a81 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:25.274057 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e412faaf-2db3-417f-a7ca-4e96b63d4a81 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:25.274812 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e412faaf-2db3-417f-a7ca-4e96b63d4a81 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:25.275273 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e412faaf-2db3-417f-a7ca-4e96b63d4a81 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:25.303147 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-e412faaf-2db3-417f-a7ca-4e96b63d4a81 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040946 Jul 11 11:34:25.303723 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 664/1328] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:25 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:25.383591 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-ca4099b1-f940-4a9f-a241-4a0da3f6c9ec tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:25.384515 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-ca4099b1-f940-4a9f-a241-4a0da3f6c9ec tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:25.391081 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ca4099b1-f940-4a9f-a241-4a0da3f6c9ec tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:25.391557 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ca4099b1-f940-4a9f-a241-4a0da3f6c9ec tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:25.392322 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ca4099b1-f940-4a9f-a241-4a0da3f6c9ec tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:25.392774 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ca4099b1-f940-4a9f-a241-4a0da3f6c9ec tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:25.420908 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-ca4099b1-f940-4a9f-a241-4a0da3f6c9ec tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041273 Jul 11 11:34:25.421464 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 665/1329] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:25 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:25.585330 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-888907f0-ebb7-4a0b-b8b6-51e119d1a9d3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:25.585860 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-888907f0-ebb7-4a0b-b8b6-51e119d1a9d3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:25.591755 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-888907f0-ebb7-4a0b-b8b6-51e119d1a9d3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:25.592200 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-888907f0-ebb7-4a0b-b8b6-51e119d1a9d3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:25.592952 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-888907f0-ebb7-4a0b-b8b6-51e119d1a9d3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:25.593383 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-888907f0-ebb7-4a0b-b8b6-51e119d1a9d3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:25.646933 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-ee0482ae-a2b6-4fe8-8da7-04177d550a1a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:25.647569 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-ee0482ae-a2b6-4fe8-8da7-04177d550a1a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:25.653624 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ee0482ae-a2b6-4fe8-8da7-04177d550a1a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:25.654073 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ee0482ae-a2b6-4fe8-8da7-04177d550a1a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:25.654838 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ee0482ae-a2b6-4fe8-8da7-04177d550a1a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:25.655310 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ee0482ae-a2b6-4fe8-8da7-04177d550a1a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:25.738918 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-888907f0-ebb7-4a0b-b8b6-51e119d1a9d3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:25.751791 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-888907f0-ebb7-4a0b-b8b6-51e119d1a9d3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:25.751791 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-888907f0-ebb7-4a0b-b8b6-51e119d1a9d3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:25.752283 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-888907f0-ebb7-4a0b-b8b6-51e119d1a9d3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.170732 Jul 11 11:34:25.752844 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 665/1330] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:34:25 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:34:25.798370 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-ee0482ae-a2b6-4fe8-8da7-04177d550a1a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:25.806781 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-ee0482ae-a2b6-4fe8-8da7-04177d550a1a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.163693 Jul 11 11:34:25.807355 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 666/1331] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:34:25 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:34:26.319543 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-8807bad3-ae40-4bbc-bd97-5f83b7756ea9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:26.320479 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-8807bad3-ae40-4bbc-bd97-5f83b7756ea9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:26.329115 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8807bad3-ae40-4bbc-bd97-5f83b7756ea9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:26.332698 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8807bad3-ae40-4bbc-bd97-5f83b7756ea9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:26.333492 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8807bad3-ae40-4bbc-bd97-5f83b7756ea9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:26.333962 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8807bad3-ae40-4bbc-bd97-5f83b7756ea9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:26.362311 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-8807bad3-ae40-4bbc-bd97-5f83b7756ea9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051466 Jul 11 11:34:26.362986 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 666/1332] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:26 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:26.434581 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-f883a611-4928-41b5-9a4a-ecdad84d80cf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:26.435554 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-f883a611-4928-41b5-9a4a-ecdad84d80cf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:26.442812 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f883a611-4928-41b5-9a4a-ecdad84d80cf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:26.443278 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f883a611-4928-41b5-9a4a-ecdad84d80cf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:26.444020 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f883a611-4928-41b5-9a4a-ecdad84d80cf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:26.444448 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f883a611-4928-41b5-9a4a-ecdad84d80cf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:26.472866 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-f883a611-4928-41b5-9a4a-ecdad84d80cf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042238 Jul 11 11:34:26.473394 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 667/1333] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:26 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:26.769747 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-9d77e396-a8e5-4b05-8435-b05f351067c6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:26.770352 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-9d77e396-a8e5-4b05-8435-b05f351067c6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:26.776258 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9d77e396-a8e5-4b05-8435-b05f351067c6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:26.776695 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9d77e396-a8e5-4b05-8435-b05f351067c6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:26.777446 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9d77e396-a8e5-4b05-8435-b05f351067c6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:26.777872 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9d77e396-a8e5-4b05-8435-b05f351067c6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:26.823407 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-b3688229-ea5c-4df3-a0f9-6955831c0b78 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:26.824011 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-b3688229-ea5c-4df3-a0f9-6955831c0b78 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:26.829941 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b3688229-ea5c-4df3-a0f9-6955831c0b78 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:26.830383 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b3688229-ea5c-4df3-a0f9-6955831c0b78 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:26.831135 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b3688229-ea5c-4df3-a0f9-6955831c0b78 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:26.831595 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b3688229-ea5c-4df3-a0f9-6955831c0b78 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:26.920101 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-9d77e396-a8e5-4b05-8435-b05f351067c6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:26.929362 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-9d77e396-a8e5-4b05-8435-b05f351067c6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:26.930939 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-9d77e396-a8e5-4b05-8435-b05f351067c6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:26.932199 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-9d77e396-a8e5-4b05-8435-b05f351067c6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.166374 Jul 11 11:34:26.932859 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 667/1334] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:34:26 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:34:26.966275 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-b3688229-ea5c-4df3-a0f9-6955831c0b78 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:26.974576 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-b3688229-ea5c-4df3-a0f9-6955831c0b78 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.155009 Jul 11 11:34:26.975131 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 668/1335] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:34:26 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:34:27.373765 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-f8603779-8080-4d9b-82c7-83e642c9b018 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:27.374611 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-f8603779-8080-4d9b-82c7-83e642c9b018 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:27.381013 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f8603779-8080-4d9b-82c7-83e642c9b018 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:27.381458 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f8603779-8080-4d9b-82c7-83e642c9b018 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:27.382210 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f8603779-8080-4d9b-82c7-83e642c9b018 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:27.382642 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f8603779-8080-4d9b-82c7-83e642c9b018 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:27.411281 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-f8603779-8080-4d9b-82c7-83e642c9b018 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041460 Jul 11 11:34:27.411811 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 668/1336] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:27 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:27.484091 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-10aa030e-a31f-40d1-a1e6-c600aa90f344 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:27.485051 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-10aa030e-a31f-40d1-a1e6-c600aa90f344 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:27.491587 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-10aa030e-a31f-40d1-a1e6-c600aa90f344 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:27.492035 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-10aa030e-a31f-40d1-a1e6-c600aa90f344 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:27.492794 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-10aa030e-a31f-40d1-a1e6-c600aa90f344 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:27.493227 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-10aa030e-a31f-40d1-a1e6-c600aa90f344 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:27.522114 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-10aa030e-a31f-40d1-a1e6-c600aa90f344 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041903 Jul 11 11:34:27.524809 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 669/1337] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:27 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:34:27.951382 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-1a3ff9e7-fcba-46c0-bfc2-c88e7cbd6bca tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:27.951988 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-1a3ff9e7-fcba-46c0-bfc2-c88e7cbd6bca tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:27.958542 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1a3ff9e7-fcba-46c0-bfc2-c88e7cbd6bca tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:27.958983 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1a3ff9e7-fcba-46c0-bfc2-c88e7cbd6bca tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:27.959774 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1a3ff9e7-fcba-46c0-bfc2-c88e7cbd6bca tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:27.960237 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1a3ff9e7-fcba-46c0-bfc2-c88e7cbd6bca tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:27.991700 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-69da6932-930f-49b1-89ca-ca8ed2d5bc5f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:27.992399 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-69da6932-930f-49b1-89ca-ca8ed2d5bc5f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:27.998493 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-69da6932-930f-49b1-89ca-ca8ed2d5bc5f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:27.999027 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-69da6932-930f-49b1-89ca-ca8ed2d5bc5f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:27.999877 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-69da6932-930f-49b1-89ca-ca8ed2d5bc5f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:28.000376 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-69da6932-930f-49b1-89ca-ca8ed2d5bc5f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:28.088550 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-1a3ff9e7-fcba-46c0-bfc2-c88e7cbd6bca tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:28.097192 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-1a3ff9e7-fcba-46c0-bfc2-c88e7cbd6bca tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:28.098706 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-1a3ff9e7-fcba-46c0-bfc2-c88e7cbd6bca tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:28.099871 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-1a3ff9e7-fcba-46c0-bfc2-c88e7cbd6bca tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.152414 Jul 11 11:34:28.100445 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 669/1338] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:34:27 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:34:28.130454 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-69da6932-930f-49b1-89ca-ca8ed2d5bc5f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:28.138341 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-69da6932-930f-49b1-89ca-ca8ed2d5bc5f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.150695 Jul 11 11:34:28.138903 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 670/1339] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:34:27 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:34:28.422533 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-40f01675-ae85-469d-8436-1e774ec7366a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:28.423468 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-40f01675-ae85-469d-8436-1e774ec7366a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:28.430238 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-40f01675-ae85-469d-8436-1e774ec7366a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:28.430682 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-40f01675-ae85-469d-8436-1e774ec7366a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:28.431509 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-40f01675-ae85-469d-8436-1e774ec7366a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:28.431898 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-40f01675-ae85-469d-8436-1e774ec7366a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:28.460227 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-40f01675-ae85-469d-8436-1e774ec7366a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041603 Jul 11 11:34:28.460753 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 670/1340] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:28 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:28.534396 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-76101c79-ee20-493d-87c0-d5fc19a8dad1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:28.535480 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-76101c79-ee20-493d-87c0-d5fc19a8dad1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:28.541882 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-76101c79-ee20-493d-87c0-d5fc19a8dad1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:28.542329 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-76101c79-ee20-493d-87c0-d5fc19a8dad1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:28.543083 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-76101c79-ee20-493d-87c0-d5fc19a8dad1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:28.543542 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-76101c79-ee20-493d-87c0-d5fc19a8dad1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:28.572935 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-76101c79-ee20-493d-87c0-d5fc19a8dad1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042986 Jul 11 11:34:28.573481 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 671/1341] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:28 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:29.118161 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-cbe50ced-68c4-4a6e-8e5d-35b4ad8582c1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:29.118718 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-cbe50ced-68c4-4a6e-8e5d-35b4ad8582c1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:29.124717 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-cbe50ced-68c4-4a6e-8e5d-35b4ad8582c1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:29.125164 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-cbe50ced-68c4-4a6e-8e5d-35b4ad8582c1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:29.125918 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-cbe50ced-68c4-4a6e-8e5d-35b4ad8582c1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:29.126352 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-cbe50ced-68c4-4a6e-8e5d-35b4ad8582c1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:29.154998 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-b4da8d0b-5a95-4fba-ab92-1edd24ab7574 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:29.155802 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-b4da8d0b-5a95-4fba-ab92-1edd24ab7574 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:29.161800 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b4da8d0b-5a95-4fba-ab92-1edd24ab7574 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:29.162243 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b4da8d0b-5a95-4fba-ab92-1edd24ab7574 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:29.162998 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b4da8d0b-5a95-4fba-ab92-1edd24ab7574 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:29.163460 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b4da8d0b-5a95-4fba-ab92-1edd24ab7574 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:29.258537 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-cbe50ced-68c4-4a6e-8e5d-35b4ad8582c1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:29.266964 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-cbe50ced-68c4-4a6e-8e5d-35b4ad8582c1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:29.269104 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-cbe50ced-68c4-4a6e-8e5d-35b4ad8582c1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:29.270262 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-cbe50ced-68c4-4a6e-8e5d-35b4ad8582c1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.156019 Jul 11 11:34:29.270816 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 671/1342] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:34:29 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:34:29.296643 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-b4da8d0b-5a95-4fba-ab92-1edd24ab7574 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:29.304530 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-b4da8d0b-5a95-4fba-ab92-1edd24ab7574 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.153308 Jul 11 11:34:29.305081 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 672/1343] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:34:29 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:34:29.471616 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-e78327e0-f4a5-42ab-8ceb-b3a633230087 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:29.472532 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-e78327e0-f4a5-42ab-8ceb-b3a633230087 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:29.478828 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e78327e0-f4a5-42ab-8ceb-b3a633230087 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:29.479292 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e78327e0-f4a5-42ab-8ceb-b3a633230087 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:29.480048 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e78327e0-f4a5-42ab-8ceb-b3a633230087 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:29.480480 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e78327e0-f4a5-42ab-8ceb-b3a633230087 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:29.508521 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-e78327e0-f4a5-42ab-8ceb-b3a633230087 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040763 Jul 11 11:34:29.509063 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 672/1344] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:29 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:29.584455 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-3ebf8546-85df-48e1-b1c3-060d16f9f858 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:29.585524 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-3ebf8546-85df-48e1-b1c3-060d16f9f858 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:29.592091 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3ebf8546-85df-48e1-b1c3-060d16f9f858 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:29.592544 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3ebf8546-85df-48e1-b1c3-060d16f9f858 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:29.593311 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3ebf8546-85df-48e1-b1c3-060d16f9f858 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:29.593744 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3ebf8546-85df-48e1-b1c3-060d16f9f858 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:29.621940 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-3ebf8546-85df-48e1-b1c3-060d16f9f858 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041461 Jul 11 11:34:29.622511 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 673/1345] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:29 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:30.288838 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-ab9772b2-6181-46e6-b3c9-8eeb16ebaccc tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:30.289443 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-ab9772b2-6181-46e6-b3c9-8eeb16ebaccc tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:30.295531 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ab9772b2-6181-46e6-b3c9-8eeb16ebaccc tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:30.295978 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ab9772b2-6181-46e6-b3c9-8eeb16ebaccc tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:30.296736 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ab9772b2-6181-46e6-b3c9-8eeb16ebaccc tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:30.297172 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ab9772b2-6181-46e6-b3c9-8eeb16ebaccc tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:30.320808 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-8e680a12-2b6e-4595-bfc2-4bac480409e3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:30.321606 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-8e680a12-2b6e-4595-bfc2-4bac480409e3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:30.327894 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8e680a12-2b6e-4595-bfc2-4bac480409e3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:30.328445 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8e680a12-2b6e-4595-bfc2-4bac480409e3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:30.329281 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8e680a12-2b6e-4595-bfc2-4bac480409e3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:30.330278 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8e680a12-2b6e-4595-bfc2-4bac480409e3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:30.427514 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-ab9772b2-6181-46e6-b3c9-8eeb16ebaccc tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:30.435836 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-ab9772b2-6181-46e6-b3c9-8eeb16ebaccc tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:30.437349 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-ab9772b2-6181-46e6-b3c9-8eeb16ebaccc tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:30.438497 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-ab9772b2-6181-46e6-b3c9-8eeb16ebaccc tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.153563 Jul 11 11:34:30.439053 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 673/1346] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:34:30 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:34:30.462069 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-8e680a12-2b6e-4595-bfc2-4bac480409e3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:30.469773 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-8e680a12-2b6e-4595-bfc2-4bac480409e3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.152795 Jul 11 11:34:30.470322 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 674/1347] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:34:30 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:34:30.519460 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-1638682c-0d0b-48b2-8902-09cc4ef8343d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:30.520389 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-1638682c-0d0b-48b2-8902-09cc4ef8343d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:30.526755 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1638682c-0d0b-48b2-8902-09cc4ef8343d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:30.527205 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1638682c-0d0b-48b2-8902-09cc4ef8343d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:30.527996 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1638682c-0d0b-48b2-8902-09cc4ef8343d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:30.528436 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1638682c-0d0b-48b2-8902-09cc4ef8343d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:30.556931 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-1638682c-0d0b-48b2-8902-09cc4ef8343d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041867 Jul 11 11:34:30.557415 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 674/1348] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:30 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:30.633336 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-ee52374f-cd71-485f-87d9-0c28e2845e26 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:30.634281 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-ee52374f-cd71-485f-87d9-0c28e2845e26 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:30.640637 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ee52374f-cd71-485f-87d9-0c28e2845e26 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:30.641080 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ee52374f-cd71-485f-87d9-0c28e2845e26 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:30.641829 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ee52374f-cd71-485f-87d9-0c28e2845e26 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:30.642257 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ee52374f-cd71-485f-87d9-0c28e2845e26 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:30.670979 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-ee52374f-cd71-485f-87d9-0c28e2845e26 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041541 Jul 11 11:34:30.671540 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 675/1349] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:30 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:34:31.457280 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-b5137505-eb47-44fc-8e5c-c5430096d371 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:31.457882 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-b5137505-eb47-44fc-8e5c-c5430096d371 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:31.463834 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b5137505-eb47-44fc-8e5c-c5430096d371 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:31.464276 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b5137505-eb47-44fc-8e5c-c5430096d371 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:31.465020 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b5137505-eb47-44fc-8e5c-c5430096d371 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:31.465447 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b5137505-eb47-44fc-8e5c-c5430096d371 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:31.487146 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-4782416a-f222-42cd-b508-7e926759d2f9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:31.487791 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-4782416a-f222-42cd-b508-7e926759d2f9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:31.493815 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4782416a-f222-42cd-b508-7e926759d2f9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:31.494265 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4782416a-f222-42cd-b508-7e926759d2f9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:31.495029 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4782416a-f222-42cd-b508-7e926759d2f9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:31.495483 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4782416a-f222-42cd-b508-7e926759d2f9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:31.592364 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-b5137505-eb47-44fc-8e5c-c5430096d371 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:31.600882 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-b5137505-eb47-44fc-8e5c-c5430096d371 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:31.602362 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-b5137505-eb47-44fc-8e5c-c5430096d371 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:31.603526 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-b5137505-eb47-44fc-8e5c-c5430096d371 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.150646 Jul 11 11:34:31.604087 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 675/1350] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:34:31 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:34:31.608716 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-68d5c55e-58d1-4392-977c-3dfa02371021 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:31.609557 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-68d5c55e-58d1-4392-977c-3dfa02371021 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:31.615207 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-68d5c55e-58d1-4392-977c-3dfa02371021 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:31.615710 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-68d5c55e-58d1-4392-977c-3dfa02371021 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:31.616461 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-68d5c55e-58d1-4392-977c-3dfa02371021 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:31.617114 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-68d5c55e-58d1-4392-977c-3dfa02371021 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:31.623679 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-4782416a-f222-42cd-b508-7e926759d2f9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:31.632154 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-4782416a-f222-42cd-b508-7e926759d2f9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.148831 Jul 11 11:34:31.632794 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 676/1351] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:34:31 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:34:31.646491 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-68d5c55e-58d1-4392-977c-3dfa02371021 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041413 Jul 11 11:34:31.647034 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 676/1352] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:31 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:31.682179 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-5b4e89b3-133a-4a63-a100-d6580ab605b9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:31.683094 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-5b4e89b3-133a-4a63-a100-d6580ab605b9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:31.689971 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5b4e89b3-133a-4a63-a100-d6580ab605b9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:31.690415 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5b4e89b3-133a-4a63-a100-d6580ab605b9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:31.691174 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5b4e89b3-133a-4a63-a100-d6580ab605b9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:31.691884 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5b4e89b3-133a-4a63-a100-d6580ab605b9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:31.720166 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-5b4e89b3-133a-4a63-a100-d6580ab605b9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041814 Jul 11 11:34:31.720714 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 677/1353] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:31 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:32.621644 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-32390a48-f391-4e6f-a54d-759308bfd9f2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:32.622253 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-32390a48-f391-4e6f-a54d-759308bfd9f2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:32.628734 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-32390a48-f391-4e6f-a54d-759308bfd9f2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:32.629185 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-32390a48-f391-4e6f-a54d-759308bfd9f2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:32.629944 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-32390a48-f391-4e6f-a54d-759308bfd9f2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:32.630376 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-32390a48-f391-4e6f-a54d-759308bfd9f2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:32.649268 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-b91edde1-9ef2-455b-80d6-5372b6729d08 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:32.650126 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-b91edde1-9ef2-455b-80d6-5372b6729d08 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:32.656317 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b91edde1-9ef2-455b-80d6-5372b6729d08 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:32.656771 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b91edde1-9ef2-455b-80d6-5372b6729d08 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:32.657539 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b91edde1-9ef2-455b-80d6-5372b6729d08 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:32.658629 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b91edde1-9ef2-455b-80d6-5372b6729d08 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:32.761978 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-32390a48-f391-4e6f-a54d-759308bfd9f2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:32.770802 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-32390a48-f391-4e6f-a54d-759308bfd9f2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:32.772334 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-32390a48-f391-4e6f-a54d-759308bfd9f2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:32.773490 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-32390a48-f391-4e6f-a54d-759308bfd9f2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.155751 Jul 11 11:34:32.774078 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 677/1354] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:34:32 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:34:32.778678 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-e6ed23bc-725c-4bce-8328-25a4353b82bf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:32.779612 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-e6ed23bc-725c-4bce-8328-25a4353b82bf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:32.785866 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e6ed23bc-725c-4bce-8328-25a4353b82bf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:32.789276 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-b91edde1-9ef2-455b-80d6-5372b6729d08 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:32.790113 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e6ed23bc-725c-4bce-8328-25a4353b82bf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:32.791148 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e6ed23bc-725c-4bce-8328-25a4353b82bf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:32.791497 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e6ed23bc-725c-4bce-8328-25a4353b82bf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:32.797157 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-b91edde1-9ef2-455b-80d6-5372b6729d08 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.151732 Jul 11 11:34:32.797732 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 678/1355] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:34:32 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:34:32.802400 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-e9b4d3c1-6804-48a2-b011-4030a1885ca8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:32.803340 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-e9b4d3c1-6804-48a2-b011-4030a1885ca8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:32.809173 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e9b4d3c1-6804-48a2-b011-4030a1885ca8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:32.809629 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e9b4d3c1-6804-48a2-b011-4030a1885ca8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:32.810395 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e9b4d3c1-6804-48a2-b011-4030a1885ca8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:32.810835 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e9b4d3c1-6804-48a2-b011-4030a1885ca8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:32.822201 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-e6ed23bc-725c-4bce-8328-25a4353b82bf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047110 Jul 11 11:34:32.822760 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 678/1356] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:32 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:32.840180 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-e9b4d3c1-6804-48a2-b011-4030a1885ca8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041454 Jul 11 11:34:32.840727 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 679/1357] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:32 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:33.791922 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-de6b1311-1f26-4555-af21-6f89c7b0b3a6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:33.792459 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-de6b1311-1f26-4555-af21-6f89c7b0b3a6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:33.798903 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-de6b1311-1f26-4555-af21-6f89c7b0b3a6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:33.799379 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-de6b1311-1f26-4555-af21-6f89c7b0b3a6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:33.800146 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-de6b1311-1f26-4555-af21-6f89c7b0b3a6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:33.800578 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-de6b1311-1f26-4555-af21-6f89c7b0b3a6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:33.813957 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-df9c4326-ed03-4011-a2a1-bf679e78bac2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:33.815077 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-df9c4326-ed03-4011-a2a1-bf679e78bac2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:33.821807 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-df9c4326-ed03-4011-a2a1-bf679e78bac2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:33.822252 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-df9c4326-ed03-4011-a2a1-bf679e78bac2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:33.823011 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-df9c4326-ed03-4011-a2a1-bf679e78bac2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:33.823481 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-df9c4326-ed03-4011-a2a1-bf679e78bac2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:33.841922 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=100 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:34:33.928674 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-de6b1311-1f26-4555-af21-6f89c7b0b3a6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:33.932189 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=100 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:34:33.937438 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-de6b1311-1f26-4555-af21-6f89c7b0b3a6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:33.938936 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-de6b1311-1f26-4555-af21-6f89c7b0b3a6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:33.940644 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-de6b1311-1f26-4555-af21-6f89c7b0b3a6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.152703 Jul 11 11:34:33.941204 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 679/1358] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:34:33 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:34:33.945934 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-254d8407-0191-4061-a818-6d64e38ad05b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:33.951606 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-254d8407-0191-4061-a818-6d64e38ad05b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:33.952733 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-df9c4326-ed03-4011-a2a1-bf679e78bac2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:33.952898 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-254d8407-0191-4061-a818-6d64e38ad05b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:33.953202 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-254d8407-0191-4061-a818-6d64e38ad05b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:33.953966 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-254d8407-0191-4061-a818-6d64e38ad05b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:33.954401 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-254d8407-0191-4061-a818-6d64e38ad05b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:33.961261 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-df9c4326-ed03-4011-a2a1-bf679e78bac2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.151049 Jul 11 11:34:33.962065 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 680/1359] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:34:33 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:34:33.966565 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-1d4cfa56-deb1-4143-a733-170025354fdf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:33.967629 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-1d4cfa56-deb1-4143-a733-170025354fdf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:33.973339 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1d4cfa56-deb1-4143-a733-170025354fdf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:33.973792 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1d4cfa56-deb1-4143-a733-170025354fdf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:33.974556 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1d4cfa56-deb1-4143-a733-170025354fdf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:33.974989 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1d4cfa56-deb1-4143-a733-170025354fdf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:33.987770 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-254d8407-0191-4061-a818-6d64e38ad05b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045261 Jul 11 11:34:33.988332 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 680/1360] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:33 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:34.004443 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-1d4cfa56-deb1-4143-a733-170025354fdf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041410 Jul 11 11:34:34.005001 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 681/1361] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:33 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:34.959803 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-c4c30de2-6684-4d80-bac7-f8020685ea0f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:34.960405 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-c4c30de2-6684-4d80-bac7-f8020685ea0f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:34.966866 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c4c30de2-6684-4d80-bac7-f8020685ea0f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:34.967350 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c4c30de2-6684-4d80-bac7-f8020685ea0f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:34.968104 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c4c30de2-6684-4d80-bac7-f8020685ea0f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:34.968536 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c4c30de2-6684-4d80-bac7-f8020685ea0f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:34.977728 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-415ddc1a-e380-4219-8ebf-8b08fd0ffa53 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:34.978466 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-415ddc1a-e380-4219-8ebf-8b08fd0ffa53 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:34.985049 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-415ddc1a-e380-4219-8ebf-8b08fd0ffa53 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:34.985500 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-415ddc1a-e380-4219-8ebf-8b08fd0ffa53 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:34.986293 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-415ddc1a-e380-4219-8ebf-8b08fd0ffa53 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:34.986726 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-415ddc1a-e380-4219-8ebf-8b08fd0ffa53 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:34.989429 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 11:34:34.990844 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Mon Jul 11 11:34:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 (ip 10.222.0.26) !!! Jul 11 11:34:35.121221 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-c4c30de2-6684-4d80-bac7-f8020685ea0f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:35.123354 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-415ddc1a-e380-4219-8ebf-8b08fd0ffa53 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:35.129799 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-c4c30de2-6684-4d80-bac7-f8020685ea0f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:35.131306 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-c4c30de2-6684-4d80-bac7-f8020685ea0f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:35.131446 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-415ddc1a-e380-4219-8ebf-8b08fd0ffa53 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.157454 Jul 11 11:34:35.131925 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 682/1362] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:34:34 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:34:35.132451 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-c4c30de2-6684-4d80-bac7-f8020685ea0f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.176602 Jul 11 11:34:35.133160 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 681/1363] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:34:34 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:34:35.136693 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-61211b4e-c747-4119-a027-40beeb353a57 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:35.137614 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-61211b4e-c747-4119-a027-40beeb353a57 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:35.141219 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-dee353bd-ffd3-451c-ab5d-8d661ad17c06 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:35.142780 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-dee353bd-ffd3-451c-ab5d-8d661ad17c06 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:35.144087 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-61211b4e-c747-4119-a027-40beeb353a57 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:35.144542 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-61211b4e-c747-4119-a027-40beeb353a57 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:35.145311 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-61211b4e-c747-4119-a027-40beeb353a57 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:35.145745 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-61211b4e-c747-4119-a027-40beeb353a57 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:35.148945 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-dee353bd-ffd3-451c-ab5d-8d661ad17c06 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:35.149386 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-dee353bd-ffd3-451c-ab5d-8d661ad17c06 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:35.150170 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-dee353bd-ffd3-451c-ab5d-8d661ad17c06 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:35.150598 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-dee353bd-ffd3-451c-ab5d-8d661ad17c06 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:35.174861 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-61211b4e-c747-4119-a027-40beeb353a57 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041903 Jul 11 11:34:35.175459 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 683/1364] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:35 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:35.179692 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-dee353bd-ffd3-451c-ab5d-8d661ad17c06 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043092 Jul 11 11:34:35.180249 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 682/1365] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:35 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:36.147698 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-8a3f62f2-12f1-44e2-a00a-aec3d25f7ba6 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:36.148245 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-8a3f62f2-12f1-44e2-a00a-aec3d25f7ba6 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:36.149523 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-0a2d8c9b-b23f-4ef4-9b69-8c1915ea5f31 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:36.150131 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-0a2d8c9b-b23f-4ef4-9b69-8c1915ea5f31 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:36.154916 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8a3f62f2-12f1-44e2-a00a-aec3d25f7ba6 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:36.155394 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8a3f62f2-12f1-44e2-a00a-aec3d25f7ba6 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:36.156168 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8a3f62f2-12f1-44e2-a00a-aec3d25f7ba6 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:36.156466 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0a2d8c9b-b23f-4ef4-9b69-8c1915ea5f31 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:36.156600 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8a3f62f2-12f1-44e2-a00a-aec3d25f7ba6 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:36.156908 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0a2d8c9b-b23f-4ef4-9b69-8c1915ea5f31 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:36.157663 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0a2d8c9b-b23f-4ef4-9b69-8c1915ea5f31 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:36.158594 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0a2d8c9b-b23f-4ef4-9b69-8c1915ea5f31 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:36.297192 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-0a2d8c9b-b23f-4ef4-9b69-8c1915ea5f31 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:36.306208 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-0a2d8c9b-b23f-4ef4-9b69-8c1915ea5f31 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:36.307766 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-0a2d8c9b-b23f-4ef4-9b69-8c1915ea5f31 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:36.308915 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-0a2d8c9b-b23f-4ef4-9b69-8c1915ea5f31 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.163209 Jul 11 11:34:36.309473 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 683/1366] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:34:36 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 11:34:36.314178 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-00912f13-480e-4405-8299-2adb4b879cbd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:36.314514 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-8a3f62f2-12f1-44e2-a00a-aec3d25f7ba6 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:36.315091 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-00912f13-480e-4405-8299-2adb4b879cbd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:36.321371 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-00912f13-480e-4405-8299-2adb4b879cbd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:36.322611 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-00912f13-480e-4405-8299-2adb4b879cbd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:36.322611 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-00912f13-480e-4405-8299-2adb4b879cbd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:36.322987 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-00912f13-480e-4405-8299-2adb4b879cbd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:36.323683 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-8a3f62f2-12f1-44e2-a00a-aec3d25f7ba6 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.179878 Jul 11 11:34:36.324253 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 684/1367] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:34:36 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:34:36.329001 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-245f5611-0497-454c-90ce-ed25bbbcb2c3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:36.330577 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-245f5611-0497-454c-90ce-ed25bbbcb2c3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:36.336459 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-245f5611-0497-454c-90ce-ed25bbbcb2c3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:36.336905 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-245f5611-0497-454c-90ce-ed25bbbcb2c3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:36.337787 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-245f5611-0497-454c-90ce-ed25bbbcb2c3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:36.338218 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-245f5611-0497-454c-90ce-ed25bbbcb2c3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:36.357279 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-00912f13-480e-4405-8299-2adb4b879cbd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043524 Jul 11 11:34:36.357279 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 684/1368] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:36 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:36.368366 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-245f5611-0497-454c-90ce-ed25bbbcb2c3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043096 Jul 11 11:34:36.368924 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 685/1369] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:36 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:37.327740 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-7994a6a4-b03b-4745-815c-fb3bf1fc08bf tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:37.328293 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-7994a6a4-b03b-4745-815c-fb3bf1fc08bf tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:37.334587 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7994a6a4-b03b-4745-815c-fb3bf1fc08bf tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:37.335033 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7994a6a4-b03b-4745-815c-fb3bf1fc08bf tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:37.336037 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7994a6a4-b03b-4745-815c-fb3bf1fc08bf tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:37.336250 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7994a6a4-b03b-4745-815c-fb3bf1fc08bf tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:37.341078 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-75741960-9393-4dbb-bba0-c92e555564c0 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:37.341763 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-75741960-9393-4dbb-bba0-c92e555564c0 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:37.348309 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-75741960-9393-4dbb-bba0-c92e555564c0 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:37.348754 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-75741960-9393-4dbb-bba0-c92e555564c0 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:37.349516 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-75741960-9393-4dbb-bba0-c92e555564c0 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:37.349951 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-75741960-9393-4dbb-bba0-c92e555564c0 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:37.465359 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-7994a6a4-b03b-4745-815c-fb3bf1fc08bf tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:37.474126 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-7994a6a4-b03b-4745-815c-fb3bf1fc08bf tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:37.475770 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-7994a6a4-b03b-4745-815c-fb3bf1fc08bf tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:37.476915 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-7994a6a4-b03b-4745-815c-fb3bf1fc08bf tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.153048 Jul 11 11:34:37.477478 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 685/1370] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:34:37 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:34:37.482067 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-269ea922-d0ca-49e6-958b-36516c9e94c5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:37.482994 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-269ea922-d0ca-49e6-958b-36516c9e94c5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:37.488592 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-75741960-9393-4dbb-bba0-c92e555564c0 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:37.489550 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-269ea922-d0ca-49e6-958b-36516c9e94c5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:37.490000 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-269ea922-d0ca-49e6-958b-36516c9e94c5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:37.490767 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-269ea922-d0ca-49e6-958b-36516c9e94c5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:37.491202 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-269ea922-d0ca-49e6-958b-36516c9e94c5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:37.509885 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-75741960-9393-4dbb-bba0-c92e555564c0 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.172542 Jul 11 11:34:37.514910 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 686/1371] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:34:37 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:34:37.515441 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-bf2d8bc3-8a75-45fb-ac21-11fe89c81201 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:37.516448 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-bf2d8bc3-8a75-45fb-ac21-11fe89c81201 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:37.522454 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-bf2d8bc3-8a75-45fb-ac21-11fe89c81201 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:37.522906 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-bf2d8bc3-8a75-45fb-ac21-11fe89c81201 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:37.523707 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-bf2d8bc3-8a75-45fb-ac21-11fe89c81201 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:37.524152 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-bf2d8bc3-8a75-45fb-ac21-11fe89c81201 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:37.524450 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-269ea922-d0ca-49e6-958b-36516c9e94c5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045943 Jul 11 11:34:37.528419 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 686/1372] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:37 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:37.553648 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-bf2d8bc3-8a75-45fb-ac21-11fe89c81201 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042175 Jul 11 11:34:37.554193 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 687/1373] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:37 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:38.495383 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-bd4ca7b1-d7c4-4e2f-9e45-05c283c3564c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:38.496023 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-bd4ca7b1-d7c4-4e2f-9e45-05c283c3564c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:38.502975 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bd4ca7b1-d7c4-4e2f-9e45-05c283c3564c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:38.503668 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bd4ca7b1-d7c4-4e2f-9e45-05c283c3564c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:38.504443 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bd4ca7b1-d7c4-4e2f-9e45-05c283c3564c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:38.504878 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bd4ca7b1-d7c4-4e2f-9e45-05c283c3564c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:38.529812 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-7ed9403a-2500-4b99-a95d-69111f114158 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:38.530539 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-7ed9403a-2500-4b99-a95d-69111f114158 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:38.537138 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7ed9403a-2500-4b99-a95d-69111f114158 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:38.537588 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7ed9403a-2500-4b99-a95d-69111f114158 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:38.538354 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7ed9403a-2500-4b99-a95d-69111f114158 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:38.538788 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7ed9403a-2500-4b99-a95d-69111f114158 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:38.636693 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-bd4ca7b1-d7c4-4e2f-9e45-05c283c3564c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:38.645126 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-bd4ca7b1-d7c4-4e2f-9e45-05c283c3564c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:38.646651 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-bd4ca7b1-d7c4-4e2f-9e45-05c283c3564c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:38.647829 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-bd4ca7b1-d7c4-4e2f-9e45-05c283c3564c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.156324 Jul 11 11:34:38.648387 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 687/1374] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:34:38 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:34:38.652912 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-a8873e6f-d3dc-4aa4-89ef-7c5dd570d8f0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:38.653816 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-a8873e6f-d3dc-4aa4-89ef-7c5dd570d8f0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:38.659806 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a8873e6f-d3dc-4aa4-89ef-7c5dd570d8f0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:38.660251 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a8873e6f-d3dc-4aa4-89ef-7c5dd570d8f0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:38.661024 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a8873e6f-d3dc-4aa4-89ef-7c5dd570d8f0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:38.661460 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a8873e6f-d3dc-4aa4-89ef-7c5dd570d8f0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:38.671408 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-7ed9403a-2500-4b99-a95d-69111f114158 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:38.679752 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-7ed9403a-2500-4b99-a95d-69111f114158 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.153819 Jul 11 11:34:38.680378 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 688/1375] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:34:38 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:34:38.684866 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-657b0fa8-88de-4cec-871d-f4b39650464b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:38.685925 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-657b0fa8-88de-4cec-871d-f4b39650464b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:38.691617 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-a8873e6f-d3dc-4aa4-89ef-7c5dd570d8f0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041952 Jul 11 11:34:38.692183 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 688/1376] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:38 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:38.692510 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-657b0fa8-88de-4cec-871d-f4b39650464b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:38.692961 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-657b0fa8-88de-4cec-871d-f4b39650464b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:38.693728 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-657b0fa8-88de-4cec-871d-f4b39650464b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:38.694160 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-657b0fa8-88de-4cec-871d-f4b39650464b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:38.722082 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-657b0fa8-88de-4cec-871d-f4b39650464b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040725 Jul 11 11:34:38.722635 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 689/1377] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:38 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:39.666057 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-2b57d2a3-8f78-4bec-bd0d-c67ddc7eecbf tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:39.666691 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-2b57d2a3-8f78-4bec-bd0d-c67ddc7eecbf tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:39.673166 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2b57d2a3-8f78-4bec-bd0d-c67ddc7eecbf tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:39.673616 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2b57d2a3-8f78-4bec-bd0d-c67ddc7eecbf tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:39.674366 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2b57d2a3-8f78-4bec-bd0d-c67ddc7eecbf tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:39.674797 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2b57d2a3-8f78-4bec-bd0d-c67ddc7eecbf tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:39.696683 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-094b24a0-d6b1-413e-bc41-441227803337 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:39.697319 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-094b24a0-d6b1-413e-bc41-441227803337 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:39.703536 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-094b24a0-d6b1-413e-bc41-441227803337 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:39.703977 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-094b24a0-d6b1-413e-bc41-441227803337 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:39.704732 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-094b24a0-d6b1-413e-bc41-441227803337 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:39.705818 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-094b24a0-d6b1-413e-bc41-441227803337 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:39.805259 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-2b57d2a3-8f78-4bec-bd0d-c67ddc7eecbf tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:39.814962 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-2b57d2a3-8f78-4bec-bd0d-c67ddc7eecbf tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:39.816975 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-2b57d2a3-8f78-4bec-bd0d-c67ddc7eecbf tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:39.818538 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-2b57d2a3-8f78-4bec-bd0d-c67ddc7eecbf tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.156284 Jul 11 11:34:39.819100 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 689/1378] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:34:39 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:34:39.824146 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-0d60388a-e092-49d7-be20-b3a38c38e7c2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:39.825346 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-0d60388a-e092-49d7-be20-b3a38c38e7c2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:39.833089 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0d60388a-e092-49d7-be20-b3a38c38e7c2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:39.833539 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0d60388a-e092-49d7-be20-b3a38c38e7c2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:39.834309 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0d60388a-e092-49d7-be20-b3a38c38e7c2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:39.834738 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0d60388a-e092-49d7-be20-b3a38c38e7c2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:39.842468 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-094b24a0-d6b1-413e-bc41-441227803337 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:39.850441 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-094b24a0-d6b1-413e-bc41-441227803337 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.157707 Jul 11 11:34:39.851010 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 690/1379] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:34:39 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:34:39.857057 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-da7b4a4c-7274-4e30-a8b3-b8df8ad5a0ff tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:39.858373 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-da7b4a4c-7274-4e30-a8b3-b8df8ad5a0ff tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:39.864193 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-0d60388a-e092-49d7-be20-b3a38c38e7c2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043667 Jul 11 11:34:39.864760 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 690/1380] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:39 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:39.864926 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-da7b4a4c-7274-4e30-a8b3-b8df8ad5a0ff tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:39.865272 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-da7b4a4c-7274-4e30-a8b3-b8df8ad5a0ff tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:39.866155 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-da7b4a4c-7274-4e30-a8b3-b8df8ad5a0ff tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:39.866589 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-da7b4a4c-7274-4e30-a8b3-b8df8ad5a0ff tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:39.897259 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-da7b4a4c-7274-4e30-a8b3-b8df8ad5a0ff tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045055 Jul 11 11:34:39.897973 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 691/1381] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:39 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:40.836933 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-19104cc9-d1e6-4c4d-aa5b-02aae37f6d71 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:40.837487 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-19104cc9-d1e6-4c4d-aa5b-02aae37f6d71 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:40.844002 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-19104cc9-d1e6-4c4d-aa5b-02aae37f6d71 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:40.844503 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-19104cc9-d1e6-4c4d-aa5b-02aae37f6d71 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:40.845265 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-19104cc9-d1e6-4c4d-aa5b-02aae37f6d71 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:40.846281 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-19104cc9-d1e6-4c4d-aa5b-02aae37f6d71 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:40.867887 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-f487003b-a7cb-4f71-bb95-3a17ce4bebae tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:40.868375 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-f487003b-a7cb-4f71-bb95-3a17ce4bebae tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:40.875338 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f487003b-a7cb-4f71-bb95-3a17ce4bebae tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:40.875728 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f487003b-a7cb-4f71-bb95-3a17ce4bebae tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:40.876485 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f487003b-a7cb-4f71-bb95-3a17ce4bebae tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:40.876916 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f487003b-a7cb-4f71-bb95-3a17ce4bebae tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:40.992716 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-19104cc9-d1e6-4c4d-aa5b-02aae37f6d71 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:41.001080 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-19104cc9-d1e6-4c4d-aa5b-02aae37f6d71 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:41.002560 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-19104cc9-d1e6-4c4d-aa5b-02aae37f6d71 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:41.003828 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-19104cc9-d1e6-4c4d-aa5b-02aae37f6d71 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.170855 Jul 11 11:34:41.004401 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 691/1382] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:34:40 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:34:41.009078 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-98ab745e-45dd-4ef8-a1f2-672fd19c5b7e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:41.009988 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-98ab745e-45dd-4ef8-a1f2-672fd19c5b7e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:41.015945 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-98ab745e-45dd-4ef8-a1f2-672fd19c5b7e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:41.016390 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-98ab745e-45dd-4ef8-a1f2-672fd19c5b7e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:41.017150 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-98ab745e-45dd-4ef8-a1f2-672fd19c5b7e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:41.018127 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-98ab745e-45dd-4ef8-a1f2-672fd19c5b7e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:41.019396 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-f487003b-a7cb-4f71-bb95-3a17ce4bebae tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:41.027241 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-f487003b-a7cb-4f71-bb95-3a17ce4bebae tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.163238 Jul 11 11:34:41.027847 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 692/1383] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:34:40 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:34:41.032396 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-9eccff07-9c63-4c5b-a22c-154a4ec39337 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:41.039111 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-9eccff07-9c63-4c5b-a22c-154a4ec39337 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:41.039644 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9eccff07-9c63-4c5b-a22c-154a4ec39337 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:41.040122 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9eccff07-9c63-4c5b-a22c-154a4ec39337 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:41.040882 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9eccff07-9c63-4c5b-a22c-154a4ec39337 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:41.041343 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9eccff07-9c63-4c5b-a22c-154a4ec39337 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:41.047538 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-98ab745e-45dd-4ef8-a1f2-672fd19c5b7e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042098 Jul 11 11:34:41.048091 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 692/1384] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:41 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:41.078334 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-9eccff07-9c63-4c5b-a22c-154a4ec39337 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048115 Jul 11 11:34:41.078334 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 693/1385] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:41 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:42.021974 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-0a252c7f-03ff-480b-9819-869845601a8a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:42.022586 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-0a252c7f-03ff-480b-9819-869845601a8a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:42.029182 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0a252c7f-03ff-480b-9819-869845601a8a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:42.029633 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0a252c7f-03ff-480b-9819-869845601a8a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:42.030395 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0a252c7f-03ff-480b-9819-869845601a8a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:42.030830 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0a252c7f-03ff-480b-9819-869845601a8a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:42.044911 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-0bd7bed9-294b-41f8-aa7b-1b9db8d130e5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:42.045632 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-0bd7bed9-294b-41f8-aa7b-1b9db8d130e5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:42.053132 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0bd7bed9-294b-41f8-aa7b-1b9db8d130e5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:42.053581 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0bd7bed9-294b-41f8-aa7b-1b9db8d130e5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:42.054387 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0bd7bed9-294b-41f8-aa7b-1b9db8d130e5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:42.056040 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0bd7bed9-294b-41f8-aa7b-1b9db8d130e5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:42.171559 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-0a252c7f-03ff-480b-9819-869845601a8a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:42.180553 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-0a252c7f-03ff-480b-9819-869845601a8a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:42.182040 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-0a252c7f-03ff-480b-9819-869845601a8a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:42.183178 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-0a252c7f-03ff-480b-9819-869845601a8a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.165209 Jul 11 11:34:42.183762 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 693/1386] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:34:42 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:34:42.187842 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-0bd7bed9-294b-41f8-aa7b-1b9db8d130e5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:42.188310 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-9d6daef7-9356-4230-b347-fc87132b4af8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:42.189293 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-9d6daef7-9356-4230-b347-fc87132b4af8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:42.195625 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9d6daef7-9356-4230-b347-fc87132b4af8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:42.196312 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9d6daef7-9356-4230-b347-fc87132b4af8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:42.196710 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-0bd7bed9-294b-41f8-aa7b-1b9db8d130e5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.155633 Jul 11 11:34:42.197067 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9d6daef7-9356-4230-b347-fc87132b4af8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:42.197281 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 694/1387] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:34:42 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:34:42.197499 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9d6daef7-9356-4230-b347-fc87132b4af8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:42.202233 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-ead13b7d-4961-4bd9-824d-3dd8ecc699ae tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:42.203193 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-ead13b7d-4961-4bd9-824d-3dd8ecc699ae tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:42.209301 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ead13b7d-4961-4bd9-824d-3dd8ecc699ae tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:42.209744 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ead13b7d-4961-4bd9-824d-3dd8ecc699ae tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:42.210561 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ead13b7d-4961-4bd9-824d-3dd8ecc699ae tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:42.211028 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ead13b7d-4961-4bd9-824d-3dd8ecc699ae tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:42.228493 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-9d6daef7-9356-4230-b347-fc87132b4af8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043720 Jul 11 11:34:42.229053 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 694/1388] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:42 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:42.239902 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-ead13b7d-4961-4bd9-824d-3dd8ecc699ae tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041516 Jul 11 11:34:42.240444 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 695/1389] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:42 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:43.201761 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-421688e5-8f31-48ca-98fe-0e25ff73c22c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:43.202367 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-421688e5-8f31-48ca-98fe-0e25ff73c22c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:43.209388 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-421688e5-8f31-48ca-98fe-0e25ff73c22c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:43.209863 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-421688e5-8f31-48ca-98fe-0e25ff73c22c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:43.210669 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-421688e5-8f31-48ca-98fe-0e25ff73c22c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:43.211083 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-421688e5-8f31-48ca-98fe-0e25ff73c22c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:43.213021 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-69feb014-0b72-4ba3-a02a-2166303fb87a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:43.213627 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-69feb014-0b72-4ba3-a02a-2166303fb87a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:43.220003 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-69feb014-0b72-4ba3-a02a-2166303fb87a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:43.221042 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-69feb014-0b72-4ba3-a02a-2166303fb87a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:43.221805 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-69feb014-0b72-4ba3-a02a-2166303fb87a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:43.222233 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-69feb014-0b72-4ba3-a02a-2166303fb87a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:43.347340 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-421688e5-8f31-48ca-98fe-0e25ff73c22c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:43.349162 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-69feb014-0b72-4ba3-a02a-2166303fb87a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:43.355946 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-421688e5-8f31-48ca-98fe-0e25ff73c22c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:43.357212 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-69feb014-0b72-4ba3-a02a-2166303fb87a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.147897 Jul 11 11:34:43.357435 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-421688e5-8f31-48ca-98fe-0e25ff73c22c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:43.358023 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 696/1390] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:34:43 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:34:43.358582 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-421688e5-8f31-48ca-98fe-0e25ff73c22c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.160764 Jul 11 11:34:43.367010 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 695/1391] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:34:43 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:34:43.367199 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-d545f821-2afe-4d79-be0c-58405f1e1e9b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:43.367199 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-d545f821-2afe-4d79-be0c-58405f1e1e9b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:43.367429 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-42b452d7-b242-446b-861d-430fd48a7970 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:43.367429 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-42b452d7-b242-446b-861d-430fd48a7970 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:43.369989 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d545f821-2afe-4d79-be0c-58405f1e1e9b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:43.370463 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d545f821-2afe-4d79-be0c-58405f1e1e9b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:43.370642 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-42b452d7-b242-446b-861d-430fd48a7970 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:43.371092 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-42b452d7-b242-446b-861d-430fd48a7970 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:43.371232 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d545f821-2afe-4d79-be0c-58405f1e1e9b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:43.371697 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d545f821-2afe-4d79-be0c-58405f1e1e9b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:43.371882 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-42b452d7-b242-446b-861d-430fd48a7970 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:43.372314 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-42b452d7-b242-446b-861d-430fd48a7970 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:43.375335 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=100 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:34:43.389769 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=100 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:34:43.401764 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-d545f821-2afe-4d79-be0c-58405f1e1e9b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042860 Jul 11 11:34:43.402337 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 697/1392] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:43 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:43.403025 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-42b452d7-b242-446b-861d-430fd48a7970 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042644 Jul 11 11:34:43.403611 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 696/1393] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:43 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:43.648814 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 11:34:43.648956 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Mon Jul 11 11:34:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 11:34:44.374282 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-4d6c747c-94f9-44e1-9f05-ec0750ef40d4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:44.374827 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-4d6c747c-94f9-44e1-9f05-ec0750ef40d4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:44.376082 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-71f8f44b-b865-4bbc-9ea6-d4ab9ecace2f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:44.376696 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-71f8f44b-b865-4bbc-9ea6-d4ab9ecace2f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:44.381684 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4d6c747c-94f9-44e1-9f05-ec0750ef40d4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:44.382137 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4d6c747c-94f9-44e1-9f05-ec0750ef40d4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:44.382903 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4d6c747c-94f9-44e1-9f05-ec0750ef40d4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:44.383365 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4d6c747c-94f9-44e1-9f05-ec0750ef40d4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:44.383558 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-71f8f44b-b865-4bbc-9ea6-d4ab9ecace2f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:44.384005 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-71f8f44b-b865-4bbc-9ea6-d4ab9ecace2f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:44.384791 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-71f8f44b-b865-4bbc-9ea6-d4ab9ecace2f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:44.385220 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-71f8f44b-b865-4bbc-9ea6-d4ab9ecace2f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:44.513737 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-4d6c747c-94f9-44e1-9f05-ec0750ef40d4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:44.516557 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-71f8f44b-b865-4bbc-9ea6-d4ab9ecace2f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:44.522156 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-4d6c747c-94f9-44e1-9f05-ec0750ef40d4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.151870 Jul 11 11:34:44.522816 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 698/1394] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:34:44 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:34:44.525542 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-71f8f44b-b865-4bbc-9ea6-d4ab9ecace2f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:44.527023 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-71f8f44b-b865-4bbc-9ea6-d4ab9ecace2f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:44.527342 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-25d56829-4933-4823-9760-ce72792e9f9a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:44.528374 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-71f8f44b-b865-4bbc-9ea6-d4ab9ecace2f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.156140 Jul 11 11:34:44.528504 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-25d56829-4933-4823-9760-ce72792e9f9a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:44.538268 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 697/1395] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:34:44 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 11:34:44.538268 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-55084cc8-26b6-4f72-878d-694b83463c56 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:44.538549 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-25d56829-4933-4823-9760-ce72792e9f9a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:44.538549 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-25d56829-4933-4823-9760-ce72792e9f9a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:44.538750 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-55084cc8-26b6-4f72-878d-694b83463c56 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:44.538835 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-25d56829-4933-4823-9760-ce72792e9f9a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:44.538835 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-25d56829-4933-4823-9760-ce72792e9f9a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:44.541568 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-55084cc8-26b6-4f72-878d-694b83463c56 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:44.542009 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-55084cc8-26b6-4f72-878d-694b83463c56 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:44.542762 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-55084cc8-26b6-4f72-878d-694b83463c56 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:44.543187 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-55084cc8-26b6-4f72-878d-694b83463c56 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:44.568059 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-25d56829-4933-4823-9760-ce72792e9f9a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044157 Jul 11 11:34:44.568634 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 699/1396] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:44 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:44.572730 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-55084cc8-26b6-4f72-878d-694b83463c56 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042325 Jul 11 11:34:44.573275 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 698/1397] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:44 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:45.540031 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-8e339016-450e-4907-8b62-adc7a3f19924 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:45.540031 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-8e339016-450e-4907-8b62-adc7a3f19924 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:45.546734 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8e339016-450e-4907-8b62-adc7a3f19924 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:45.546875 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8e339016-450e-4907-8b62-adc7a3f19924 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:45.548114 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-59447b24-3059-450d-9d94-363f10e49ca3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:45.549081 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8e339016-450e-4907-8b62-adc7a3f19924 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:45.549172 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-59447b24-3059-450d-9d94-363f10e49ca3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:45.549265 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8e339016-450e-4907-8b62-adc7a3f19924 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:45.555111 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-59447b24-3059-450d-9d94-363f10e49ca3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:45.555585 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-59447b24-3059-450d-9d94-363f10e49ca3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:45.556334 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-59447b24-3059-450d-9d94-363f10e49ca3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:45.556760 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-59447b24-3059-450d-9d94-363f10e49ca3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:45.675423 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-8e339016-450e-4907-8b62-adc7a3f19924 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:45.682207 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-59447b24-3059-450d-9d94-363f10e49ca3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:45.683315 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-8e339016-450e-4907-8b62-adc7a3f19924 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.148062 Jul 11 11:34:45.683930 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 700/1398] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:34:45 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:34:45.688412 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-bb98e37b-3fc1-49c8-8fa2-0b3a1768060e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:45.689881 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-bb98e37b-3fc1-49c8-8fa2-0b3a1768060e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:45.691140 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-59447b24-3059-450d-9d94-363f10e49ca3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:45.692929 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-59447b24-3059-450d-9d94-363f10e49ca3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:45.694153 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-59447b24-3059-450d-9d94-363f10e49ca3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.151338 Jul 11 11:34:45.694701 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 699/1399] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:34:45 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 11:34:45.695960 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-bb98e37b-3fc1-49c8-8fa2-0b3a1768060e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:45.696404 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-bb98e37b-3fc1-49c8-8fa2-0b3a1768060e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:45.697160 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-bb98e37b-3fc1-49c8-8fa2-0b3a1768060e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:45.697590 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-bb98e37b-3fc1-49c8-8fa2-0b3a1768060e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:45.699712 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-35e9fd32-fa1d-4ee1-a2b8-484b7d4f9592 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:45.700411 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-35e9fd32-fa1d-4ee1-a2b8-484b7d4f9592 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:45.706310 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-35e9fd32-fa1d-4ee1-a2b8-484b7d4f9592 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:45.706758 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-35e9fd32-fa1d-4ee1-a2b8-484b7d4f9592 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:45.707556 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-35e9fd32-fa1d-4ee1-a2b8-484b7d4f9592 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:45.707990 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-35e9fd32-fa1d-4ee1-a2b8-484b7d4f9592 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:45.735365 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-bb98e37b-3fc1-49c8-8fa2-0b3a1768060e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050358 Jul 11 11:34:45.735931 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 701/1400] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:45 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:45.738229 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-35e9fd32-fa1d-4ee1-a2b8-484b7d4f9592 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042454 Jul 11 11:34:45.738958 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 700/1401] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:45 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:46.701074 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-2fdef551-c072-4ad7-a4fa-96ee1a9f6ad7 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:46.701679 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-2fdef551-c072-4ad7-a4fa-96ee1a9f6ad7 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:46.708670 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2fdef551-c072-4ad7-a4fa-96ee1a9f6ad7 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:46.709111 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2fdef551-c072-4ad7-a4fa-96ee1a9f6ad7 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:46.709865 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2fdef551-c072-4ad7-a4fa-96ee1a9f6ad7 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:46.710292 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2fdef551-c072-4ad7-a4fa-96ee1a9f6ad7 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:46.713010 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-968a7edf-f69d-41ba-975b-47a251176e88 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:46.713616 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-968a7edf-f69d-41ba-975b-47a251176e88 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:46.720059 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-968a7edf-f69d-41ba-975b-47a251176e88 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:46.720503 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-968a7edf-f69d-41ba-975b-47a251176e88 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:46.721263 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-968a7edf-f69d-41ba-975b-47a251176e88 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:46.721692 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-968a7edf-f69d-41ba-975b-47a251176e88 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:46.847986 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-2fdef551-c072-4ad7-a4fa-96ee1a9f6ad7 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:46.852831 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-968a7edf-f69d-41ba-975b-47a251176e88 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:46.855907 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-2fdef551-c072-4ad7-a4fa-96ee1a9f6ad7 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.158655 Jul 11 11:34:46.856476 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 702/1402] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:34:46 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:34:46.861709 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-bd38f312-14ca-4101-9ad3-7ce66a9cb226 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:46.861866 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-968a7edf-f69d-41ba-975b-47a251176e88 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:46.862627 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-bd38f312-14ca-4101-9ad3-7ce66a9cb226 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:46.863441 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-968a7edf-f69d-41ba-975b-47a251176e88 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:46.864651 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-968a7edf-f69d-41ba-975b-47a251176e88 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.155477 Jul 11 11:34:46.867920 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 701/1403] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:34:46 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 11:34:46.868614 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-bd38f312-14ca-4101-9ad3-7ce66a9cb226 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:46.869084 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-bd38f312-14ca-4101-9ad3-7ce66a9cb226 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:46.869807 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-bd38f312-14ca-4101-9ad3-7ce66a9cb226 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:46.870236 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-bd38f312-14ca-4101-9ad3-7ce66a9cb226 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:46.872533 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-4ee2292d-d1ba-44fe-ac06-d1d4e16969e6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:46.873620 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-4ee2292d-d1ba-44fe-ac06-d1d4e16969e6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:46.880447 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4ee2292d-d1ba-44fe-ac06-d1d4e16969e6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:46.880891 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4ee2292d-d1ba-44fe-ac06-d1d4e16969e6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:46.881660 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4ee2292d-d1ba-44fe-ac06-d1d4e16969e6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:46.882100 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4ee2292d-d1ba-44fe-ac06-d1d4e16969e6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:46.899730 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-bd38f312-14ca-4101-9ad3-7ce66a9cb226 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042159 Jul 11 11:34:46.902309 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 703/1404] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:46 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:46.912784 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-4ee2292d-d1ba-44fe-ac06-d1d4e16969e6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043798 Jul 11 11:34:46.913330 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 702/1405] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:46 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:47.872900 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-b5335db1-a759-4c4d-ade3-c775a5a81cdb tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:47.873508 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-b5335db1-a759-4c4d-ade3-c775a5a81cdb tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:47.880245 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b5335db1-a759-4c4d-ade3-c775a5a81cdb tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:47.880691 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b5335db1-a759-4c4d-ade3-c775a5a81cdb tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:47.881454 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b5335db1-a759-4c4d-ade3-c775a5a81cdb tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:47.881560 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-997a4e20-c350-4efb-aa9d-9f2cfaebe766 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:47.881968 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b5335db1-a759-4c4d-ade3-c775a5a81cdb tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:47.882169 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-997a4e20-c350-4efb-aa9d-9f2cfaebe766 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:47.888582 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-997a4e20-c350-4efb-aa9d-9f2cfaebe766 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:47.889038 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-997a4e20-c350-4efb-aa9d-9f2cfaebe766 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:47.889797 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-997a4e20-c350-4efb-aa9d-9f2cfaebe766 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:47.890227 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-997a4e20-c350-4efb-aa9d-9f2cfaebe766 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:48.010294 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-b5335db1-a759-4c4d-ade3-c775a5a81cdb tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:48.017967 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-997a4e20-c350-4efb-aa9d-9f2cfaebe766 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:48.018957 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-b5335db1-a759-4c4d-ade3-c775a5a81cdb tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.149813 Jul 11 11:34:48.019568 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 704/1406] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:34:47 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:34:48.024314 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-f5e7b084-8a89-4577-96c4-b57603cb5749 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:48.025434 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-f5e7b084-8a89-4577-96c4-b57603cb5749 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:48.027271 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-997a4e20-c350-4efb-aa9d-9f2cfaebe766 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:48.030531 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-997a4e20-c350-4efb-aa9d-9f2cfaebe766 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:48.030531 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-997a4e20-c350-4efb-aa9d-9f2cfaebe766 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.152181 Jul 11 11:34:48.030806 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 703/1407] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:34:47 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 11:34:48.031482 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f5e7b084-8a89-4577-96c4-b57603cb5749 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:48.031925 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f5e7b084-8a89-4577-96c4-b57603cb5749 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:48.032685 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f5e7b084-8a89-4577-96c4-b57603cb5749 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:48.033114 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f5e7b084-8a89-4577-96c4-b57603cb5749 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:48.035361 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-1660f90f-3db3-4b41-98eb-5706a12baddf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:48.036256 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-1660f90f-3db3-4b41-98eb-5706a12baddf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:48.041994 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1660f90f-3db3-4b41-98eb-5706a12baddf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:48.042445 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1660f90f-3db3-4b41-98eb-5706a12baddf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:48.043197 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1660f90f-3db3-4b41-98eb-5706a12baddf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:48.043645 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1660f90f-3db3-4b41-98eb-5706a12baddf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:48.062636 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-f5e7b084-8a89-4577-96c4-b57603cb5749 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042003 Jul 11 11:34:48.063193 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 705/1408] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:48 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:48.073510 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-1660f90f-3db3-4b41-98eb-5706a12baddf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041660 Jul 11 11:34:48.074227 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 704/1409] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:48 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:49.036559 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-1c9fa24b-186c-456c-9373-a1e577d90902 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:49.037175 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-1c9fa24b-186c-456c-9373-a1e577d90902 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:49.043735 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1c9fa24b-186c-456c-9373-a1e577d90902 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:49.044375 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1c9fa24b-186c-456c-9373-a1e577d90902 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:49.045317 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1c9fa24b-186c-456c-9373-a1e577d90902 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:49.045950 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1c9fa24b-186c-456c-9373-a1e577d90902 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:49.048481 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-cf1f1695-4615-40d2-9f54-ddbe4d3ca4a6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:49.049664 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-cf1f1695-4615-40d2-9f54-ddbe4d3ca4a6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:49.056401 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-cf1f1695-4615-40d2-9f54-ddbe4d3ca4a6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:49.056847 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-cf1f1695-4615-40d2-9f54-ddbe4d3ca4a6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:49.057618 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-cf1f1695-4615-40d2-9f54-ddbe4d3ca4a6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:49.058105 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-cf1f1695-4615-40d2-9f54-ddbe4d3ca4a6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:49.185269 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-1c9fa24b-186c-456c-9373-a1e577d90902 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:49.193772 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-1c9fa24b-186c-456c-9373-a1e577d90902 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.161656 Jul 11 11:34:49.194337 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 706/1410] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:34:49 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:34:49.199090 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-f59389ab-c911-4dbc-bd21-acda757335e1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:49.200031 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-f59389ab-c911-4dbc-bd21-acda757335e1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:49.206495 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f59389ab-c911-4dbc-bd21-acda757335e1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:49.206936 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f59389ab-c911-4dbc-bd21-acda757335e1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:49.207734 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f59389ab-c911-4dbc-bd21-acda757335e1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:49.208165 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f59389ab-c911-4dbc-bd21-acda757335e1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:49.239297 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-f59389ab-c911-4dbc-bd21-acda757335e1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043686 Jul 11 11:34:49.239882 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 707/1411] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:49 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:49.244568 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-e9083ced-67a6-41fa-a428-d1cb015da691 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:49.245480 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-e9083ced-67a6-41fa-a428-d1cb015da691 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:49.251400 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e9083ced-67a6-41fa-a428-d1cb015da691 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:49.251882 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e9083ced-67a6-41fa-a428-d1cb015da691 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:49.252648 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e9083ced-67a6-41fa-a428-d1cb015da691 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:49.253085 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e9083ced-67a6-41fa-a428-d1cb015da691 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:49.282228 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-e9083ced-67a6-41fa-a428-d1cb015da691 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041252 Jul 11 11:34:49.286480 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 708/1412] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:49 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:49.297970 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-cf1f1695-4615-40d2-9f54-ddbe4d3ca4a6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:49.306740 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-cf1f1695-4615-40d2-9f54-ddbe4d3ca4a6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:49.308248 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-cf1f1695-4615-40d2-9f54-ddbe4d3ca4a6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:49.309384 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-cf1f1695-4615-40d2-9f54-ddbe4d3ca4a6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.264802 Jul 11 11:34:49.309940 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 705/1413] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:34:49 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:34:50.210659 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-e826aff4-73a1-4d11-a385-c129987f75e3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:50.211198 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-e826aff4-73a1-4d11-a385-c129987f75e3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:50.213508 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_api:SELECT=100 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:34:50.218216 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e826aff4-73a1-4d11-a385-c129987f75e3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:50.218695 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e826aff4-73a1-4d11-a385-c129987f75e3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:50.219488 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e826aff4-73a1-4d11-a385-c129987f75e3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:50.219926 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e826aff4-73a1-4d11-a385-c129987f75e3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:50.249943 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-0f6cbf61-54c2-4d6c-8727-f5f3314f89e3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:50.250893 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-0f6cbf61-54c2-4d6c-8727-f5f3314f89e3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:50.257536 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0f6cbf61-54c2-4d6c-8727-f5f3314f89e3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:50.257983 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0f6cbf61-54c2-4d6c-8727-f5f3314f89e3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:50.258749 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0f6cbf61-54c2-4d6c-8727-f5f3314f89e3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:50.259179 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0f6cbf61-54c2-4d6c-8727-f5f3314f89e3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:50.288191 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-0f6cbf61-54c2-4d6c-8727-f5f3314f89e3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042036 Jul 11 11:34:50.289031 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 706/1414] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:50 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:34:50.293661 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-b73cc253-9d6a-40a3-b6cb-c3b2f1c17c17 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:50.294565 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-b73cc253-9d6a-40a3-b6cb-c3b2f1c17c17 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:50.300968 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b73cc253-9d6a-40a3-b6cb-c3b2f1c17c17 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:50.301413 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b73cc253-9d6a-40a3-b6cb-c3b2f1c17c17 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:50.302176 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b73cc253-9d6a-40a3-b6cb-c3b2f1c17c17 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:50.302608 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b73cc253-9d6a-40a3-b6cb-c3b2f1c17c17 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:50.331848 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-b73cc253-9d6a-40a3-b6cb-c3b2f1c17c17 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041655 Jul 11 11:34:50.332405 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 707/1415] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:50 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:50.336719 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-dafeef10-7f90-4669-9700-5a415286fb8a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:50.337380 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-dafeef10-7f90-4669-9700-5a415286fb8a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:50.342913 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-dafeef10-7f90-4669-9700-5a415286fb8a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:50.343392 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-dafeef10-7f90-4669-9700-5a415286fb8a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:50.344143 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-dafeef10-7f90-4669-9700-5a415286fb8a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:50.344566 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-dafeef10-7f90-4669-9700-5a415286fb8a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:50.352918 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-e826aff4-73a1-4d11-a385-c129987f75e3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:50.360690 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-e826aff4-73a1-4d11-a385-c129987f75e3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.153931 Jul 11 11:34:50.361831 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 709/1416] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:34:50 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:34:50.472957 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-dafeef10-7f90-4669-9700-5a415286fb8a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:50.481148 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-dafeef10-7f90-4669-9700-5a415286fb8a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:50.482644 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-dafeef10-7f90-4669-9700-5a415286fb8a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:50.483816 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-dafeef10-7f90-4669-9700-5a415286fb8a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.150521 Jul 11 11:34:50.484372 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 708/1417] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:34:50 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:34:51.299533 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-755b22e3-f798-4828-b0af-675a5ef13a99 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:51.300365 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-755b22e3-f798-4828-b0af-675a5ef13a99 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:51.306840 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-755b22e3-f798-4828-b0af-675a5ef13a99 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:51.307318 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-755b22e3-f798-4828-b0af-675a5ef13a99 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:51.308071 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-755b22e3-f798-4828-b0af-675a5ef13a99 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:51.308498 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-755b22e3-f798-4828-b0af-675a5ef13a99 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:51.336921 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-755b22e3-f798-4828-b0af-675a5ef13a99 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041960 Jul 11 11:34:51.337461 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 710/1418] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:51 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:51.343055 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-c6745e3e-dbe6-4e5d-b27b-9ad26799bc64 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:51.343991 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-c6745e3e-dbe6-4e5d-b27b-9ad26799bc64 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:51.350356 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c6745e3e-dbe6-4e5d-b27b-9ad26799bc64 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:51.350798 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c6745e3e-dbe6-4e5d-b27b-9ad26799bc64 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:51.351569 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c6745e3e-dbe6-4e5d-b27b-9ad26799bc64 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:51.352023 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c6745e3e-dbe6-4e5d-b27b-9ad26799bc64 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:51.378621 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-5506b4b4-56ec-45bb-96d2-d0437412c0d4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:51.379223 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-5506b4b4-56ec-45bb-96d2-d0437412c0d4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:51.380974 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-c6745e3e-dbe6-4e5d-b27b-9ad26799bc64 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041689 Jul 11 11:34:51.381537 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 709/1419] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:51 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:34:51.385225 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5506b4b4-56ec-45bb-96d2-d0437412c0d4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:51.385670 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5506b4b4-56ec-45bb-96d2-d0437412c0d4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:51.386420 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5506b4b4-56ec-45bb-96d2-d0437412c0d4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:51.386851 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5506b4b4-56ec-45bb-96d2-d0437412c0d4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:51.502906 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-0c9eb56b-6f4c-45d1-87f0-6840481369d1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:51.503655 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-0c9eb56b-6f4c-45d1-87f0-6840481369d1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:51.509716 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0c9eb56b-6f4c-45d1-87f0-6840481369d1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:51.510258 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0c9eb56b-6f4c-45d1-87f0-6840481369d1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:51.511093 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0c9eb56b-6f4c-45d1-87f0-6840481369d1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:51.511617 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0c9eb56b-6f4c-45d1-87f0-6840481369d1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:51.523305 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-5506b4b4-56ec-45bb-96d2-d0437412c0d4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:51.532732 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-5506b4b4-56ec-45bb-96d2-d0437412c0d4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.157984 Jul 11 11:34:51.533789 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 711/1420] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:34:51 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:34:51.642129 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-0c9eb56b-6f4c-45d1-87f0-6840481369d1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:51.650710 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-0c9eb56b-6f4c-45d1-87f0-6840481369d1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:51.652361 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-0c9eb56b-6f4c-45d1-87f0-6840481369d1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:51.653505 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-0c9eb56b-6f4c-45d1-87f0-6840481369d1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.155048 Jul 11 11:34:51.654058 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 710/1421] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:34:51 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 11:34:52.348174 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-75a444ca-c153-446a-a0a1-bf27020e4ce8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:52.349018 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-75a444ca-c153-446a-a0a1-bf27020e4ce8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:52.355479 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-75a444ca-c153-446a-a0a1-bf27020e4ce8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:52.355923 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-75a444ca-c153-446a-a0a1-bf27020e4ce8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:52.356672 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-75a444ca-c153-446a-a0a1-bf27020e4ce8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:52.357103 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-75a444ca-c153-446a-a0a1-bf27020e4ce8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:52.385804 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-75a444ca-c153-446a-a0a1-bf27020e4ce8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041662 Jul 11 11:34:52.386341 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 712/1422] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:52 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:52.392051 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-101ddc45-7449-4cbc-8011-d5b43751fbe1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:52.392963 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-101ddc45-7449-4cbc-8011-d5b43751fbe1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:52.396190 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_api:SELECT=100 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:34:52.399680 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-101ddc45-7449-4cbc-8011-d5b43751fbe1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:52.400127 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-101ddc45-7449-4cbc-8011-d5b43751fbe1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:52.400880 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-101ddc45-7449-4cbc-8011-d5b43751fbe1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:52.401314 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-101ddc45-7449-4cbc-8011-d5b43751fbe1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:52.429359 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-101ddc45-7449-4cbc-8011-d5b43751fbe1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041180 Jul 11 11:34:52.429898 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 711/1423] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:52 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:52.552337 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-7666fd64-ae87-48f7-bf38-191d857d08e1 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:52.552936 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-7666fd64-ae87-48f7-bf38-191d857d08e1 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:52.558983 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7666fd64-ae87-48f7-bf38-191d857d08e1 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:52.559463 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7666fd64-ae87-48f7-bf38-191d857d08e1 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:52.560214 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7666fd64-ae87-48f7-bf38-191d857d08e1 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:52.560645 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7666fd64-ae87-48f7-bf38-191d857d08e1 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:52.671572 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-8ec2c0e3-2099-4177-b8b6-731dc04f0923 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:52.672182 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-8ec2c0e3-2099-4177-b8b6-731dc04f0923 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:52.679084 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8ec2c0e3-2099-4177-b8b6-731dc04f0923 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:52.679564 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8ec2c0e3-2099-4177-b8b6-731dc04f0923 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:52.680348 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8ec2c0e3-2099-4177-b8b6-731dc04f0923 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:52.680786 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8ec2c0e3-2099-4177-b8b6-731dc04f0923 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:52.689421 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-7666fd64-ae87-48f7-bf38-191d857d08e1 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:52.693161 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=100 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:34:52.697882 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-7666fd64-ae87-48f7-bf38-191d857d08e1 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.149899 Jul 11 11:34:52.698454 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 713/1424] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:34:52 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:34:52.806862 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-8ec2c0e3-2099-4177-b8b6-731dc04f0923 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:52.815175 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-8ec2c0e3-2099-4177-b8b6-731dc04f0923 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:52.816945 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-8ec2c0e3-2099-4177-b8b6-731dc04f0923 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:52.818090 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-8ec2c0e3-2099-4177-b8b6-731dc04f0923 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.150375 Jul 11 11:34:52.818644 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 712/1425] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:34:52 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 11:34:53.398022 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-00341fb7-3d82-4e07-9d29-6ae96cd8daed tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:53.398923 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-00341fb7-3d82-4e07-9d29-6ae96cd8daed tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:53.405782 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-00341fb7-3d82-4e07-9d29-6ae96cd8daed tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:53.406226 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-00341fb7-3d82-4e07-9d29-6ae96cd8daed tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:53.406984 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-00341fb7-3d82-4e07-9d29-6ae96cd8daed tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:53.407449 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-00341fb7-3d82-4e07-9d29-6ae96cd8daed tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:53.435738 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-00341fb7-3d82-4e07-9d29-6ae96cd8daed tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041725 Jul 11 11:34:53.436288 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 714/1426] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:53 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:53.441484 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-e3382f0f-312d-43b0-a367-f86ddc506e4b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:53.442680 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-e3382f0f-312d-43b0-a367-f86ddc506e4b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:53.449060 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e3382f0f-312d-43b0-a367-f86ddc506e4b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:53.455448 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e3382f0f-312d-43b0-a367-f86ddc506e4b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:53.455448 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e3382f0f-312d-43b0-a367-f86ddc506e4b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:53.455448 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e3382f0f-312d-43b0-a367-f86ddc506e4b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:53.455448 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=100 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:34:53.479605 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-e3382f0f-312d-43b0-a367-f86ddc506e4b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042623 Jul 11 11:34:53.480150 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 713/1427] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:53 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:34:53.714706 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-7e1b2cd2-ba7d-4615-9d8b-c8fd9eb66afc tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:53.715343 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-7e1b2cd2-ba7d-4615-9d8b-c8fd9eb66afc tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:53.721193 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7e1b2cd2-ba7d-4615-9d8b-c8fd9eb66afc tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:53.721632 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7e1b2cd2-ba7d-4615-9d8b-c8fd9eb66afc tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:53.722379 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7e1b2cd2-ba7d-4615-9d8b-c8fd9eb66afc tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:53.722814 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7e1b2cd2-ba7d-4615-9d8b-c8fd9eb66afc tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:53.836712 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-d2fb0845-0b4e-49d3-9702-1465f7466a9c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:53.837323 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-d2fb0845-0b4e-49d3-9702-1465f7466a9c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:53.843698 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d2fb0845-0b4e-49d3-9702-1465f7466a9c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:53.844141 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d2fb0845-0b4e-49d3-9702-1465f7466a9c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:53.844924 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d2fb0845-0b4e-49d3-9702-1465f7466a9c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:53.845356 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d2fb0845-0b4e-49d3-9702-1465f7466a9c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:53.849307 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-7e1b2cd2-ba7d-4615-9d8b-c8fd9eb66afc tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:53.857314 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-7e1b2cd2-ba7d-4615-9d8b-c8fd9eb66afc tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.146382 Jul 11 11:34:53.857917 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 715/1428] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:34:53 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:34:53.972146 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-d2fb0845-0b4e-49d3-9702-1465f7466a9c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:53.980498 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-d2fb0845-0b4e-49d3-9702-1465f7466a9c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:53.982024 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-d2fb0845-0b4e-49d3-9702-1465f7466a9c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:53.983172 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-d2fb0845-0b4e-49d3-9702-1465f7466a9c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.151008 Jul 11 11:34:53.983758 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 714/1429] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:34:53 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 11:34:54.447140 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-e3a58bdd-4572-43ef-ad9e-e3c6e7463edc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:54.448109 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-e3a58bdd-4572-43ef-ad9e-e3c6e7463edc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:54.455050 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e3a58bdd-4572-43ef-ad9e-e3c6e7463edc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:54.455529 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e3a58bdd-4572-43ef-ad9e-e3c6e7463edc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:54.456292 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e3a58bdd-4572-43ef-ad9e-e3c6e7463edc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:54.456733 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e3a58bdd-4572-43ef-ad9e-e3c6e7463edc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:54.485408 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-e3a58bdd-4572-43ef-ad9e-e3c6e7463edc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042207 Jul 11 11:34:54.486078 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 716/1430] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:54 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:54.490921 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-30980ef6-e900-47f6-ac68-8c8450fcd180 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:54.491874 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-30980ef6-e900-47f6-ac68-8c8450fcd180 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:54.498225 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-30980ef6-e900-47f6-ac68-8c8450fcd180 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:54.498673 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-30980ef6-e900-47f6-ac68-8c8450fcd180 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:54.499461 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-30980ef6-e900-47f6-ac68-8c8450fcd180 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:54.499910 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-30980ef6-e900-47f6-ac68-8c8450fcd180 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:54.528513 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-30980ef6-e900-47f6-ac68-8c8450fcd180 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041536 Jul 11 11:34:54.529066 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 715/1431] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:54 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:34:54.874990 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-7bc751ff-fc88-4948-b34f-987c9279fbd3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:54.875552 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-7bc751ff-fc88-4948-b34f-987c9279fbd3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:54.882197 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7bc751ff-fc88-4948-b34f-987c9279fbd3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:54.882649 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7bc751ff-fc88-4948-b34f-987c9279fbd3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:54.883470 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7bc751ff-fc88-4948-b34f-987c9279fbd3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:54.883909 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7bc751ff-fc88-4948-b34f-987c9279fbd3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:55.002525 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-2d3c3050-810b-46a5-ac16-49f7bc851f47 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:55.003177 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-2d3c3050-810b-46a5-ac16-49f7bc851f47 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:55.009161 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2d3c3050-810b-46a5-ac16-49f7bc851f47 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:55.009626 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2d3c3050-810b-46a5-ac16-49f7bc851f47 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:55.010350 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2d3c3050-810b-46a5-ac16-49f7bc851f47 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:55.010780 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2d3c3050-810b-46a5-ac16-49f7bc851f47 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:55.012142 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-7bc751ff-fc88-4948-b34f-987c9279fbd3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:55.020706 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-7bc751ff-fc88-4948-b34f-987c9279fbd3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.149579 Jul 11 11:34:55.021295 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 717/1432] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:34:54 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:34:55.144756 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-2d3c3050-810b-46a5-ac16-49f7bc851f47 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:55.153013 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-2d3c3050-810b-46a5-ac16-49f7bc851f47 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:55.154515 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-2d3c3050-810b-46a5-ac16-49f7bc851f47 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:55.155702 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-2d3c3050-810b-46a5-ac16-49f7bc851f47 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.157641 Jul 11 11:34:55.156262 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 716/1433] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:34:54 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 11:34:55.496884 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-a02d552b-fc78-43b0-9139-d32d9a418a24 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:55.497898 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-a02d552b-fc78-43b0-9139-d32d9a418a24 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:55.504340 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a02d552b-fc78-43b0-9139-d32d9a418a24 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:55.504782 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a02d552b-fc78-43b0-9139-d32d9a418a24 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:55.505591 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a02d552b-fc78-43b0-9139-d32d9a418a24 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:55.506027 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a02d552b-fc78-43b0-9139-d32d9a418a24 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:55.536889 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-a02d552b-fc78-43b0-9139-d32d9a418a24 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043926 Jul 11 11:34:55.537448 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 718/1434] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:55 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:55.540539 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-54fc3228-0148-448c-bffd-40bdf1e12726 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:55.541502 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-54fc3228-0148-448c-bffd-40bdf1e12726 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:55.548001 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-54fc3228-0148-448c-bffd-40bdf1e12726 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:55.548444 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-54fc3228-0148-448c-bffd-40bdf1e12726 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:55.549194 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-54fc3228-0148-448c-bffd-40bdf1e12726 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:55.550223 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-54fc3228-0148-448c-bffd-40bdf1e12726 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:55.578179 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-54fc3228-0148-448c-bffd-40bdf1e12726 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041641 Jul 11 11:34:55.578732 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 717/1435] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:55 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:34:56.038598 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-eb635102-0cb3-4f73-8a9f-dc45c365bfe8 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:56.039202 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-eb635102-0cb3-4f73-8a9f-dc45c365bfe8 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:56.045378 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-eb635102-0cb3-4f73-8a9f-dc45c365bfe8 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:56.045826 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-eb635102-0cb3-4f73-8a9f-dc45c365bfe8 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:56.046587 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-eb635102-0cb3-4f73-8a9f-dc45c365bfe8 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:56.047020 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-eb635102-0cb3-4f73-8a9f-dc45c365bfe8 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:56.173228 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-4e1b8cd4-28e2-447b-846d-468b5766956c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:56.173972 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-4e1b8cd4-28e2-447b-846d-468b5766956c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:56.179926 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4e1b8cd4-28e2-447b-846d-468b5766956c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:56.180376 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4e1b8cd4-28e2-447b-846d-468b5766956c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:56.181151 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4e1b8cd4-28e2-447b-846d-468b5766956c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:56.181595 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4e1b8cd4-28e2-447b-846d-468b5766956c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:56.184123 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-eb635102-0cb3-4f73-8a9f-dc45c365bfe8 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:56.192835 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-eb635102-0cb3-4f73-8a9f-dc45c365bfe8 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.158519 Jul 11 11:34:56.193728 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 719/1436] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:34:56 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:34:56.313973 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-4e1b8cd4-28e2-447b-846d-468b5766956c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:56.323874 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-4e1b8cd4-28e2-447b-846d-468b5766956c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:56.325403 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-4e1b8cd4-28e2-447b-846d-468b5766956c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:56.326553 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-4e1b8cd4-28e2-447b-846d-468b5766956c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.157288 Jul 11 11:34:56.327115 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 718/1437] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:34:56 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 11:34:56.548498 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-62c123d8-2890-4ad8-8057-471837fea61c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:56.549935 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-62c123d8-2890-4ad8-8057-471837fea61c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:56.556393 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-62c123d8-2890-4ad8-8057-471837fea61c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:56.556866 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-62c123d8-2890-4ad8-8057-471837fea61c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:56.571579 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-62c123d8-2890-4ad8-8057-471837fea61c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:56.572017 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-62c123d8-2890-4ad8-8057-471837fea61c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:56.590750 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-740d9806-3325-4f61-976c-b153047a8e2c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:56.592364 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-740d9806-3325-4f61-976c-b153047a8e2c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:56.598559 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-740d9806-3325-4f61-976c-b153047a8e2c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:56.599004 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-740d9806-3325-4f61-976c-b153047a8e2c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:56.599970 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-740d9806-3325-4f61-976c-b153047a8e2c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:56.600405 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-740d9806-3325-4f61-976c-b153047a8e2c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:56.603961 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-62c123d8-2890-4ad8-8057-471837fea61c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059456 Jul 11 11:34:56.604521 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 720/1438] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:56 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:56.629934 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-740d9806-3325-4f61-976c-b153047a8e2c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043772 Jul 11 11:34:56.630358 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 719/1439] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:56 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:34:57.209726 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-e6036efd-1c8e-44e5-9b9d-147d485eeafe tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:57.210330 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-e6036efd-1c8e-44e5-9b9d-147d485eeafe tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:57.216396 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e6036efd-1c8e-44e5-9b9d-147d485eeafe tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:57.216842 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e6036efd-1c8e-44e5-9b9d-147d485eeafe tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:57.217598 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e6036efd-1c8e-44e5-9b9d-147d485eeafe tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:57.218034 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e6036efd-1c8e-44e5-9b9d-147d485eeafe tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:57.343157 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-e6036efd-1c8e-44e5-9b9d-147d485eeafe tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:57.345630 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-58c471b2-8e6d-4838-80dd-bd7ff6fcb8e5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:57.346229 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-58c471b2-8e6d-4838-80dd-bd7ff6fcb8e5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:57.351899 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-e6036efd-1c8e-44e5-9b9d-147d485eeafe tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.146035 Jul 11 11:34:57.352465 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 721/1440] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:34:57 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:34:57.352923 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-58c471b2-8e6d-4838-80dd-bd7ff6fcb8e5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:57.353364 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-58c471b2-8e6d-4838-80dd-bd7ff6fcb8e5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:57.354117 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-58c471b2-8e6d-4838-80dd-bd7ff6fcb8e5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:57.354545 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-58c471b2-8e6d-4838-80dd-bd7ff6fcb8e5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:57.486609 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-58c471b2-8e6d-4838-80dd-bd7ff6fcb8e5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:57.495402 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-58c471b2-8e6d-4838-80dd-bd7ff6fcb8e5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:57.496957 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-58c471b2-8e6d-4838-80dd-bd7ff6fcb8e5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:57.498102 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-58c471b2-8e6d-4838-80dd-bd7ff6fcb8e5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.156265 Jul 11 11:34:57.498653 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 720/1441] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:34:57 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 11:34:57.615080 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-eecafeb8-11d5-4ab2-8cf5-c90513d35220 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:57.615951 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-eecafeb8-11d5-4ab2-8cf5-c90513d35220 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:57.622337 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-eecafeb8-11d5-4ab2-8cf5-c90513d35220 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:57.622786 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-eecafeb8-11d5-4ab2-8cf5-c90513d35220 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:57.623602 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-eecafeb8-11d5-4ab2-8cf5-c90513d35220 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:57.624042 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-eecafeb8-11d5-4ab2-8cf5-c90513d35220 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:57.641175 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-e49e6a8e-cf3d-435e-a43a-1e5333a09edd tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:57.642125 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-e49e6a8e-cf3d-435e-a43a-1e5333a09edd tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:57.649280 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e49e6a8e-cf3d-435e-a43a-1e5333a09edd tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:57.649729 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e49e6a8e-cf3d-435e-a43a-1e5333a09edd tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:57.650498 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e49e6a8e-cf3d-435e-a43a-1e5333a09edd tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:57.650938 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e49e6a8e-cf3d-435e-a43a-1e5333a09edd tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:57.654475 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-eecafeb8-11d5-4ab2-8cf5-c90513d35220 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043282 Jul 11 11:34:57.655232 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 722/1442] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:57 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:57.679482 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-e49e6a8e-cf3d-435e-a43a-1e5333a09edd tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042168 Jul 11 11:34:57.680031 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 721/1443] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:57 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:34:58.368524 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-524731b2-4d70-4914-a0b4-25dc0ce43a58 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:58.369130 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-524731b2-4d70-4914-a0b4-25dc0ce43a58 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:58.375005 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-524731b2-4d70-4914-a0b4-25dc0ce43a58 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:58.375479 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-524731b2-4d70-4914-a0b4-25dc0ce43a58 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:58.376232 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-524731b2-4d70-4914-a0b4-25dc0ce43a58 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:58.376972 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-524731b2-4d70-4914-a0b4-25dc0ce43a58 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:58.504509 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-524731b2-4d70-4914-a0b4-25dc0ce43a58 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:58.512567 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-524731b2-4d70-4914-a0b4-25dc0ce43a58 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.147823 Jul 11 11:34:58.513127 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 723/1444] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:34:58 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:34:58.516049 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-a8798eee-7d9f-45c7-bd7e-4644f4b68ba9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:58.516654 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-a8798eee-7d9f-45c7-bd7e-4644f4b68ba9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:58.522591 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a8798eee-7d9f-45c7-bd7e-4644f4b68ba9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:58.523037 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a8798eee-7d9f-45c7-bd7e-4644f4b68ba9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:58.523826 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a8798eee-7d9f-45c7-bd7e-4644f4b68ba9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:58.524261 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a8798eee-7d9f-45c7-bd7e-4644f4b68ba9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:58.647223 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-a8798eee-7d9f-45c7-bd7e-4644f4b68ba9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:58.655903 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-a8798eee-7d9f-45c7-bd7e-4644f4b68ba9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:58.657386 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-a8798eee-7d9f-45c7-bd7e-4644f4b68ba9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:58.658513 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-a8798eee-7d9f-45c7-bd7e-4644f4b68ba9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.146335 Jul 11 11:34:58.659053 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 722/1445] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:34:58 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 11:34:58.666442 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-408f1b14-9447-4ef5-a501-e3d08c0b7b14 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:58.667422 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-408f1b14-9447-4ef5-a501-e3d08c0b7b14 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:58.673768 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-408f1b14-9447-4ef5-a501-e3d08c0b7b14 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:58.674212 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-408f1b14-9447-4ef5-a501-e3d08c0b7b14 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:58.674972 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-408f1b14-9447-4ef5-a501-e3d08c0b7b14 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:58.675448 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-408f1b14-9447-4ef5-a501-e3d08c0b7b14 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:58.690158 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-ccc4a03b-b0d8-40b2-9ad8-b74b0ace0be0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:58.691063 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-ccc4a03b-b0d8-40b2-9ad8-b74b0ace0be0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:58.697200 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ccc4a03b-b0d8-40b2-9ad8-b74b0ace0be0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:58.697641 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ccc4a03b-b0d8-40b2-9ad8-b74b0ace0be0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:58.698389 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ccc4a03b-b0d8-40b2-9ad8-b74b0ace0be0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:58.698820 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ccc4a03b-b0d8-40b2-9ad8-b74b0ace0be0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:58.704633 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-408f1b14-9447-4ef5-a501-e3d08c0b7b14 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042045 Jul 11 11:34:58.705190 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 724/1446] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:58 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:58.727300 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-ccc4a03b-b0d8-40b2-9ad8-b74b0ace0be0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040920 Jul 11 11:34:58.727845 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 723/1447] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:58 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:34:59.528763 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-fe75239d-6837-46d2-b03a-3f288668aab4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:59.529399 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-fe75239d-6837-46d2-b03a-3f288668aab4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:59.536073 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fe75239d-6837-46d2-b03a-3f288668aab4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:59.536521 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fe75239d-6837-46d2-b03a-3f288668aab4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:59.537281 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fe75239d-6837-46d2-b03a-3f288668aab4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:59.537741 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fe75239d-6837-46d2-b03a-3f288668aab4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:59.661295 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-fe75239d-6837-46d2-b03a-3f288668aab4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:59.669045 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-fe75239d-6837-46d2-b03a-3f288668aab4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.144166 Jul 11 11:34:59.669606 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 725/1448] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:34:59 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:34:59.676891 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-9c74dd1c-0be7-4024-b519-a09ffebdc17f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:59.677496 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-9c74dd1c-0be7-4024-b519-a09ffebdc17f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:59.684028 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9c74dd1c-0be7-4024-b519-a09ffebdc17f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:59.684468 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9c74dd1c-0be7-4024-b519-a09ffebdc17f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:59.685213 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9c74dd1c-0be7-4024-b519-a09ffebdc17f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:59.685641 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9c74dd1c-0be7-4024-b519-a09ffebdc17f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:59.716019 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-d1b6e8a5-0609-4aa9-9d69-d0cf25faf3d3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:59.716972 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-d1b6e8a5-0609-4aa9-9d69-d0cf25faf3d3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:59.724006 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d1b6e8a5-0609-4aa9-9d69-d0cf25faf3d3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:59.724455 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d1b6e8a5-0609-4aa9-9d69-d0cf25faf3d3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:59.725217 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d1b6e8a5-0609-4aa9-9d69-d0cf25faf3d3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:59.725653 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d1b6e8a5-0609-4aa9-9d69-d0cf25faf3d3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:59.754320 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-d1b6e8a5-0609-4aa9-9d69-d0cf25faf3d3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042157 Jul 11 11:34:59.754874 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 726/1449] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:59 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:34:59.759525 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-22e06d9b-600d-45c9-9793-4c50e6bc620b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:34:59.760865 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-22e06d9b-600d-45c9-9793-4c50e6bc620b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:34:59.766170 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-22e06d9b-600d-45c9-9793-4c50e6bc620b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:59.766618 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-22e06d9b-600d-45c9-9793-4c50e6bc620b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:59.767408 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-22e06d9b-600d-45c9-9793-4c50e6bc620b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:34:59.767847 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-22e06d9b-600d-45c9-9793-4c50e6bc620b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:34:59.798527 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-22e06d9b-600d-45c9-9793-4c50e6bc620b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042592 Jul 11 11:34:59.799103 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 727/1450] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:34:59 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:34:59.812649 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-9c74dd1c-0be7-4024-b519-a09ffebdc17f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:59.821940 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-9c74dd1c-0be7-4024-b519-a09ffebdc17f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:59.823457 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-9c74dd1c-0be7-4024-b519-a09ffebdc17f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:34:59.824592 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-9c74dd1c-0be7-4024-b519-a09ffebdc17f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.151542 Jul 11 11:34:59.825142 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 724/1451] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:34:59 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:35:00.685168 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-c752eb2c-44c8-4d70-aeae-90f6bcfc580f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:00.685783 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-c752eb2c-44c8-4d70-aeae-90f6bcfc580f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:00.692057 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c752eb2c-44c8-4d70-aeae-90f6bcfc580f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:00.692515 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c752eb2c-44c8-4d70-aeae-90f6bcfc580f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:00.693272 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c752eb2c-44c8-4d70-aeae-90f6bcfc580f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:00.693706 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c752eb2c-44c8-4d70-aeae-90f6bcfc580f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:00.765523 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-cc83f7b2-e9de-4c80-aad1-bb2142deb7be tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:00.766368 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-cc83f7b2-e9de-4c80-aad1-bb2142deb7be tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:00.772847 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-cc83f7b2-e9de-4c80-aad1-bb2142deb7be tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:00.773275 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-cc83f7b2-e9de-4c80-aad1-bb2142deb7be tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:00.774043 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-cc83f7b2-e9de-4c80-aad1-bb2142deb7be tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:00.774480 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-cc83f7b2-e9de-4c80-aad1-bb2142deb7be tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:00.804011 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-cc83f7b2-e9de-4c80-aad1-bb2142deb7be tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042424 Jul 11 11:35:00.809940 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 725/1452] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:00 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:35:00.810393 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-09d69911-6654-4549-8325-27c344980ec3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:00.811331 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-09d69911-6654-4549-8325-27c344980ec3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:00.817385 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-09d69911-6654-4549-8325-27c344980ec3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:00.817836 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-09d69911-6654-4549-8325-27c344980ec3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:00.818676 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-09d69911-6654-4549-8325-27c344980ec3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:00.819113 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-09d69911-6654-4549-8325-27c344980ec3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:00.823538 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-c752eb2c-44c8-4d70-aeae-90f6bcfc580f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:00.831468 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-c752eb2c-44c8-4d70-aeae-90f6bcfc580f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.150179 Jul 11 11:35:00.832041 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 728/1453] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:35:00 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:35:00.842785 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-13fc571a-0034-4bf7-b11f-128c3d53bd70 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:00.843424 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-13fc571a-0034-4bf7-b11f-128c3d53bd70 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:00.848402 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-09d69911-6654-4549-8325-27c344980ec3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041681 Jul 11 11:35:00.848966 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 726/1454] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:00 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:35:00.849797 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-13fc571a-0034-4bf7-b11f-128c3d53bd70 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:00.850247 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-13fc571a-0034-4bf7-b11f-128c3d53bd70 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:00.851011 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-13fc571a-0034-4bf7-b11f-128c3d53bd70 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:00.851479 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-13fc571a-0034-4bf7-b11f-128c3d53bd70 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:00.977158 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-13fc571a-0034-4bf7-b11f-128c3d53bd70 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:00.985385 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-13fc571a-0034-4bf7-b11f-128c3d53bd70 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:00.986885 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-13fc571a-0034-4bf7-b11f-128c3d53bd70 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:00.988127 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-13fc571a-0034-4bf7-b11f-128c3d53bd70 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.149065 Jul 11 11:35:00.989239 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 729/1455] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:35:00 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 11:35:01.817689 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-35dcb725-7e81-4ed8-b5ee-e3b5e59c7eb1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:01.818576 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-35dcb725-7e81-4ed8-b5ee-e3b5e59c7eb1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:01.825054 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-35dcb725-7e81-4ed8-b5ee-e3b5e59c7eb1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:01.825507 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-35dcb725-7e81-4ed8-b5ee-e3b5e59c7eb1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:01.826267 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-35dcb725-7e81-4ed8-b5ee-e3b5e59c7eb1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:01.826703 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-35dcb725-7e81-4ed8-b5ee-e3b5e59c7eb1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:01.847333 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-e4ea05c4-2b67-4ba5-821f-eb9669f12a84 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:01.848513 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-e4ea05c4-2b67-4ba5-821f-eb9669f12a84 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:01.854919 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e4ea05c4-2b67-4ba5-821f-eb9669f12a84 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:01.855397 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e4ea05c4-2b67-4ba5-821f-eb9669f12a84 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:01.856157 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e4ea05c4-2b67-4ba5-821f-eb9669f12a84 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:01.856274 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-35dcb725-7e81-4ed8-b5ee-e3b5e59c7eb1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042784 Jul 11 11:35:01.856589 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e4ea05c4-2b67-4ba5-821f-eb9669f12a84 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:01.856788 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 727/1456] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:01 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:35:01.861446 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-bbbeed11-e619-48e9-8ef5-e3164bf1b88f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:01.862348 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-bbbeed11-e619-48e9-8ef5-e3164bf1b88f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:01.868242 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bbbeed11-e619-48e9-8ef5-e3164bf1b88f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:01.868686 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bbbeed11-e619-48e9-8ef5-e3164bf1b88f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:01.869443 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bbbeed11-e619-48e9-8ef5-e3164bf1b88f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:01.869871 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bbbeed11-e619-48e9-8ef5-e3164bf1b88f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:01.874727 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=100 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:35:01.898979 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-bbbeed11-e619-48e9-8ef5-e3164bf1b88f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041138 Jul 11 11:35:01.899574 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 728/1457] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:01 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:35:01.986144 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-e4ea05c4-2b67-4ba5-821f-eb9669f12a84 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:01.993911 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-e4ea05c4-2b67-4ba5-821f-eb9669f12a84 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.150271 Jul 11 11:35:01.994473 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 730/1458] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:35:01 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:35:02.006218 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-25973295-cf65-4f31-93fa-e910fb5b1636 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:02.006852 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-25973295-cf65-4f31-93fa-e910fb5b1636 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:02.012713 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-25973295-cf65-4f31-93fa-e910fb5b1636 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:02.013151 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-25973295-cf65-4f31-93fa-e910fb5b1636 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:02.014227 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-25973295-cf65-4f31-93fa-e910fb5b1636 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:02.014654 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-25973295-cf65-4f31-93fa-e910fb5b1636 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:02.141701 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-25973295-cf65-4f31-93fa-e910fb5b1636 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:02.145723 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=100 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:35:02.150874 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-25973295-cf65-4f31-93fa-e910fb5b1636 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:02.152416 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-25973295-cf65-4f31-93fa-e910fb5b1636 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:02.157031 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-25973295-cf65-4f31-93fa-e910fb5b1636 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.151218 Jul 11 11:35:02.157031 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 729/1459] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:35:02 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:35:02.868251 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-af1b83a6-4123-4d8f-bab8-2959c75f3c00 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:02.869183 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-af1b83a6-4123-4d8f-bab8-2959c75f3c00 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:02.875620 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-af1b83a6-4123-4d8f-bab8-2959c75f3c00 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:02.876069 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-af1b83a6-4123-4d8f-bab8-2959c75f3c00 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:02.876831 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-af1b83a6-4123-4d8f-bab8-2959c75f3c00 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:02.877267 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-af1b83a6-4123-4d8f-bab8-2959c75f3c00 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:02.910907 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-e3c43cab-fe78-4aca-beb2-953c617a19f3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:02.911523 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-af1b83a6-4123-4d8f-bab8-2959c75f3c00 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046071 Jul 11 11:35:02.911827 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 731/1460] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:02 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:35:02.911960 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-e3c43cab-fe78-4aca-beb2-953c617a19f3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:02.918891 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e3c43cab-fe78-4aca-beb2-953c617a19f3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:02.919819 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e3c43cab-fe78-4aca-beb2-953c617a19f3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:02.920133 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e3c43cab-fe78-4aca-beb2-953c617a19f3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:02.920569 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e3c43cab-fe78-4aca-beb2-953c617a19f3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:02.950753 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-e3c43cab-fe78-4aca-beb2-953c617a19f3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044623 Jul 11 11:35:02.951325 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 730/1461] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:02 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:35:03.016961 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-7fcbf3a7-c3d8-4a77-81e5-3ddbc19a2e3b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:03.017575 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-7fcbf3a7-c3d8-4a77-81e5-3ddbc19a2e3b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:03.023524 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7fcbf3a7-c3d8-4a77-81e5-3ddbc19a2e3b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:03.023972 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7fcbf3a7-c3d8-4a77-81e5-3ddbc19a2e3b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:03.024730 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7fcbf3a7-c3d8-4a77-81e5-3ddbc19a2e3b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:03.025165 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7fcbf3a7-c3d8-4a77-81e5-3ddbc19a2e3b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:03.159866 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-7fcbf3a7-c3d8-4a77-81e5-3ddbc19a2e3b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:03.168330 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-7fcbf3a7-c3d8-4a77-81e5-3ddbc19a2e3b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.155217 Jul 11 11:35:03.168896 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 732/1462] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:35:03 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:35:03.171810 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-cae04b8d-6823-4f20-855a-965717df5084 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:03.178527 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-cae04b8d-6823-4f20-855a-965717df5084 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:03.178765 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-cae04b8d-6823-4f20-855a-965717df5084 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:03.179207 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-cae04b8d-6823-4f20-855a-965717df5084 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:03.179989 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-cae04b8d-6823-4f20-855a-965717df5084 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:03.180416 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-cae04b8d-6823-4f20-855a-965717df5084 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:03.314508 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-cae04b8d-6823-4f20-855a-965717df5084 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:03.323589 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-cae04b8d-6823-4f20-855a-965717df5084 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:03.325086 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-cae04b8d-6823-4f20-855a-965717df5084 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:03.326225 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-cae04b8d-6823-4f20-855a-965717df5084 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.158491 Jul 11 11:35:03.326779 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 731/1463] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:35:03 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:35:03.922017 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-f84bd087-1433-467b-8de4-bfdce5939be9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:03.922970 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-f84bd087-1433-467b-8de4-bfdce5939be9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:03.937183 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f84bd087-1433-467b-8de4-bfdce5939be9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:03.937634 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f84bd087-1433-467b-8de4-bfdce5939be9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:03.938399 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f84bd087-1433-467b-8de4-bfdce5939be9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:03.938832 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f84bd087-1433-467b-8de4-bfdce5939be9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:03.962481 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-2c12355a-b4b2-4b65-9d3f-56b8ccd5cc33 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:03.963496 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-2c12355a-b4b2-4b65-9d3f-56b8ccd5cc33 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:03.970018 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-f84bd087-1433-467b-8de4-bfdce5939be9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052100 Jul 11 11:35:03.970218 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2c12355a-b4b2-4b65-9d3f-56b8ccd5cc33 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:03.970598 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 733/1464] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:03 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:35:03.970758 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2c12355a-b4b2-4b65-9d3f-56b8ccd5cc33 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:03.971420 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2c12355a-b4b2-4b65-9d3f-56b8ccd5cc33 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:03.971857 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2c12355a-b4b2-4b65-9d3f-56b8ccd5cc33 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:04.003168 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-2c12355a-b4b2-4b65-9d3f-56b8ccd5cc33 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044551 Jul 11 11:35:04.005628 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 732/1465] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:03 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:35:04.185642 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-d285e2aa-4c49-4971-b254-e08ff3694926 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:04.186166 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-d285e2aa-4c49-4971-b254-e08ff3694926 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:04.192911 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d285e2aa-4c49-4971-b254-e08ff3694926 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:04.192911 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d285e2aa-4c49-4971-b254-e08ff3694926 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:04.193622 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d285e2aa-4c49-4971-b254-e08ff3694926 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:04.195297 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d285e2aa-4c49-4971-b254-e08ff3694926 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:04.329722 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-d285e2aa-4c49-4971-b254-e08ff3694926 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:04.339630 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-d285e2aa-4c49-4971-b254-e08ff3694926 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.157768 Jul 11 11:35:04.340900 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 734/1466] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:35:04 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:35:04.344947 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-b9e80cbf-d894-4ca4-8621-5b1066a649f9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:04.345551 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-b9e80cbf-d894-4ca4-8621-5b1066a649f9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:04.352070 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b9e80cbf-d894-4ca4-8621-5b1066a649f9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:04.352514 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b9e80cbf-d894-4ca4-8621-5b1066a649f9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:04.353261 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b9e80cbf-d894-4ca4-8621-5b1066a649f9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:04.353690 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b9e80cbf-d894-4ca4-8621-5b1066a649f9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:04.502159 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-b9e80cbf-d894-4ca4-8621-5b1066a649f9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:04.512351 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-b9e80cbf-d894-4ca4-8621-5b1066a649f9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:04.515112 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-b9e80cbf-d894-4ca4-8621-5b1066a649f9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:04.516332 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-b9e80cbf-d894-4ca4-8621-5b1066a649f9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.175199 Jul 11 11:35:04.516891 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 733/1467] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:35:04 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 11:35:04.982515 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-1a2758f9-affa-419e-86c0-3327ab5541f0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:04.983389 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-1a2758f9-affa-419e-86c0-3327ab5541f0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:04.990334 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1a2758f9-affa-419e-86c0-3327ab5541f0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:04.990781 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1a2758f9-affa-419e-86c0-3327ab5541f0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:04.991560 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1a2758f9-affa-419e-86c0-3327ab5541f0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:04.991994 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1a2758f9-affa-419e-86c0-3327ab5541f0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:05.015122 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-72333453-9a63-4d16-9c47-5411f67c2369 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:05.016061 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-72333453-9a63-4d16-9c47-5411f67c2369 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:05.021521 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-1a2758f9-affa-419e-86c0-3327ab5541f0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043017 Jul 11 11:35:05.022085 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 735/1468] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:04 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:35:05.022581 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-72333453-9a63-4d16-9c47-5411f67c2369 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:05.023029 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-72333453-9a63-4d16-9c47-5411f67c2369 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:05.023821 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-72333453-9a63-4d16-9c47-5411f67c2369 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:05.024248 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-72333453-9a63-4d16-9c47-5411f67c2369 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:05.052904 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-72333453-9a63-4d16-9c47-5411f67c2369 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041827 Jul 11 11:35:05.053455 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 734/1469] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:05 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:35:05.356775 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-60e71aca-bcf1-4ec5-a8cd-c07d5655a366 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:05.357310 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-60e71aca-bcf1-4ec5-a8cd-c07d5655a366 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:05.364041 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-60e71aca-bcf1-4ec5-a8cd-c07d5655a366 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:05.364491 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-60e71aca-bcf1-4ec5-a8cd-c07d5655a366 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:05.365259 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-60e71aca-bcf1-4ec5-a8cd-c07d5655a366 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:05.365695 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-60e71aca-bcf1-4ec5-a8cd-c07d5655a366 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:05.495482 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-60e71aca-bcf1-4ec5-a8cd-c07d5655a366 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:05.503458 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-60e71aca-bcf1-4ec5-a8cd-c07d5655a366 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.150594 Jul 11 11:35:05.504083 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 736/1470] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:35:05 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:35:05.535404 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-9bfb4b40-69dc-4485-8a85-e75687823019 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:05.536031 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-9bfb4b40-69dc-4485-8a85-e75687823019 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:05.541989 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9bfb4b40-69dc-4485-8a85-e75687823019 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:05.542432 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9bfb4b40-69dc-4485-8a85-e75687823019 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:05.543179 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9bfb4b40-69dc-4485-8a85-e75687823019 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:05.543703 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9bfb4b40-69dc-4485-8a85-e75687823019 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:05.668093 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-9bfb4b40-69dc-4485-8a85-e75687823019 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:05.676900 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-9bfb4b40-69dc-4485-8a85-e75687823019 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:05.678387 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-9bfb4b40-69dc-4485-8a85-e75687823019 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:05.679558 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-9bfb4b40-69dc-4485-8a85-e75687823019 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.148532 Jul 11 11:35:05.680105 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 735/1471] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:35:05 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:35:06.032993 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-01853ea5-aa06-495e-9b79-465ee213028d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:06.035727 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-01853ea5-aa06-495e-9b79-465ee213028d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:06.040959 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-01853ea5-aa06-495e-9b79-465ee213028d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:06.041412 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-01853ea5-aa06-495e-9b79-465ee213028d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:06.042168 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-01853ea5-aa06-495e-9b79-465ee213028d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:06.042604 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-01853ea5-aa06-495e-9b79-465ee213028d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:06.064478 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-a4b3b019-94aa-4499-8b08-05c833a9f813 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:06.065391 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-a4b3b019-94aa-4499-8b08-05c833a9f813 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:06.071877 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-01853ea5-aa06-495e-9b79-465ee213028d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042759 Jul 11 11:35:06.072148 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a4b3b019-94aa-4499-8b08-05c833a9f813 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:06.072639 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 737/1472] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:06 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:35:06.072782 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a4b3b019-94aa-4499-8b08-05c833a9f813 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:06.073349 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a4b3b019-94aa-4499-8b08-05c833a9f813 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:06.073781 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a4b3b019-94aa-4499-8b08-05c833a9f813 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:06.103060 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-a4b3b019-94aa-4499-8b08-05c833a9f813 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042455 Jul 11 11:35:06.103632 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 736/1473] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:06 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:35:06.520386 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-71dd3609-94ed-444a-bc08-15105ec61deb tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:06.520917 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-71dd3609-94ed-444a-bc08-15105ec61deb tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:06.526814 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-71dd3609-94ed-444a-bc08-15105ec61deb tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:06.527280 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-71dd3609-94ed-444a-bc08-15105ec61deb tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:06.528056 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-71dd3609-94ed-444a-bc08-15105ec61deb tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:06.528485 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-71dd3609-94ed-444a-bc08-15105ec61deb tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:06.680067 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-71dd3609-94ed-444a-bc08-15105ec61deb tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:06.687986 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-71dd3609-94ed-444a-bc08-15105ec61deb tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.171535 Jul 11 11:35:06.688552 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 738/1474] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:35:06 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:35:06.698198 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-b3eae75c-f66a-44e2-b59e-6cdb14866c2f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:06.699191 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-b3eae75c-f66a-44e2-b59e-6cdb14866c2f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:06.704836 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b3eae75c-f66a-44e2-b59e-6cdb14866c2f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:06.705276 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b3eae75c-f66a-44e2-b59e-6cdb14866c2f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:06.706067 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b3eae75c-f66a-44e2-b59e-6cdb14866c2f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:06.706493 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b3eae75c-f66a-44e2-b59e-6cdb14866c2f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:06.836844 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-b3eae75c-f66a-44e2-b59e-6cdb14866c2f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:06.845125 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-b3eae75c-f66a-44e2-b59e-6cdb14866c2f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:06.846618 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-b3eae75c-f66a-44e2-b59e-6cdb14866c2f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:06.847809 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-b3eae75c-f66a-44e2-b59e-6cdb14866c2f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.153545 Jul 11 11:35:06.848350 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 737/1475] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:35:06 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:35:07.084159 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-5aa93893-5a6e-4722-85f4-1cb79eda60fd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:07.085133 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-5aa93893-5a6e-4722-85f4-1cb79eda60fd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:07.091667 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5aa93893-5a6e-4722-85f4-1cb79eda60fd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:07.092115 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5aa93893-5a6e-4722-85f4-1cb79eda60fd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:07.092880 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5aa93893-5a6e-4722-85f4-1cb79eda60fd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:07.093314 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5aa93893-5a6e-4722-85f4-1cb79eda60fd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:07.114027 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-aca35bd4-4b87-44e6-a781-03b0e363dd87 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:07.114927 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-aca35bd4-4b87-44e6-a781-03b0e363dd87 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:07.121386 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-aca35bd4-4b87-44e6-a781-03b0e363dd87 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:07.121825 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-aca35bd4-4b87-44e6-a781-03b0e363dd87 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:07.122165 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-5aa93893-5a6e-4722-85f4-1cb79eda60fd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042626 Jul 11 11:35:07.122580 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-aca35bd4-4b87-44e6-a781-03b0e363dd87 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:07.123014 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 739/1476] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:07 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:35:07.123137 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-aca35bd4-4b87-44e6-a781-03b0e363dd87 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:07.151661 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-aca35bd4-4b87-44e6-a781-03b0e363dd87 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041660 Jul 11 11:35:07.152198 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 738/1477] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:07 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:35:07.705817 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-04d5e7c3-2af2-4cf2-b15b-a1a1da2ab595 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:07.706430 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-04d5e7c3-2af2-4cf2-b15b-a1a1da2ab595 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:07.712477 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-04d5e7c3-2af2-4cf2-b15b-a1a1da2ab595 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:07.712930 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-04d5e7c3-2af2-4cf2-b15b-a1a1da2ab595 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:07.713690 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-04d5e7c3-2af2-4cf2-b15b-a1a1da2ab595 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:07.714123 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-04d5e7c3-2af2-4cf2-b15b-a1a1da2ab595 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:07.842940 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-04d5e7c3-2af2-4cf2-b15b-a1a1da2ab595 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:07.851837 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-04d5e7c3-2af2-4cf2-b15b-a1a1da2ab595 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.149807 Jul 11 11:35:07.852425 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 740/1478] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:35:07 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:35:07.866263 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-60278d7c-32fd-4276-8d93-08a3d722c9f2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:07.866871 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-60278d7c-32fd-4276-8d93-08a3d722c9f2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:07.872948 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-60278d7c-32fd-4276-8d93-08a3d722c9f2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:07.873399 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-60278d7c-32fd-4276-8d93-08a3d722c9f2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:07.874209 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-60278d7c-32fd-4276-8d93-08a3d722c9f2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:07.874647 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-60278d7c-32fd-4276-8d93-08a3d722c9f2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:08.003363 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-60278d7c-32fd-4276-8d93-08a3d722c9f2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:08.011650 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-60278d7c-32fd-4276-8d93-08a3d722c9f2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:08.013196 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-60278d7c-32fd-4276-8d93-08a3d722c9f2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:08.014349 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-60278d7c-32fd-4276-8d93-08a3d722c9f2 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.152501 Jul 11 11:35:08.014902 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 739/1479] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:35:07 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:35:08.133761 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-acd987b8-1fd7-4db9-a795-19c503519180 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:08.134644 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-acd987b8-1fd7-4db9-a795-19c503519180 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:08.141047 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-acd987b8-1fd7-4db9-a795-19c503519180 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:08.141492 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-acd987b8-1fd7-4db9-a795-19c503519180 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:08.142236 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-acd987b8-1fd7-4db9-a795-19c503519180 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:08.142666 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-acd987b8-1fd7-4db9-a795-19c503519180 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:08.163217 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-4eb01dd8-7307-4a44-b372-7e1cc7cda100 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:08.164190 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-4eb01dd8-7307-4a44-b372-7e1cc7cda100 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:08.170550 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4eb01dd8-7307-4a44-b372-7e1cc7cda100 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:08.171002 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4eb01dd8-7307-4a44-b372-7e1cc7cda100 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:08.171797 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4eb01dd8-7307-4a44-b372-7e1cc7cda100 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:08.172095 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-acd987b8-1fd7-4db9-a795-19c503519180 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042279 Jul 11 11:35:08.172224 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4eb01dd8-7307-4a44-b372-7e1cc7cda100 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:08.172659 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 741/1480] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:08 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:35:08.200645 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-4eb01dd8-7307-4a44-b372-7e1cc7cda100 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041868 Jul 11 11:35:08.201187 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 740/1481] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:08 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:35:08.869394 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-56d94e7e-325e-4fea-b357-3322397d5b54 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:08.870008 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-56d94e7e-325e-4fea-b357-3322397d5b54 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:08.876767 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-56d94e7e-325e-4fea-b357-3322397d5b54 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:08.877218 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-56d94e7e-325e-4fea-b357-3322397d5b54 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:08.877986 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-56d94e7e-325e-4fea-b357-3322397d5b54 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:08.878427 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-56d94e7e-325e-4fea-b357-3322397d5b54 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:09.004912 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-56d94e7e-325e-4fea-b357-3322397d5b54 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:09.012738 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-56d94e7e-325e-4fea-b357-3322397d5b54 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.147213 Jul 11 11:35:09.018197 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 742/1482] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:35:08 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:35:09.032649 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-af75badc-7470-4628-b576-661901840e2f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:09.033263 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-af75badc-7470-4628-b576-661901840e2f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:09.039219 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-af75badc-7470-4628-b576-661901840e2f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:09.039694 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-af75badc-7470-4628-b576-661901840e2f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:09.040508 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-af75badc-7470-4628-b576-661901840e2f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:09.040942 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-af75badc-7470-4628-b576-661901840e2f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:09.166378 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-af75badc-7470-4628-b576-661901840e2f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:09.175454 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-af75badc-7470-4628-b576-661901840e2f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:09.177519 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-af75badc-7470-4628-b576-661901840e2f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:09.178773 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-af75badc-7470-4628-b576-661901840e2f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.150322 Jul 11 11:35:09.179383 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 741/1483] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:35:09 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:35:09.183659 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-efea5b04-62f8-4fec-ab66-458a6f0e6bee tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:09.184606 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-efea5b04-62f8-4fec-ab66-458a6f0e6bee tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:09.191049 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-efea5b04-62f8-4fec-ab66-458a6f0e6bee tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:09.192401 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-efea5b04-62f8-4fec-ab66-458a6f0e6bee tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:09.193149 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-efea5b04-62f8-4fec-ab66-458a6f0e6bee tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:09.193578 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-efea5b04-62f8-4fec-ab66-458a6f0e6bee tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:09.212200 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-73784a0b-8aa6-4bc9-b232-e200e0b76b27 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:09.213144 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-73784a0b-8aa6-4bc9-b232-e200e0b76b27 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:09.219039 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-73784a0b-8aa6-4bc9-b232-e200e0b76b27 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:09.219532 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-73784a0b-8aa6-4bc9-b232-e200e0b76b27 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:09.220308 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-73784a0b-8aa6-4bc9-b232-e200e0b76b27 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:09.220721 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-73784a0b-8aa6-4bc9-b232-e200e0b76b27 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:09.221813 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-efea5b04-62f8-4fec-ab66-458a6f0e6bee tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042012 Jul 11 11:35:09.222389 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 743/1484] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:09 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:35:09.249898 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-73784a0b-8aa6-4bc9-b232-e200e0b76b27 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041524 Jul 11 11:35:09.258082 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 742/1485] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:09 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:35:10.032986 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-a197e368-daac-423b-8f5f-afd59e6f2f08 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:10.033595 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-a197e368-daac-423b-8f5f-afd59e6f2f08 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:10.039552 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a197e368-daac-423b-8f5f-afd59e6f2f08 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:10.039999 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a197e368-daac-423b-8f5f-afd59e6f2f08 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:10.040755 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a197e368-daac-423b-8f5f-afd59e6f2f08 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:10.041186 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a197e368-daac-423b-8f5f-afd59e6f2f08 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:10.165186 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-a197e368-daac-423b-8f5f-afd59e6f2f08 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:10.173219 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-a197e368-daac-423b-8f5f-afd59e6f2f08 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.144011 Jul 11 11:35:10.173795 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 744/1486] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:35:10 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:35:10.197322 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-7e313d00-3840-4e3e-bc2f-b4f9d4f978a3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:10.197847 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-7e313d00-3840-4e3e-bc2f-b4f9d4f978a3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:10.204252 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7e313d00-3840-4e3e-bc2f-b4f9d4f978a3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:10.204693 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7e313d00-3840-4e3e-bc2f-b4f9d4f978a3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:10.205439 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7e313d00-3840-4e3e-bc2f-b4f9d4f978a3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:10.205867 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7e313d00-3840-4e3e-bc2f-b4f9d4f978a3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:10.232355 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-c1c7c126-3045-4588-8672-9141c711e3de tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:10.233279 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-c1c7c126-3045-4588-8672-9141c711e3de tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:10.239840 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c1c7c126-3045-4588-8672-9141c711e3de tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:10.240287 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c1c7c126-3045-4588-8672-9141c711e3de tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:10.241055 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c1c7c126-3045-4588-8672-9141c711e3de tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:10.241491 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c1c7c126-3045-4588-8672-9141c711e3de tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:10.271418 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-c1c7c126-3045-4588-8672-9141c711e3de tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042795 Jul 11 11:35:10.271981 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 745/1487] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:10 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:35:10.276443 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-bbc84901-35a4-4c93-9a24-eaa019e538c7 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:10.277369 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-bbc84901-35a4-4c93-9a24-eaa019e538c7 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:10.283130 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-bbc84901-35a4-4c93-9a24-eaa019e538c7 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:10.283613 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-bbc84901-35a4-4c93-9a24-eaa019e538c7 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:10.284828 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-bbc84901-35a4-4c93-9a24-eaa019e538c7 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:10.284828 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-bbc84901-35a4-4c93-9a24-eaa019e538c7 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:10.312951 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-bbc84901-35a4-4c93-9a24-eaa019e538c7 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039957 Jul 11 11:35:10.313516 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 746/1488] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:10 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:35:10.335634 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-7e313d00-3840-4e3e-bc2f-b4f9d4f978a3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:10.343872 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-7e313d00-3840-4e3e-bc2f-b4f9d4f978a3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:10.345360 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-7e313d00-3840-4e3e-bc2f-b4f9d4f978a3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:10.346492 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-7e313d00-3840-4e3e-bc2f-b4f9d4f978a3 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.153044 Jul 11 11:35:10.347039 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 743/1489] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:35:10 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:35:11.189985 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-8d32c170-a235-4fc4-a63a-c347d572965c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:11.190596 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-8d32c170-a235-4fc4-a63a-c347d572965c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:11.196921 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8d32c170-a235-4fc4-a63a-c347d572965c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:11.197372 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8d32c170-a235-4fc4-a63a-c347d572965c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:11.198136 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8d32c170-a235-4fc4-a63a-c347d572965c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:11.198573 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8d32c170-a235-4fc4-a63a-c347d572965c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:11.202526 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=100 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:35:11.282327 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-ab873ad9-29c1-41cb-b825-03ee6974d926 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:11.283246 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-ab873ad9-29c1-41cb-b825-03ee6974d926 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:11.290295 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ab873ad9-29c1-41cb-b825-03ee6974d926 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:11.290734 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ab873ad9-29c1-41cb-b825-03ee6974d926 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:11.291516 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ab873ad9-29c1-41cb-b825-03ee6974d926 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:11.291944 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ab873ad9-29c1-41cb-b825-03ee6974d926 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:11.322732 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-ab873ad9-29c1-41cb-b825-03ee6974d926 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044509 Jul 11 11:35:11.323477 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 744/1490] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:11 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:35:11.327512 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-8d32c170-a235-4fc4-a63a-c347d572965c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:11.328750 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-a44610f4-9ce1-44c4-b445-348bf2dfbbc8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:11.329656 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-a44610f4-9ce1-44c4-b445-348bf2dfbbc8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:11.335838 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-8d32c170-a235-4fc4-a63a-c347d572965c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.149727 Jul 11 11:35:11.336074 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a44610f4-9ce1-44c4-b445-348bf2dfbbc8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:11.336402 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 747/1491] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:35:11 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:35:11.336579 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a44610f4-9ce1-44c4-b445-348bf2dfbbc8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:11.337178 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a44610f4-9ce1-44c4-b445-348bf2dfbbc8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:11.337608 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a44610f4-9ce1-44c4-b445-348bf2dfbbc8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:11.364411 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-dd9b7444-1dfa-4156-acd9-328b2f6bdb1a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:11.365008 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-dd9b7444-1dfa-4156-acd9-328b2f6bdb1a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:11.366103 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-a44610f4-9ce1-44c4-b445-348bf2dfbbc8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041641 Jul 11 11:35:11.366664 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 745/1492] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:11 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:35:11.370933 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-dd9b7444-1dfa-4156-acd9-328b2f6bdb1a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:11.371407 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-dd9b7444-1dfa-4156-acd9-328b2f6bdb1a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:11.372157 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-dd9b7444-1dfa-4156-acd9-328b2f6bdb1a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:11.372586 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-dd9b7444-1dfa-4156-acd9-328b2f6bdb1a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:11.497746 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-dd9b7444-1dfa-4156-acd9-328b2f6bdb1a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:11.506534 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-dd9b7444-1dfa-4156-acd9-328b2f6bdb1a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:11.508061 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-dd9b7444-1dfa-4156-acd9-328b2f6bdb1a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:11.509198 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-dd9b7444-1dfa-4156-acd9-328b2f6bdb1a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.148515 Jul 11 11:35:11.509779 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 748/1493] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:35:11 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 11:35:12.334151 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-a07f5c9e-0ac8-4fba-b355-cfa1a2e6c8b6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:12.334978 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-a07f5c9e-0ac8-4fba-b355-cfa1a2e6c8b6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:12.341445 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a07f5c9e-0ac8-4fba-b355-cfa1a2e6c8b6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:12.341885 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a07f5c9e-0ac8-4fba-b355-cfa1a2e6c8b6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:12.342630 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a07f5c9e-0ac8-4fba-b355-cfa1a2e6c8b6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:12.343057 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a07f5c9e-0ac8-4fba-b355-cfa1a2e6c8b6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:12.352672 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-7fd17c3b-e924-4aa3-966c-234800685b6a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:12.353281 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-7fd17c3b-e924-4aa3-966c-234800685b6a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:12.359821 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=100 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:35:12.360000 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7fd17c3b-e924-4aa3-966c-234800685b6a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:12.360270 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7fd17c3b-e924-4aa3-966c-234800685b6a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:12.361032 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7fd17c3b-e924-4aa3-966c-234800685b6a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:12.361466 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7fd17c3b-e924-4aa3-966c-234800685b6a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:12.372656 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-a07f5c9e-0ac8-4fba-b355-cfa1a2e6c8b6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042482 Jul 11 11:35:12.373213 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 746/1494] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:12 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:35:12.377938 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-9003b51e-7b99-4332-9ad0-69eefce4110c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:12.378857 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-9003b51e-7b99-4332-9ad0-69eefce4110c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:12.384550 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9003b51e-7b99-4332-9ad0-69eefce4110c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:12.384991 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9003b51e-7b99-4332-9ad0-69eefce4110c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:12.390503 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9003b51e-7b99-4332-9ad0-69eefce4110c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:12.390503 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9003b51e-7b99-4332-9ad0-69eefce4110c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:12.415219 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-9003b51e-7b99-4332-9ad0-69eefce4110c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040997 Jul 11 11:35:12.415803 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 747/1495] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:12 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:35:12.491003 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-7fd17c3b-e924-4aa3-966c-234800685b6a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:12.498830 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-7fd17c3b-e924-4aa3-966c-234800685b6a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.150043 Jul 11 11:35:12.499427 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 749/1496] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:35:12 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:35:12.527511 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-02b25a33-5f89-4d3a-9383-cf202a4be0b7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:12.528121 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-02b25a33-5f89-4d3a-9383-cf202a4be0b7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:12.534045 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-02b25a33-5f89-4d3a-9383-cf202a4be0b7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:12.534476 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-02b25a33-5f89-4d3a-9383-cf202a4be0b7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:12.535960 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-02b25a33-5f89-4d3a-9383-cf202a4be0b7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:12.536402 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-02b25a33-5f89-4d3a-9383-cf202a4be0b7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:12.668341 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-02b25a33-5f89-4d3a-9383-cf202a4be0b7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:12.677015 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-02b25a33-5f89-4d3a-9383-cf202a4be0b7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:12.678508 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-02b25a33-5f89-4d3a-9383-cf202a4be0b7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:12.679736 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-02b25a33-5f89-4d3a-9383-cf202a4be0b7 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.155867 Jul 11 11:35:12.680294 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 748/1497] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:35:12 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:35:13.383527 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-8014aad9-e098-4e3b-9ae0-eb828fccdf49 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:13.384366 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-8014aad9-e098-4e3b-9ae0-eb828fccdf49 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:13.390821 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8014aad9-e098-4e3b-9ae0-eb828fccdf49 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:13.391281 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8014aad9-e098-4e3b-9ae0-eb828fccdf49 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:13.392052 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8014aad9-e098-4e3b-9ae0-eb828fccdf49 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:13.392477 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8014aad9-e098-4e3b-9ae0-eb828fccdf49 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:13.422630 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-8014aad9-e098-4e3b-9ae0-eb828fccdf49 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043299 Jul 11 11:35:13.423192 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 750/1498] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:13 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:35:13.426361 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-ec3814e2-7ed6-46b6-a84d-5beec8730e82 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:13.427326 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-ec3814e2-7ed6-46b6-a84d-5beec8730e82 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:13.433787 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ec3814e2-7ed6-46b6-a84d-5beec8730e82 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:13.435490 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ec3814e2-7ed6-46b6-a84d-5beec8730e82 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:13.435490 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ec3814e2-7ed6-46b6-a84d-5beec8730e82 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:13.435490 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ec3814e2-7ed6-46b6-a84d-5beec8730e82 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:13.463906 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-ec3814e2-7ed6-46b6-a84d-5beec8730e82 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041772 Jul 11 11:35:13.464453 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 749/1499] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:13 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:35:13.516134 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-ba16b895-e147-4af2-a4df-88b0aa4ad687 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:13.516769 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-ba16b895-e147-4af2-a4df-88b0aa4ad687 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:13.522712 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ba16b895-e147-4af2-a4df-88b0aa4ad687 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:13.523152 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ba16b895-e147-4af2-a4df-88b0aa4ad687 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:13.523942 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ba16b895-e147-4af2-a4df-88b0aa4ad687 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:13.524370 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ba16b895-e147-4af2-a4df-88b0aa4ad687 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:13.652501 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-ba16b895-e147-4af2-a4df-88b0aa4ad687 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:13.660686 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-ba16b895-e147-4af2-a4df-88b0aa4ad687 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.148352 Jul 11 11:35:13.661248 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 751/1500] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:35:13 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:35:13.698438 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-d350b6d7-da9d-4a20-8e67-c00620aeac92 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:13.699042 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-d350b6d7-da9d-4a20-8e67-c00620aeac92 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:13.704968 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d350b6d7-da9d-4a20-8e67-c00620aeac92 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:13.705416 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d350b6d7-da9d-4a20-8e67-c00620aeac92 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:13.706171 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d350b6d7-da9d-4a20-8e67-c00620aeac92 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:13.706605 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d350b6d7-da9d-4a20-8e67-c00620aeac92 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:13.845483 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-d350b6d7-da9d-4a20-8e67-c00620aeac92 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:13.854727 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-d350b6d7-da9d-4a20-8e67-c00620aeac92 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:13.856252 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-d350b6d7-da9d-4a20-8e67-c00620aeac92 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:13.857403 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-d350b6d7-da9d-4a20-8e67-c00620aeac92 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.162827 Jul 11 11:35:13.857966 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 750/1501] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:35:13 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:35:14.434051 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-831553f7-4386-44e0-92b5-0b878e7fe1f4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:14.435008 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-831553f7-4386-44e0-92b5-0b878e7fe1f4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:14.442394 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-831553f7-4386-44e0-92b5-0b878e7fe1f4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:14.442845 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-831553f7-4386-44e0-92b5-0b878e7fe1f4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:14.443624 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-831553f7-4386-44e0-92b5-0b878e7fe1f4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:14.444061 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-831553f7-4386-44e0-92b5-0b878e7fe1f4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:14.471555 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-831553f7-4386-44e0-92b5-0b878e7fe1f4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041383 Jul 11 11:35:14.472139 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 752/1502] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:14 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:35:14.475610 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-7ffa2cb6-4b8d-4f08-a217-c455186f31c3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:14.476558 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-7ffa2cb6-4b8d-4f08-a217-c455186f31c3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:14.482967 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7ffa2cb6-4b8d-4f08-a217-c455186f31c3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:14.483460 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7ffa2cb6-4b8d-4f08-a217-c455186f31c3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:14.484211 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7ffa2cb6-4b8d-4f08-a217-c455186f31c3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:14.484644 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7ffa2cb6-4b8d-4f08-a217-c455186f31c3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:14.513345 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-7ffa2cb6-4b8d-4f08-a217-c455186f31c3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041781 Jul 11 11:35:14.513889 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 751/1503] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:14 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:35:14.680345 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-aa3e902e-777c-4ff7-9d99-8467b710141c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:14.680951 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-aa3e902e-777c-4ff7-9d99-8467b710141c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:14.686906 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-aa3e902e-777c-4ff7-9d99-8467b710141c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:14.687327 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-aa3e902e-777c-4ff7-9d99-8467b710141c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:14.688078 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-aa3e902e-777c-4ff7-9d99-8467b710141c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:14.688505 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-aa3e902e-777c-4ff7-9d99-8467b710141c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:14.813680 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-aa3e902e-777c-4ff7-9d99-8467b710141c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:14.822370 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-aa3e902e-777c-4ff7-9d99-8467b710141c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.148720 Jul 11 11:35:14.822940 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 753/1504] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:35:14 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:35:14.875691 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-f111413e-8fc9-4739-b93f-46f5cd2e3d6a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:14.876295 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-f111413e-8fc9-4739-b93f-46f5cd2e3d6a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:14.882741 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f111413e-8fc9-4739-b93f-46f5cd2e3d6a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:14.883186 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f111413e-8fc9-4739-b93f-46f5cd2e3d6a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:14.883968 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f111413e-8fc9-4739-b93f-46f5cd2e3d6a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:14.884393 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f111413e-8fc9-4739-b93f-46f5cd2e3d6a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:15.009428 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-f111413e-8fc9-4739-b93f-46f5cd2e3d6a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:15.017757 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-f111413e-8fc9-4739-b93f-46f5cd2e3d6a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:15.019810 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-f111413e-8fc9-4739-b93f-46f5cd2e3d6a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:15.020922 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-f111413e-8fc9-4739-b93f-46f5cd2e3d6a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.149138 Jul 11 11:35:15.021479 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 752/1505] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:35:14 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:35:15.482206 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-d7693d72-f9c5-4093-895c-a36849d01ebc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:15.483109 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-d7693d72-f9c5-4093-895c-a36849d01ebc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:15.489930 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d7693d72-f9c5-4093-895c-a36849d01ebc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:15.490377 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d7693d72-f9c5-4093-895c-a36849d01ebc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:15.491187 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d7693d72-f9c5-4093-895c-a36849d01ebc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:15.491642 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d7693d72-f9c5-4093-895c-a36849d01ebc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:15.520900 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-d7693d72-f9c5-4093-895c-a36849d01ebc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042819 Jul 11 11:35:15.521449 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 754/1506] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:15 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:35:15.525641 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-78ed738b-7d55-4620-b4b9-b60f0665906e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:15.526561 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-78ed738b-7d55-4620-b4b9-b60f0665906e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:15.532937 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-78ed738b-7d55-4620-b4b9-b60f0665906e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:15.533383 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-78ed738b-7d55-4620-b4b9-b60f0665906e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:15.534133 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-78ed738b-7d55-4620-b4b9-b60f0665906e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:15.534597 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-78ed738b-7d55-4620-b4b9-b60f0665906e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:15.563266 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-78ed738b-7d55-4620-b4b9-b60f0665906e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041632 Jul 11 11:35:15.563814 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 753/1507] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:15 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:35:15.839081 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-37e270e8-2f80-4b2c-905b-ae1c13ea96b9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:15.839642 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-37e270e8-2f80-4b2c-905b-ae1c13ea96b9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:15.845511 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-37e270e8-2f80-4b2c-905b-ae1c13ea96b9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:15.845952 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-37e270e8-2f80-4b2c-905b-ae1c13ea96b9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:15.846699 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-37e270e8-2f80-4b2c-905b-ae1c13ea96b9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:15.847128 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-37e270e8-2f80-4b2c-905b-ae1c13ea96b9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:16.039787 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-6bfb929a-4348-4c2c-864d-0282f512b981 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:16.040395 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-6bfb929a-4348-4c2c-864d-0282f512b981 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:16.046923 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6bfb929a-4348-4c2c-864d-0282f512b981 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:16.047410 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6bfb929a-4348-4c2c-864d-0282f512b981 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:16.048347 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6bfb929a-4348-4c2c-864d-0282f512b981 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:16.048786 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6bfb929a-4348-4c2c-864d-0282f512b981 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:16.181397 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-6bfb929a-4348-4c2c-864d-0282f512b981 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:16.182630 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-37e270e8-2f80-4b2c-905b-ae1c13ea96b9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:16.189828 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-6bfb929a-4348-4c2c-864d-0282f512b981 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:16.190469 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-37e270e8-2f80-4b2c-905b-ae1c13ea96b9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.355268 Jul 11 11:35:16.191064 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 755/1508] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:35:15 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:35:16.191380 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-6bfb929a-4348-4c2c-864d-0282f512b981 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:16.192936 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-6bfb929a-4348-4c2c-864d-0282f512b981 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.157126 Jul 11 11:35:16.193494 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 754/1509] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:35:16 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 11:35:16.531693 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-c438af2d-170e-417a-b206-c36bdaad4b09 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:16.532615 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-c438af2d-170e-417a-b206-c36bdaad4b09 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:16.539226 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c438af2d-170e-417a-b206-c36bdaad4b09 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:16.539502 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c438af2d-170e-417a-b206-c36bdaad4b09 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:16.540258 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c438af2d-170e-417a-b206-c36bdaad4b09 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:16.540685 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c438af2d-170e-417a-b206-c36bdaad4b09 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:16.570074 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-c438af2d-170e-417a-b206-c36bdaad4b09 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042341 Jul 11 11:35:16.570625 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 756/1510] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:16 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:35:16.575518 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-85df88f3-fa06-401c-9ddc-62671210c7e5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:16.576444 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-85df88f3-fa06-401c-9ddc-62671210c7e5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:16.582981 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-85df88f3-fa06-401c-9ddc-62671210c7e5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:16.583473 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-85df88f3-fa06-401c-9ddc-62671210c7e5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:16.584241 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-85df88f3-fa06-401c-9ddc-62671210c7e5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:16.584675 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-85df88f3-fa06-401c-9ddc-62671210c7e5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:16.612419 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-85df88f3-fa06-401c-9ddc-62671210c7e5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040986 Jul 11 11:35:16.613468 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 755/1511] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:16 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:35:17.208102 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-2b732143-0b2f-49dc-bb54-35a88de1f53c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:17.208703 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-2b732143-0b2f-49dc-bb54-35a88de1f53c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:17.211625 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-880cce45-ba1b-40bf-b783-873fe4157231 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:17.212558 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-880cce45-ba1b-40bf-b783-873fe4157231 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:17.215028 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2b732143-0b2f-49dc-bb54-35a88de1f53c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:17.215593 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2b732143-0b2f-49dc-bb54-35a88de1f53c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:17.216402 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2b732143-0b2f-49dc-bb54-35a88de1f53c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:17.216848 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2b732143-0b2f-49dc-bb54-35a88de1f53c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:17.218755 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-880cce45-ba1b-40bf-b783-873fe4157231 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:17.219209 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-880cce45-ba1b-40bf-b783-873fe4157231 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:17.220063 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-880cce45-ba1b-40bf-b783-873fe4157231 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:17.220506 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-880cce45-ba1b-40bf-b783-873fe4157231 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:17.346743 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-2b732143-0b2f-49dc-bb54-35a88de1f53c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:17.355014 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-2b732143-0b2f-49dc-bb54-35a88de1f53c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.151278 Jul 11 11:35:17.355751 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 757/1512] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:35:17 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:35:17.357931 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-880cce45-ba1b-40bf-b783-873fe4157231 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:17.367173 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-880cce45-ba1b-40bf-b783-873fe4157231 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:17.368697 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-880cce45-ba1b-40bf-b783-873fe4157231 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:17.369840 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-880cce45-ba1b-40bf-b783-873fe4157231 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.162995 Jul 11 11:35:17.370504 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 756/1513] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:35:17 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 11:35:17.581817 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-569de0f0-7c57-4618-bb5e-79c6d16d7e77 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:17.582829 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-569de0f0-7c57-4618-bb5e-79c6d16d7e77 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:17.589156 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-569de0f0-7c57-4618-bb5e-79c6d16d7e77 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:17.589622 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-569de0f0-7c57-4618-bb5e-79c6d16d7e77 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:17.590379 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-569de0f0-7c57-4618-bb5e-79c6d16d7e77 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:17.590846 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-569de0f0-7c57-4618-bb5e-79c6d16d7e77 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:17.619990 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-569de0f0-7c57-4618-bb5e-79c6d16d7e77 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042151 Jul 11 11:35:17.620749 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 758/1514] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:17 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:35:17.624471 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-8839fc22-c142-43b5-9d4b-94bf1525bc5c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:17.625505 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-8839fc22-c142-43b5-9d4b-94bf1525bc5c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:17.632006 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8839fc22-c142-43b5-9d4b-94bf1525bc5c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:17.632457 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8839fc22-c142-43b5-9d4b-94bf1525bc5c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:17.633250 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8839fc22-c142-43b5-9d4b-94bf1525bc5c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:17.633685 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8839fc22-c142-43b5-9d4b-94bf1525bc5c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:17.662727 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-8839fc22-c142-43b5-9d4b-94bf1525bc5c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042217 Jul 11 11:35:17.663297 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 757/1515] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:17 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:35:18.371512 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-0421a648-c5f4-4205-b796-bbdb3935cfa9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:18.372109 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-0421a648-c5f4-4205-b796-bbdb3935cfa9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:18.373974 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_api:SELECT=100 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:35:18.379068 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0421a648-c5f4-4205-b796-bbdb3935cfa9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:18.379556 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0421a648-c5f4-4205-b796-bbdb3935cfa9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:18.380315 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0421a648-c5f4-4205-b796-bbdb3935cfa9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:18.380749 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0421a648-c5f4-4205-b796-bbdb3935cfa9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:18.388213 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-e4791d3b-62a0-4a06-af70-c755a8a3d3e1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:18.388892 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-e4791d3b-62a0-4a06-af70-c755a8a3d3e1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:18.396477 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e4791d3b-62a0-4a06-af70-c755a8a3d3e1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:18.396987 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e4791d3b-62a0-4a06-af70-c755a8a3d3e1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:18.397769 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e4791d3b-62a0-4a06-af70-c755a8a3d3e1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:18.398206 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e4791d3b-62a0-4a06-af70-c755a8a3d3e1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:18.512565 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-0421a648-c5f4-4205-b796-bbdb3935cfa9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:18.521008 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-0421a648-c5f4-4205-b796-bbdb3935cfa9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.153349 Jul 11 11:35:18.521586 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 759/1516] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:35:18 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:35:18.524766 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-e4791d3b-62a0-4a06-af70-c755a8a3d3e1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:18.532988 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-e4791d3b-62a0-4a06-af70-c755a8a3d3e1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:18.534503 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-e4791d3b-62a0-4a06-af70-c755a8a3d3e1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:18.535657 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-e4791d3b-62a0-4a06-af70-c755a8a3d3e1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 200 len: 1746 microversion: 2.20 time: 0.151384 Jul 11 11:35:18.536195 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 758/1517] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:35:18 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 1746 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 11:35:18.605214 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-ee4e2e8c-8d4e-4a76-a7cb-3baf5f8fef0d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:18.605720 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-ee4e2e8c-8d4e-4a76-a7cb-3baf5f8fef0d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:18.612129 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ee4e2e8c-8d4e-4a76-a7cb-3baf5f8fef0d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:18.613657 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ee4e2e8c-8d4e-4a76-a7cb-3baf5f8fef0d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:18.613657 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ee4e2e8c-8d4e-4a76-a7cb-3baf5f8fef0d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:18.613926 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ee4e2e8c-8d4e-4a76-a7cb-3baf5f8fef0d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:18.632101 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-c420d4a4-b39b-465e-b997-fbb5fe41cad5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:18.633017 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-c420d4a4-b39b-465e-b997-fbb5fe41cad5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:18.639395 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c420d4a4-b39b-465e-b997-fbb5fe41cad5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:18.639838 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c420d4a4-b39b-465e-b997-fbb5fe41cad5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:18.640596 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c420d4a4-b39b-465e-b997-fbb5fe41cad5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:18.641027 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c420d4a4-b39b-465e-b997-fbb5fe41cad5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:18.671147 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-c420d4a4-b39b-465e-b997-fbb5fe41cad5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043502 Jul 11 11:35:18.671881 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 759/1518] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:18 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:35:18.677030 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-49667438-1693-4412-bfb0-db4b844a0e9e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:18.677937 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-49667438-1693-4412-bfb0-db4b844a0e9e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:18.683693 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-49667438-1693-4412-bfb0-db4b844a0e9e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:18.684147 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-49667438-1693-4412-bfb0-db4b844a0e9e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:18.684910 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-49667438-1693-4412-bfb0-db4b844a0e9e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:18.685340 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-49667438-1693-4412-bfb0-db4b844a0e9e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:18.715480 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-49667438-1693-4412-bfb0-db4b844a0e9e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042549 Jul 11 11:35:18.716216 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 760/1519] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:18 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:35:19.370105 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-ee4e2e8c-8d4e-4a76-a7cb-3baf5f8fef0d tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703/os-volume_attachments/2b87424a-e537-407d-bc04-6670abef009e" status: 202 len: 0 microversion: 2.20 time: 0.768814 Jul 11 11:35:19.370703 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 760/1520] 10.222.0.26 () {60 vars in 1456 bytes} [Mon Jul 11 11:35:18 2022] DELETE /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703/os-volume_attachments/2b87424a-e537-407d-bc04-6670abef009e => generated 0 bytes in 770 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 11 11:35:19.378907 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-234c0515-de77-47d5-ba11-31ea6e78099f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:19.379874 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-234c0515-de77-47d5-ba11-31ea6e78099f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:19.382749 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_api:SELECT=100 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:35:19.386092 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-234c0515-de77-47d5-ba11-31ea6e78099f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:19.387978 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-234c0515-de77-47d5-ba11-31ea6e78099f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:19.387978 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-234c0515-de77-47d5-ba11-31ea6e78099f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:19.387978 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-234c0515-de77-47d5-ba11-31ea6e78099f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:19.416004 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-234c0515-de77-47d5-ba11-31ea6e78099f tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041024 Jul 11 11:35:19.419744 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 761/1521] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 11 11:35:19 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:35:19.510509 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-04f7f28e-09fc-4e5c-9040-fc2f9a82e265 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:19.511012 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-04f7f28e-09fc-4e5c-9040-fc2f9a82e265 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:19.517044 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-04f7f28e-09fc-4e5c-9040-fc2f9a82e265 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:19.517501 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-04f7f28e-09fc-4e5c-9040-fc2f9a82e265 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:19.518255 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-04f7f28e-09fc-4e5c-9040-fc2f9a82e265 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:19.518691 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-04f7f28e-09fc-4e5c-9040-fc2f9a82e265 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:19.533942 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:35:19.538139 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-9adae35b-5acd-485d-a0b8-656596c9c625 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:19.538768 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-9adae35b-5acd-485d-a0b8-656596c9c625 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:19.544626 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-04f7f28e-09fc-4e5c-9040-fc2f9a82e265 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Going to try to terminate instance {{(pid=118322) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 11:35:19.545673 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9adae35b-5acd-485d-a0b8-656596c9c625 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:19.545673 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9adae35b-5acd-485d-a0b8-656596c9c625 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:19.546329 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9adae35b-5acd-485d-a0b8-656596c9c625 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:19.546755 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9adae35b-5acd-485d-a0b8-656596c9c625 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:19.550491 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.compute.api [None req-04f7f28e-09fc-4e5c-9040-fc2f9a82e265 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Working on deleting snapshot 57fd14d2-c528-4958-9534-7e6dcad0386f from shelved instance... Jul 11 11:35:19.676821 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-9adae35b-5acd-485d-a0b8-656596c9c625 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:19.684935 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-9adae35b-5acd-485d-a0b8-656596c9c625 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.151108 Jul 11 11:35:19.685501 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 762/1522] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:35:19 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:35:19.689977 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-cb06297f-73b8-4aca-b10f-346b81530d67 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:19.690872 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-cb06297f-73b8-4aca-b10f-346b81530d67 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:19.696743 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-cb06297f-73b8-4aca-b10f-346b81530d67 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:19.697181 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-cb06297f-73b8-4aca-b10f-346b81530d67 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:19.697925 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-cb06297f-73b8-4aca-b10f-346b81530d67 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:19.698352 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-cb06297f-73b8-4aca-b10f-346b81530d67 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:19.701863 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=100 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:35:19.727503 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-cb06297f-73b8-4aca-b10f-346b81530d67 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040968 Jul 11 11:35:19.728045 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 763/1523] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:19 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:35:19.732501 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-481cc943-411c-45e1-a650-1ce3a6e5c3e8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:19.733326 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-481cc943-411c-45e1-a650-1ce3a6e5c3e8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:19.739799 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-481cc943-411c-45e1-a650-1ce3a6e5c3e8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:19.740239 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-481cc943-411c-45e1-a650-1ce3a6e5c3e8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:19.741020 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-481cc943-411c-45e1-a650-1ce3a6e5c3e8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:19.741448 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-481cc943-411c-45e1-a650-1ce3a6e5c3e8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:19.769722 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-481cc943-411c-45e1-a650-1ce3a6e5c3e8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040670 Jul 11 11:35:19.770265 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 764/1524] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:19 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:35:20.701945 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-f46afab5-2ade-460e-bf20-0e28d5ce232f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:20.702587 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-f46afab5-2ade-460e-bf20-0e28d5ce232f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:20.709076 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f46afab5-2ade-460e-bf20-0e28d5ce232f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:20.709519 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f46afab5-2ade-460e-bf20-0e28d5ce232f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:20.710275 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f46afab5-2ade-460e-bf20-0e28d5ce232f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:20.710706 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f46afab5-2ade-460e-bf20-0e28d5ce232f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:20.836045 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-f46afab5-2ade-460e-bf20-0e28d5ce232f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:20.843877 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-f46afab5-2ade-460e-bf20-0e28d5ce232f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.145799 Jul 11 11:35:20.844442 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 765/1525] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:35:20 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:35:20.849038 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-75f378f9-8522-4717-8fdb-d920a3c1f3c9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:20.849956 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-75f378f9-8522-4717-8fdb-d920a3c1f3c9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:20.854276 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-04f7f28e-09fc-4e5c-9040-fc2f9a82e265 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Doing local delete in cell 342f6239-eef4-41fd-9223-51ec0b89b6f5(cell1) {{(pid=118322) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jul 11 11:35:20.855084 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-04f7f28e-09fc-4e5c-9040-fc2f9a82e265 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:20.855549 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-04f7f28e-09fc-4e5c-9040-fc2f9a82e265 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:20.855657 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-75f378f9-8522-4717-8fdb-d920a3c1f3c9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:20.859027 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.compute.api [None req-04f7f28e-09fc-4e5c-9040-fc2f9a82e265 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Jul 11 11:35:20.859157 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-75f378f9-8522-4717-8fdb-d920a3c1f3c9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:20.859157 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-75f378f9-8522-4717-8fdb-d920a3c1f3c9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:20.859157 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-75f378f9-8522-4717-8fdb-d920a3c1f3c9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:20.862822 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.network.neutron [None req-04f7f28e-09fc-4e5c-9040-fc2f9a82e265 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] deallocate_for_instance() {{(pid=118322) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 11 11:35:20.886857 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-75f378f9-8522-4717-8fdb-d920a3c1f3c9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041386 Jul 11 11:35:20.887439 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 766/1526] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:20 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:35:20.891851 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-9b449261-747b-4f64-b579-f7df72ee9721 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:20.892742 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-9b449261-747b-4f64-b579-f7df72ee9721 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:20.899011 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9b449261-747b-4f64-b579-f7df72ee9721 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:20.905044 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9b449261-747b-4f64-b579-f7df72ee9721 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:20.905044 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9b449261-747b-4f64-b579-f7df72ee9721 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:20.905044 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9b449261-747b-4f64-b579-f7df72ee9721 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:20.934386 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-9b449261-747b-4f64-b579-f7df72ee9721 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045915 Jul 11 11:35:20.934949 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 767/1527] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:20 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:35:21.884695 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.network.neutron [None req-04f7f28e-09fc-4e5c-9040-fc2f9a82e265 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Updating instance_info_cache with network_info: [] {{(pid=118322) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 11 11:35:21.912463 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [req-f8358bcb-b121-4a11-8f6f-422ee13dfd10 req-a15cd6ae-8e58-4cb4-bba1-3f976b86b73f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b0ec960-6583-4639-9658-a850655eb703", "name": "network-vif-deleted", "tag": "fb396fac-9f6d-4448-a468-adea47f3003f"}]} {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:35:21.920424 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [req-f8358bcb-b121-4a11-8f6f-422ee13dfd10 req-a15cd6ae-8e58-4cb4-bba1-3f976b86b73f service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:21.920867 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [req-f8358bcb-b121-4a11-8f6f-422ee13dfd10 req-a15cd6ae-8e58-4cb4-bba1-3f976b86b73f service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:21.932415 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.compute.server_external_events [req-f8358bcb-b121-4a11-8f6f-422ee13dfd10 req-a15cd6ae-8e58-4cb4-bba1-3f976b86b73f service nova] Unable to find a host for instance 4b0ec960-6583-4639-9658-a850655eb703. Dropping event network-vif-deleted {{(pid=118321) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 11 11:35:21.933289 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [req-f8358bcb-b121-4a11-8f6f-422ee13dfd10 req-a15cd6ae-8e58-4cb4-bba1-3f976b86b73f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.116884 Jul 11 11:35:21.933867 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 768/1528] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 11:35:21 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 118 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 11 11:35:21.939951 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-255140db-86cd-4c5d-8ee0-b3736c655717 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:21.940652 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-255140db-86cd-4c5d-8ee0-b3736c655717 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:21.947575 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-255140db-86cd-4c5d-8ee0-b3736c655717 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:21.948020 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-255140db-86cd-4c5d-8ee0-b3736c655717 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:21.958153 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-255140db-86cd-4c5d-8ee0-b3736c655717 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:21.958153 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-255140db-86cd-4c5d-8ee0-b3736c655717 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:22.102207 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-255140db-86cd-4c5d-8ee0-b3736c655717 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:22.111374 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-255140db-86cd-4c5d-8ee0-b3736c655717 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.175017 Jul 11 11:35:22.121241 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 769/1529] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:35:21 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:35:22.121241 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-bfe002b1-73fd-40d0-a154-a8caf60fcec9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:22.121241 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-bfe002b1-73fd-40d0-a154-a8caf60fcec9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:22.124030 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bfe002b1-73fd-40d0-a154-a8caf60fcec9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:22.124474 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bfe002b1-73fd-40d0-a154-a8caf60fcec9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:22.125229 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bfe002b1-73fd-40d0-a154-a8caf60fcec9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:22.125658 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bfe002b1-73fd-40d0-a154-a8caf60fcec9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:22.159335 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-bfe002b1-73fd-40d0-a154-a8caf60fcec9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046313 Jul 11 11:35:22.160552 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 770/1530] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:22 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:35:22.165108 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-030a5d25-f0c4-4ab3-a3e5-bac9d3708828 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:22.166025 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-030a5d25-f0c4-4ab3-a3e5-bac9d3708828 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:22.172383 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-030a5d25-f0c4-4ab3-a3e5-bac9d3708828 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:22.172838 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-030a5d25-f0c4-4ab3-a3e5-bac9d3708828 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:22.173616 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-030a5d25-f0c4-4ab3-a3e5-bac9d3708828 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:22.174052 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-030a5d25-f0c4-4ab3-a3e5-bac9d3708828 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:22.204958 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-030a5d25-f0c4-4ab3-a3e5-bac9d3708828 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043235 Jul 11 11:35:22.205539 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 771/1531] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:22 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:35:22.436073 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.scheduler.client.report [None req-04f7f28e-09fc-4e5c-9040-fc2f9a82e265 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Deleted allocations for instance 4b0ec960-6583-4639-9658-a850655eb703 Jul 11 11:35:22.815665 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-04f7f28e-09fc-4e5c-9040-fc2f9a82e265 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 204 len: 0 microversion: 2.20 time: 3.308838 Jul 11 11:35:22.816805 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 761/1532] 10.222.0.26 () {60 vars in 1279 bytes} [Mon Jul 11 11:35:19 2022] DELETE /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 0 bytes in 3311 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 11 11:35:22.825059 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-b43659df-e6c9-47eb-a569-3925fee5de40 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:22.825662 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-b43659df-e6c9-47eb-a569-3925fee5de40 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:22.832273 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b43659df-e6c9-47eb-a569-3925fee5de40 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:22.832718 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b43659df-e6c9-47eb-a569-3925fee5de40 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:22.833462 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b43659df-e6c9-47eb-a569-3925fee5de40 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:22.833887 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b43659df-e6c9-47eb-a569-3925fee5de40 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:22.847679 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.wsgi [None req-b43659df-e6c9-47eb-a569-3925fee5de40 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] HTTP exception thrown: Instance 4b0ec960-6583-4639-9658-a850655eb703 could not be found. Jul 11 11:35:22.849375 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-b43659df-e6c9-47eb-a569-3925fee5de40 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Request method failure captured: Jul 11 11:35:22.849375 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: request: GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 HTTP/1.1 Jul 11 11:35:22.849375 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Accept: application/json Jul 11 11:35:22.849375 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Accept-Encoding: identity Jul 11 11:35:22.849375 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Connection: close Jul 11 11:35:22.849375 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Content-Length: 0 Jul 11 11:35:22.849375 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Content-Type: application/json Jul 11 11:35:22.849375 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Host: 10.222.0.26 Jul 11 11:35:22.849375 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Openstack-System-Scope: None Jul 11 11:35:22.849375 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: User-Agent: python-urllib3/1.26.9 Jul 11 11:35:22.849375 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Auth-Token: gAAAAABizAjGbyj9-EYsdAofFu2CzO2d59ZW9ABUBAbQnLYnllzeEOzy491jQ4HEpM89bbrLUMplN6mcP6HQ3B1WwP6JVkBcg1zkYwnoXWYRasZ-vSNiHWKxPN1ixhfjDreb4HCRJcBhMJ-WtmjdLoAnivFahEDeMkVzqUGoMBW-7rS50fYCH-4 Jul 11 11:35:22.849375 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Domain-Id: None Jul 11 11:35:22.849375 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Domain-Name: None Jul 11 11:35:22.849375 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Identity-Status: Confirmed Jul 11 11:35:22.849375 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Is-Admin-Project: True Jul 11 11:35:22.849375 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Openstack-Nova-Api-Version: 2.20 Jul 11 11:35:22.849375 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Domain-Id: default Jul 11 11:35:22.849375 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Domain-Name: Default Jul 11 11:35:22.849375 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Id: 876864a8f283481a81ee65a1c97d0f4f Jul 11 11:35:22.849375 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-30953492 Jul 11 11:35:22.849375 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Role: member,reader Jul 11 11:35:22.849375 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Roles: member,reader Jul 11 11:35:22.851207 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_876864a8f283481a81ee65a1c97d0f4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/876864a8f283481a81ee65a1c97d0f4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/876864a8f283481a81ee65a1c97d0f4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/876864a8f283481a81ee65a1c97d0f4f"}]}] Jul 11 11:35:22.851207 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Tenant: tempest-AttachVolumeShelveTestJSON-30953492 Jul 11 11:35:22.851207 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Tenant-Id: 876864a8f283481a81ee65a1c97d0f4f Jul 11 11:35:22.851207 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-30953492 Jul 11 11:35:22.851207 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User: tempest-AttachVolumeShelveTestJSON-30953492-project Jul 11 11:35:22.851207 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Domain-Id: default Jul 11 11:35:22.851207 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Domain-Name: Default Jul 11 11:35:22.851207 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Id: 993a59e8746948ab8a0f11d877314e02 Jul 11 11:35:22.851207 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Name: tempest-AttachVolumeShelveTestJSON-30953492-project Jul 11 11:35:22.851207 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: method: > Jul 11 11:35:22.851207 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: exception: Instance 4b0ec960-6583-4639-9658-a850655eb703 could not be found. Jul 11 11:35:22.851207 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: action_args: {'id': '4b0ec960-6583-4639-9658-a850655eb703'} Jul 11 11:35:22.852338 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 11:35:22.852338 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:35:22.852338 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 11:35:22.852338 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 11:35:22.852338 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 11:35:22.852338 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 11:35:22.852338 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 11:35:22.852338 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 11:35:22.852338 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 11:35:22.852338 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 11:35:22.852338 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b0ec960-6583-4639-9658-a850655eb703 could not be found. Jul 11 11:35:22.852338 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:35:22.852338 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:35:22.852338 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:35:22.852338 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:35:22.852338 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:35:22.852338 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:35:22.852338 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 11:35:22.852338 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 11:35:22.852338 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 11:35:22.853965 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 11:35:22.853965 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 11:35:22.853965 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 11:35:22.853965 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 11:35:22.853965 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 11:35:22.853965 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 11:35:22.853965 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 11:35:22.853965 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b0ec960-6583-4639-9658-a850655eb703 could not be found. Jul 11 11:35:22.853965 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:35:22.853965 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:35:22.853965 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:35:22.853965 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:35:22.853965 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:35:22.853965 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:35:22.853965 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 11:35:22.853965 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 11:35:22.853965 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b0ec960-6583-4639-9658-a850655eb703 could not be found. Jul 11 11:35:22.853965 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:35:22.860537 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-b43659df-e6c9-47eb-a569-3925fee5de40 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Returning 404 to user: Instance 4b0ec960-6583-4639-9658-a850655eb703 could not be found. {{(pid=118321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 11:35:22.860537 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-b43659df-e6c9-47eb-a569-3925fee5de40 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 404 len: 111 microversion: 2.20 time: 0.029549 Jul 11 11:35:22.860537 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 772/1533] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:35:22 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 11 11:35:22.866173 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-e3fcdb61-3c96-413f-b929-55c3a2baa119 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '.version_select at 0x7fb010331ca0>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:22.954947 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-e3fcdb61-3c96-413f-b929-55c3a2baa119 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1662356650" status: 204 len: 0 microversion: 2.20 time: 0.092926 Jul 11 11:35:22.955576 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 762/1534] 10.222.0.26 () {60 vars in 1261 bytes} [Mon Jul 11 11:35:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1662356650 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 11 11:35:23.129570 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-a967d349-c5b4-4e15-86ec-36b67b4a7c1c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:23.130208 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-a967d349-c5b4-4e15-86ec-36b67b4a7c1c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:23.136759 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a967d349-c5b4-4e15-86ec-36b67b4a7c1c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:23.137213 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a967d349-c5b4-4e15-86ec-36b67b4a7c1c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:23.138002 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a967d349-c5b4-4e15-86ec-36b67b4a7c1c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:23.138434 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a967d349-c5b4-4e15-86ec-36b67b4a7c1c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:23.171673 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-e37a3102-9480-48a3-a0cb-7b14fe814d01 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:23.172950 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-e37a3102-9480-48a3-a0cb-7b14fe814d01 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:23.190864 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e37a3102-9480-48a3-a0cb-7b14fe814d01 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:23.192166 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e37a3102-9480-48a3-a0cb-7b14fe814d01 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:23.193275 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e37a3102-9480-48a3-a0cb-7b14fe814d01 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:23.193925 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e37a3102-9480-48a3-a0cb-7b14fe814d01 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:23.240029 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-e37a3102-9480-48a3-a0cb-7b14fe814d01 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072448 Jul 11 11:35:23.240598 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 763/1535] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:23 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:35:23.246118 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-9e1d0e07-7309-4e7a-b9c0-36916ccfe88c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:23.247022 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-9e1d0e07-7309-4e7a-b9c0-36916ccfe88c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:23.254957 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9e1d0e07-7309-4e7a-b9c0-36916ccfe88c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:23.255445 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9e1d0e07-7309-4e7a-b9c0-36916ccfe88c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:23.256216 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9e1d0e07-7309-4e7a-b9c0-36916ccfe88c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:23.256647 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9e1d0e07-7309-4e7a-b9c0-36916ccfe88c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:23.286526 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-9e1d0e07-7309-4e7a-b9c0-36916ccfe88c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044582 Jul 11 11:35:23.287184 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 764/1536] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:23 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:35:23.294325 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-a967d349-c5b4-4e15-86ec-36b67b4a7c1c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:23.302831 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-a967d349-c5b4-4e15-86ec-36b67b4a7c1c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.177590 Jul 11 11:35:23.303584 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 773/1537] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:35:23 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:35:23.815722 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-dd3d2410-20ea-498a-809f-a6d3becfbf7a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Action: 'create', calling method: .version_select at 0x7fb01048f4c0>, body: {"keypair": {"name": "tempest-keypair-534619890", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN6KVR1qciGtcgDokuNzzvJiCPnIK7UXwNnz2pBO3wmOm5nYoHNcYV23JAAAVGIZxaBKgdk3BiTuLA9IYxdKvQiUz3wkL9hZ/EOZbq7aVhcBUwz6QtDXsdnnSQiM0I256g=="}} {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:35:23.829933 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.quota [None req-dd3d2410-20ea-498a-809f-a6d3becfbf7a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Getting quotas for project 876864a8f283481a81ee65a1c97d0f4f. Resources: {'key_pairs'} {{(pid=118322) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 11:35:23.833655 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.quota [None req-dd3d2410-20ea-498a-809f-a6d3becfbf7a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Getting quotas for user 993a59e8746948ab8a0f11d877314e02 and project 876864a8f283481a81ee65a1c97d0f4f. Resources: {'key_pairs'} {{(pid=118322) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 11:35:23.920261 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-dd3d2410-20ea-498a-809f-a6d3becfbf7a tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.108325 Jul 11 11:35:23.920895 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 765/1538] 10.222.0.26 () {62 vars in 1199 bytes} [Mon Jul 11 11:35:23 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 110 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 11 11:35:24.251237 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-f595d1b3-656c-49f0-944a-f94449f7721a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:24.252182 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-f595d1b3-656c-49f0-944a-f94449f7721a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:24.259194 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f595d1b3-656c-49f0-944a-f94449f7721a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:24.259676 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f595d1b3-656c-49f0-944a-f94449f7721a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:24.260435 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f595d1b3-656c-49f0-944a-f94449f7721a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:24.260869 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f595d1b3-656c-49f0-944a-f94449f7721a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:24.290154 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-f595d1b3-656c-49f0-944a-f94449f7721a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042873 Jul 11 11:35:24.290689 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 774/1539] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:24 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:35:24.299494 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-f3965f6e-1d7e-4aa3-aad9-96376f8150e4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:24.299494 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-f3965f6e-1d7e-4aa3-aad9-96376f8150e4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:24.306006 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f3965f6e-1d7e-4aa3-aad9-96376f8150e4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:24.306454 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f3965f6e-1d7e-4aa3-aad9-96376f8150e4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:24.307217 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f3965f6e-1d7e-4aa3-aad9-96376f8150e4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:24.307681 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f3965f6e-1d7e-4aa3-aad9-96376f8150e4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:24.320339 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-f996ca30-da4f-419e-a7de-c8caa1c1a1f6 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:24.321160 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-f996ca30-da4f-419e-a7de-c8caa1c1a1f6 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:24.327537 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f996ca30-da4f-419e-a7de-c8caa1c1a1f6 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:24.328113 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f996ca30-da4f-419e-a7de-c8caa1c1a1f6 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:24.328964 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f996ca30-da4f-419e-a7de-c8caa1c1a1f6 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:24.329397 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f996ca30-da4f-419e-a7de-c8caa1c1a1f6 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:24.339799 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-f3965f6e-1d7e-4aa3-aad9-96376f8150e4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045941 Jul 11 11:35:24.340363 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 766/1540] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:24 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:35:24.491616 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-f996ca30-da4f-419e-a7de-c8caa1c1a1f6 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:24.499568 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-f996ca30-da4f-419e-a7de-c8caa1c1a1f6 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.183753 Jul 11 11:35:24.500137 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 775/1541] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:35:24 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:35:25.302480 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-a0875485-31e5-45db-bb4b-3f08f8007f85 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:25.303460 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-a0875485-31e5-45db-bb4b-3f08f8007f85 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:25.310380 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a0875485-31e5-45db-bb4b-3f08f8007f85 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:25.310917 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a0875485-31e5-45db-bb4b-3f08f8007f85 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:25.311730 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a0875485-31e5-45db-bb4b-3f08f8007f85 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:25.312159 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a0875485-31e5-45db-bb4b-3f08f8007f85 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:25.344193 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-a0875485-31e5-45db-bb4b-3f08f8007f85 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046323 Jul 11 11:35:25.344785 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 767/1542] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:25 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:35:25.352148 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-e0b621e9-0a60-49b9-8a9c-4d5559a28c1f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:25.353085 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-e0b621e9-0a60-49b9-8a9c-4d5559a28c1f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:25.359806 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e0b621e9-0a60-49b9-8a9c-4d5559a28c1f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:25.360258 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e0b621e9-0a60-49b9-8a9c-4d5559a28c1f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:25.361033 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e0b621e9-0a60-49b9-8a9c-4d5559a28c1f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:25.361465 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e0b621e9-0a60-49b9-8a9c-4d5559a28c1f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:25.392520 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-e0b621e9-0a60-49b9-8a9c-4d5559a28c1f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044837 Jul 11 11:35:25.393109 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 776/1543] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:25 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:35:25.517069 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-9eeb2de4-1f9a-406f-8e0c-e464795fc6b7 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:25.517969 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-9eeb2de4-1f9a-406f-8e0c-e464795fc6b7 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:25.524864 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9eeb2de4-1f9a-406f-8e0c-e464795fc6b7 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:25.525306 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9eeb2de4-1f9a-406f-8e0c-e464795fc6b7 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:25.526065 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9eeb2de4-1f9a-406f-8e0c-e464795fc6b7 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:25.526493 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9eeb2de4-1f9a-406f-8e0c-e464795fc6b7 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:25.661337 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-9eeb2de4-1f9a-406f-8e0c-e464795fc6b7 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:25.669298 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-9eeb2de4-1f9a-406f-8e0c-e464795fc6b7 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.156107 Jul 11 11:35:25.669861 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 768/1544] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:35:25 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:35:26.356788 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-dbfa837e-8ad5-4c1e-b264-1c040ca2fc14 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:26.357913 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-dbfa837e-8ad5-4c1e-b264-1c040ca2fc14 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:26.365619 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-dbfa837e-8ad5-4c1e-b264-1c040ca2fc14 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:26.366150 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-dbfa837e-8ad5-4c1e-b264-1c040ca2fc14 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:26.366980 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-dbfa837e-8ad5-4c1e-b264-1c040ca2fc14 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:26.367531 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-dbfa837e-8ad5-4c1e-b264-1c040ca2fc14 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:26.404671 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-01f500d6-c263-4c99-953a-52ef0536df14 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:26.405489 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-01f500d6-c263-4c99-953a-52ef0536df14 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:26.411225 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-dbfa837e-8ad5-4c1e-b264-1c040ca2fc14 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058555 Jul 11 11:35:26.414784 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 777/1545] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:26 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:35:26.415558 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-01f500d6-c263-4c99-953a-52ef0536df14 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:26.416115 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-01f500d6-c263-4c99-953a-52ef0536df14 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:26.416952 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-01f500d6-c263-4c99-953a-52ef0536df14 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:26.417336 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-01f500d6-c263-4c99-953a-52ef0536df14 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:26.432988 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-099a8f72-8972-41b9-b338-2046db08d8c6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1031425667", "imageRef": "1bb93fc1-b713-4e67-8f76-bfec3a96168b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a66f67a8-9e25-4936-aefa-ad7234de04a8"}], "security_groups": [{"name": "tempest-securitygroup--1277662155"}], "key_name": "tempest-keypair-534619890", "user_data": "}} {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:35:26.452863 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-01f500d6-c263-4c99-953a-52ef0536df14 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052437 Jul 11 11:35:26.453643 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 769/1546] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:26 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:35:26.535854 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.network.neutron [None req-099a8f72-8972-41b9-b338-2046db08d8c6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] validate_networks() for [('a66f67a8-9e25-4936-aefa-ad7234de04a8', None, None, None, None, None)] {{(pid=118321) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 11:35:26.686242 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-f1547c13-3f93-4feb-b11d-5d790df30970 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:26.686771 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-f1547c13-3f93-4feb-b11d-5d790df30970 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:26.693013 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f1547c13-3f93-4feb-b11d-5d790df30970 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:26.693454 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f1547c13-3f93-4feb-b11d-5d790df30970 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:26.694208 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f1547c13-3f93-4feb-b11d-5d790df30970 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:26.694638 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f1547c13-3f93-4feb-b11d-5d790df30970 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:26.826499 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-f1547c13-3f93-4feb-b11d-5d790df30970 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:26.835536 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-f1547c13-3f93-4feb-b11d-5d790df30970 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.153225 Jul 11 11:35:26.836275 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 770/1547] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:35:26 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:35:26.962037 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.virt.hardware [None req-099a8f72-8972-41b9-b338-2046db08d8c6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Flavor limits 0:0:0 {{(pid=118321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 11:35:26.962458 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.virt.hardware [None req-099a8f72-8972-41b9-b338-2046db08d8c6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Image limits 0:0:0 {{(pid=118321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 11:35:26.962931 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.virt.hardware [None req-099a8f72-8972-41b9-b338-2046db08d8c6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Flavor pref 0:0:0 {{(pid=118321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 11:35:26.963362 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.virt.hardware [None req-099a8f72-8972-41b9-b338-2046db08d8c6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Image pref 0:0:0 {{(pid=118321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 11:35:26.963772 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.virt.hardware [None req-099a8f72-8972-41b9-b338-2046db08d8c6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 11:35:26.972565 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-099a8f72-8972-41b9-b338-2046db08d8c6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:26.973010 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-099a8f72-8972-41b9-b338-2046db08d8c6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:26.973801 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-099a8f72-8972-41b9-b338-2046db08d8c6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:26.974234 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-099a8f72-8972-41b9-b338-2046db08d8c6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:26.991819 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.quota [None req-099a8f72-8972-41b9-b338-2046db08d8c6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Getting quotas for project 876864a8f283481a81ee65a1c97d0f4f. Resources: {'cores', 'ram', 'instances'} {{(pid=118321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 11:35:26.995735 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.quota [None req-099a8f72-8972-41b9-b338-2046db08d8c6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Getting quotas for user 993a59e8746948ab8a0f11d877314e02 and project 876864a8f283481a81ee65a1c97d0f4f. Resources: {'cores', 'ram', 'instances'} {{(pid=118321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 11:35:27.007082 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-099a8f72-8972-41b9-b338-2046db08d8c6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Going to run 1 instances... {{(pid=118321) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 11:35:27.009334 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-099a8f72-8972-41b9-b338-2046db08d8c6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: f4031167-4227-4699-bbcf-d0bec5e3ca8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb93fc1-b713-4e67-8f76-bfec3a96168b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118321) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 11:35:27.156074 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-099a8f72-8972-41b9-b338-2046db08d8c6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.727511 Jul 11 11:35:27.156715 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 778/1548] 10.222.0.26 () {62 vars in 1187 bytes} [Mon Jul 11 11:35:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 729 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 11 11:35:27.166689 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-d82b028a-639c-49b9-ae13-1fbe87910add tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:27.167435 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-d82b028a-639c-49b9-ae13-1fbe87910add tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: f4031167-4227-4699-bbcf-d0bec5e3ca8b] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:27.226658 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-d82b028a-639c-49b9-ae13-1fbe87910add tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:27.233776 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-d82b028a-639c-49b9-ae13-1fbe87910add tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:27.235327 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-d82b028a-639c-49b9-ae13-1fbe87910add tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:27.236423 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-d82b028a-639c-49b9-ae13-1fbe87910add tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/f4031167-4227-4699-bbcf-d0bec5e3ca8b" status: 200 len: 1281 microversion: 2.20 time: 0.073744 Jul 11 11:35:27.236981 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 771/1549] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:35:27 2022] GET /compute/v2.1/servers/f4031167-4227-4699-bbcf-d0bec5e3ca8b => generated 1281 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:35:27.426586 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-3015a9fa-0cf8-48ee-b463-896f1979202b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:27.427585 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-3015a9fa-0cf8-48ee-b463-896f1979202b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:27.433870 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3015a9fa-0cf8-48ee-b463-896f1979202b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:27.434334 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3015a9fa-0cf8-48ee-b463-896f1979202b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:27.435203 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3015a9fa-0cf8-48ee-b463-896f1979202b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:27.435669 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3015a9fa-0cf8-48ee-b463-896f1979202b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:27.464469 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-3015a9fa-0cf8-48ee-b463-896f1979202b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042862 Jul 11 11:35:27.464641 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-75e48cdf-db16-4713-875c-8de2dce34f8e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:27.465240 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 779/1550] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:27 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:35:27.465391 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-75e48cdf-db16-4713-875c-8de2dce34f8e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:27.473238 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-75e48cdf-db16-4713-875c-8de2dce34f8e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:27.473691 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-75e48cdf-db16-4713-875c-8de2dce34f8e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:27.474458 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-75e48cdf-db16-4713-875c-8de2dce34f8e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:27.474899 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-75e48cdf-db16-4713-875c-8de2dce34f8e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:27.503993 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-75e48cdf-db16-4713-875c-8de2dce34f8e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043520 Jul 11 11:35:27.504554 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 772/1551] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:27 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:35:27.852680 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-0ab4315b-0eb4-4a19-b163-ddb885779ccc tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:27.853287 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-0ab4315b-0eb4-4a19-b163-ddb885779ccc tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:27.859246 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0ab4315b-0eb4-4a19-b163-ddb885779ccc tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:27.859720 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0ab4315b-0eb4-4a19-b163-ddb885779ccc tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:27.860538 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0ab4315b-0eb4-4a19-b163-ddb885779ccc tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:27.860972 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0ab4315b-0eb4-4a19-b163-ddb885779ccc tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:27.989144 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-0ab4315b-0eb4-4a19-b163-ddb885779ccc tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:27.997867 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-0ab4315b-0eb4-4a19-b163-ddb885779ccc tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.149051 Jul 11 11:35:27.998383 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 780/1552] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:35:27 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:35:28.255115 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-aa19a362-9759-4ee7-8e2e-3626f36d22d0 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:28.255780 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-aa19a362-9759-4ee7-8e2e-3626f36d22d0 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: f4031167-4227-4699-bbcf-d0bec5e3ca8b] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:28.261741 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-aa19a362-9759-4ee7-8e2e-3626f36d22d0 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:28.262185 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-aa19a362-9759-4ee7-8e2e-3626f36d22d0 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:28.262945 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-aa19a362-9759-4ee7-8e2e-3626f36d22d0 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:28.263469 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-aa19a362-9759-4ee7-8e2e-3626f36d22d0 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:28.330123 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-aa19a362-9759-4ee7-8e2e-3626f36d22d0 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:28.339423 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-aa19a362-9759-4ee7-8e2e-3626f36d22d0 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:28.349339 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-aa19a362-9759-4ee7-8e2e-3626f36d22d0 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:28.350570 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-aa19a362-9759-4ee7-8e2e-3626f36d22d0 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/f4031167-4227-4699-bbcf-d0bec5e3ca8b" status: 200 len: 1285 microversion: 2.20 time: 0.099920 Jul 11 11:35:28.351142 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 773/1553] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:35:28 2022] GET /compute/v2.1/servers/f4031167-4227-4699-bbcf-d0bec5e3ca8b => generated 1285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:35:28.476016 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-5df3d982-b271-43c3-9ac5-005c8cc018db tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:28.476986 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-5df3d982-b271-43c3-9ac5-005c8cc018db tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:28.483698 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5df3d982-b271-43c3-9ac5-005c8cc018db tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:28.484144 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5df3d982-b271-43c3-9ac5-005c8cc018db tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:28.484896 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5df3d982-b271-43c3-9ac5-005c8cc018db tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:28.485322 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5df3d982-b271-43c3-9ac5-005c8cc018db tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:28.511535 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=100 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:35:28.515516 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-504ecf4a-c017-49c0-9be4-5b5e8290774f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:28.516905 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-5df3d982-b271-43c3-9ac5-005c8cc018db tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044907 Jul 11 11:35:28.518180 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-504ecf4a-c017-49c0-9be4-5b5e8290774f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:28.518302 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 781/1554] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:28 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:35:28.524250 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-504ecf4a-c017-49c0-9be4-5b5e8290774f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:28.524704 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-504ecf4a-c017-49c0-9be4-5b5e8290774f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:28.525513 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-504ecf4a-c017-49c0-9be4-5b5e8290774f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:28.526148 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-504ecf4a-c017-49c0-9be4-5b5e8290774f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:28.552016 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:35:28.557584 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-504ecf4a-c017-49c0-9be4-5b5e8290774f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046309 Jul 11 11:35:28.558151 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 774/1555] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:28 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:35:29.020959 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-9e1bdb40-29b4-4e13-a2d1-aaf87a3c79a7 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:29.021569 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-9e1bdb40-29b4-4e13-a2d1-aaf87a3c79a7 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:29.027779 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9e1bdb40-29b4-4e13-a2d1-aaf87a3c79a7 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:29.028230 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9e1bdb40-29b4-4e13-a2d1-aaf87a3c79a7 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:29.028987 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9e1bdb40-29b4-4e13-a2d1-aaf87a3c79a7 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:29.029417 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9e1bdb40-29b4-4e13-a2d1-aaf87a3c79a7 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:29.160478 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-9e1bdb40-29b4-4e13-a2d1-aaf87a3c79a7 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:29.168844 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-9e1bdb40-29b4-4e13-a2d1-aaf87a3c79a7 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.152037 Jul 11 11:35:29.169414 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 782/1556] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:35:29 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:35:29.369437 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-a72222cc-f63d-4489-b4be-ade946884860 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:29.370048 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-a72222cc-f63d-4489-b4be-ade946884860 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: f4031167-4227-4699-bbcf-d0bec5e3ca8b] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:29.376999 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a72222cc-f63d-4489-b4be-ade946884860 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:29.377833 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a72222cc-f63d-4489-b4be-ade946884860 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:29.378861 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a72222cc-f63d-4489-b4be-ade946884860 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:29.379569 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a72222cc-f63d-4489-b4be-ade946884860 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:29.448796 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-a72222cc-f63d-4489-b4be-ade946884860 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:29.456841 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-a72222cc-f63d-4489-b4be-ade946884860 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:29.458902 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-a72222cc-f63d-4489-b4be-ade946884860 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:29.460052 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-a72222cc-f63d-4489-b4be-ade946884860 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/f4031167-4227-4699-bbcf-d0bec5e3ca8b" status: 200 len: 1341 microversion: 2.20 time: 0.094520 Jul 11 11:35:29.460615 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 775/1557] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:35:29 2022] GET /compute/v2.1/servers/f4031167-4227-4699-bbcf-d0bec5e3ca8b => generated 1341 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:35:29.529277 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-34c0e741-186e-414c-bcc5-0b3922d58b75 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:29.530202 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-34c0e741-186e-414c-bcc5-0b3922d58b75 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:29.536706 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-34c0e741-186e-414c-bcc5-0b3922d58b75 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:29.537157 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-34c0e741-186e-414c-bcc5-0b3922d58b75 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:29.537926 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-34c0e741-186e-414c-bcc5-0b3922d58b75 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:29.538362 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-34c0e741-186e-414c-bcc5-0b3922d58b75 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:29.567963 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-34c0e741-186e-414c-bcc5-0b3922d58b75 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041894 Jul 11 11:35:29.568724 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 783/1558] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:29 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:35:29.570884 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-4dadbf87-e3ff-4ca7-b8a9-ba9712ca344b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:29.572487 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-4dadbf87-e3ff-4ca7-b8a9-ba9712ca344b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:29.579840 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4dadbf87-e3ff-4ca7-b8a9-ba9712ca344b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:29.580294 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4dadbf87-e3ff-4ca7-b8a9-ba9712ca344b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:29.581092 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4dadbf87-e3ff-4ca7-b8a9-ba9712ca344b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:29.581573 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4dadbf87-e3ff-4ca7-b8a9-ba9712ca344b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:29.610876 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-4dadbf87-e3ff-4ca7-b8a9-ba9712ca344b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045388 Jul 11 11:35:29.611388 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 776/1559] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:29 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:35:30.186447 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-7484df31-109d-4100-890c-aa7e299559d8 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:30.187003 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-7484df31-109d-4100-890c-aa7e299559d8 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:30.194069 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7484df31-109d-4100-890c-aa7e299559d8 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:30.194512 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7484df31-109d-4100-890c-aa7e299559d8 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:30.195284 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7484df31-109d-4100-890c-aa7e299559d8 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:30.195818 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7484df31-109d-4100-890c-aa7e299559d8 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:30.405192 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-7484df31-109d-4100-890c-aa7e299559d8 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:30.414123 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-7484df31-109d-4100-890c-aa7e299559d8 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.231909 Jul 11 11:35:30.415164 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 784/1560] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:35:30 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:35:30.478607 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-eb0ac707-1d1e-4991-be21-de67b19bb1b6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:30.479534 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-eb0ac707-1d1e-4991-be21-de67b19bb1b6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: f4031167-4227-4699-bbcf-d0bec5e3ca8b] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:30.490169 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-eb0ac707-1d1e-4991-be21-de67b19bb1b6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:30.490169 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-eb0ac707-1d1e-4991-be21-de67b19bb1b6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:30.490169 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-eb0ac707-1d1e-4991-be21-de67b19bb1b6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:30.490169 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-eb0ac707-1d1e-4991-be21-de67b19bb1b6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:30.579407 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-8dc13763-8212-4c57-8dcd-306c85dbccaf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:30.580689 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-8dc13763-8212-4c57-8dcd-306c85dbccaf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:30.587346 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8dc13763-8212-4c57-8dcd-306c85dbccaf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:30.588012 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8dc13763-8212-4c57-8dcd-306c85dbccaf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:30.588958 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8dc13763-8212-4c57-8dcd-306c85dbccaf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:30.589402 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8dc13763-8212-4c57-8dcd-306c85dbccaf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:30.623197 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-8dc13763-8212-4c57-8dcd-306c85dbccaf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047451 Jul 11 11:35:30.623941 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 785/1561] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:30 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:35:30.628779 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-26e506ca-0248-4b3a-b690-5538af84701d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:30.629522 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-eb0ac707-1d1e-4991-be21-de67b19bb1b6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:30.644250 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-26e506ca-0248-4b3a-b690-5538af84701d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:30.644250 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-26e506ca-0248-4b3a-b690-5538af84701d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:30.644250 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-26e506ca-0248-4b3a-b690-5538af84701d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:30.644250 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-26e506ca-0248-4b3a-b690-5538af84701d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:30.644799 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-26e506ca-0248-4b3a-b690-5538af84701d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:30.645436 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-eb0ac707-1d1e-4991-be21-de67b19bb1b6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:30.645436 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-eb0ac707-1d1e-4991-be21-de67b19bb1b6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:30.645436 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-eb0ac707-1d1e-4991-be21-de67b19bb1b6 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/f4031167-4227-4699-bbcf-d0bec5e3ca8b" status: 200 len: 1407 microversion: 2.20 time: 0.166529 Jul 11 11:35:30.651655 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 777/1562] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:35:30 2022] GET /compute/v2.1/servers/f4031167-4227-4699-bbcf-d0bec5e3ca8b => generated 1407 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:35:30.670468 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-26e506ca-0248-4b3a-b690-5538af84701d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045256 Jul 11 11:35:30.671031 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 786/1563] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:30 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:35:31.099967 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [req-1868b8ca-fc7a-49ba-8a43-22a0ed5fa09d req-3e9e23e6-34e9-4a96-b664-4642a680518d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4031167-4227-4699-bbcf-d0bec5e3ca8b", "tag": "0bd9eb21-bcac-4a52-8d10-e7d23735f707"}]} {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:35:31.109234 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [req-1868b8ca-fc7a-49ba-8a43-22a0ed5fa09d req-3e9e23e6-34e9-4a96-b664-4642a680518d service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:31.109742 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [req-1868b8ca-fc7a-49ba-8a43-22a0ed5fa09d req-3e9e23e6-34e9-4a96-b664-4642a680518d service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:31.124130 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.compute.server_external_events [req-1868b8ca-fc7a-49ba-8a43-22a0ed5fa09d req-3e9e23e6-34e9-4a96-b664-4642a680518d service nova] Creating event network-changed:0bd9eb21-bcac-4a52-8d10-e7d23735f707 for instance f4031167-4227-4699-bbcf-d0bec5e3ca8b on hv-cinder-84842 Jul 11 11:35:31.130838 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [req-1868b8ca-fc7a-49ba-8a43-22a0ed5fa09d req-3e9e23e6-34e9-4a96-b664-4642a680518d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117316 Jul 11 11:35:31.131484 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 778/1564] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 11:35:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:35:31.432050 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-dbcb7d1c-c5d8-4b6a-83cc-03d3b131509d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:31.432686 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-dbcb7d1c-c5d8-4b6a-83cc-03d3b131509d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:31.438756 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-dbcb7d1c-c5d8-4b6a-83cc-03d3b131509d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:31.439204 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-dbcb7d1c-c5d8-4b6a-83cc-03d3b131509d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:31.440014 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-dbcb7d1c-c5d8-4b6a-83cc-03d3b131509d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:31.440445 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-dbcb7d1c-c5d8-4b6a-83cc-03d3b131509d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:31.584782 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-dbcb7d1c-c5d8-4b6a-83cc-03d3b131509d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:31.593261 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-dbcb7d1c-c5d8-4b6a-83cc-03d3b131509d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.165047 Jul 11 11:35:31.593833 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 787/1565] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:35:31 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:35:31.635779 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-f9c59b43-7c5a-484b-9910-be80cba75687 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:31.636806 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-f9c59b43-7c5a-484b-9910-be80cba75687 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:31.643498 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f9c59b43-7c5a-484b-9910-be80cba75687 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:31.643937 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f9c59b43-7c5a-484b-9910-be80cba75687 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:31.644689 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f9c59b43-7c5a-484b-9910-be80cba75687 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:31.645121 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f9c59b43-7c5a-484b-9910-be80cba75687 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:31.660219 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-538bef2d-195c-40e9-a7c7-5a1174b406db tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:31.660857 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-538bef2d-195c-40e9-a7c7-5a1174b406db tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: f4031167-4227-4699-bbcf-d0bec5e3ca8b] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:31.666719 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-538bef2d-195c-40e9-a7c7-5a1174b406db tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:31.667174 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-538bef2d-195c-40e9-a7c7-5a1174b406db tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:31.667980 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-538bef2d-195c-40e9-a7c7-5a1174b406db tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:31.668420 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-538bef2d-195c-40e9-a7c7-5a1174b406db tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:31.674671 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-f9c59b43-7c5a-484b-9910-be80cba75687 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043380 Jul 11 11:35:31.679759 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 779/1566] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:31 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:35:31.684020 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-93c9c007-e1ce-44e8-83a9-89fe1b7841da tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:31.685498 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-93c9c007-e1ce-44e8-83a9-89fe1b7841da tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:31.691873 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-93c9c007-e1ce-44e8-83a9-89fe1b7841da tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:31.693077 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-93c9c007-e1ce-44e8-83a9-89fe1b7841da tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:31.693867 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-93c9c007-e1ce-44e8-83a9-89fe1b7841da tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:31.694301 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-93c9c007-e1ce-44e8-83a9-89fe1b7841da tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:31.723155 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-93c9c007-e1ce-44e8-83a9-89fe1b7841da tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044400 Jul 11 11:35:31.723770 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 780/1567] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:31 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:35:31.802318 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-538bef2d-195c-40e9-a7c7-5a1174b406db tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:31.810266 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-538bef2d-195c-40e9-a7c7-5a1174b406db tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:31.811812 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-538bef2d-195c-40e9-a7c7-5a1174b406db tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:31.812946 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-538bef2d-195c-40e9-a7c7-5a1174b406db tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/f4031167-4227-4699-bbcf-d0bec5e3ca8b" status: 200 len: 1407 microversion: 2.20 time: 0.157023 Jul 11 11:35:31.813538 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 788/1568] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:35:31 2022] GET /compute/v2.1/servers/f4031167-4227-4699-bbcf-d0bec5e3ca8b => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 11:35:32.609813 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-3ded0519-7cb4-425f-a515-509e9fb54663 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:32.610421 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-3ded0519-7cb4-425f-a515-509e9fb54663 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:32.616608 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3ded0519-7cb4-425f-a515-509e9fb54663 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:32.617053 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3ded0519-7cb4-425f-a515-509e9fb54663 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:32.617819 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3ded0519-7cb4-425f-a515-509e9fb54663 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:32.618253 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3ded0519-7cb4-425f-a515-509e9fb54663 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:32.686665 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-b1ff85d9-bc0c-4de2-9f6d-5d28a18c5173 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:32.687619 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-b1ff85d9-bc0c-4de2-9f6d-5d28a18c5173 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:32.695202 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b1ff85d9-bc0c-4de2-9f6d-5d28a18c5173 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:32.695698 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b1ff85d9-bc0c-4de2-9f6d-5d28a18c5173 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:32.696462 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b1ff85d9-bc0c-4de2-9f6d-5d28a18c5173 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:32.697222 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b1ff85d9-bc0c-4de2-9f6d-5d28a18c5173 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:32.729380 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-b1ff85d9-bc0c-4de2-9f6d-5d28a18c5173 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045367 Jul 11 11:35:32.729380 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 789/1569] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:32 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:35:32.737311 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-8cecb6d5-be6d-41bf-8813-5669bd7b0e4a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:32.738357 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-8cecb6d5-be6d-41bf-8813-5669bd7b0e4a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:32.744452 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8cecb6d5-be6d-41bf-8813-5669bd7b0e4a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:32.745018 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8cecb6d5-be6d-41bf-8813-5669bd7b0e4a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:32.745888 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8cecb6d5-be6d-41bf-8813-5669bd7b0e4a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:32.746434 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8cecb6d5-be6d-41bf-8813-5669bd7b0e4a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:32.755416 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-3ded0519-7cb4-425f-a515-509e9fb54663 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:32.764694 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-3ded0519-7cb4-425f-a515-509e9fb54663 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.158721 Jul 11 11:35:32.765281 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 781/1570] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:35:32 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:35:32.777404 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-8cecb6d5-be6d-41bf-8813-5669bd7b0e4a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043789 Jul 11 11:35:32.778073 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 790/1571] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:32 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:35:32.831188 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-6a675d40-6039-46e1-95fc-8828cca1f7ca tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:32.831782 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-6a675d40-6039-46e1-95fc-8828cca1f7ca tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: f4031167-4227-4699-bbcf-d0bec5e3ca8b] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:32.838510 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6a675d40-6039-46e1-95fc-8828cca1f7ca tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:32.838964 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6a675d40-6039-46e1-95fc-8828cca1f7ca tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:32.839766 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6a675d40-6039-46e1-95fc-8828cca1f7ca tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:32.840206 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6a675d40-6039-46e1-95fc-8828cca1f7ca tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:32.970502 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-6a675d40-6039-46e1-95fc-8828cca1f7ca tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:32.978969 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-6a675d40-6039-46e1-95fc-8828cca1f7ca tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:32.980679 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-6a675d40-6039-46e1-95fc-8828cca1f7ca tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:32.981865 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-6a675d40-6039-46e1-95fc-8828cca1f7ca tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/f4031167-4227-4699-bbcf-d0bec5e3ca8b" status: 200 len: 1407 microversion: 2.20 time: 0.154562 Jul 11 11:35:32.982505 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 782/1572] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:35:32 2022] GET /compute/v2.1/servers/f4031167-4227-4699-bbcf-d0bec5e3ca8b => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:35:33.740066 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-eb726fdb-e90e-4062-9e0d-acac683727fc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:33.740995 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-eb726fdb-e90e-4062-9e0d-acac683727fc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:33.747518 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-eb726fdb-e90e-4062-9e0d-acac683727fc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:33.747968 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-eb726fdb-e90e-4062-9e0d-acac683727fc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:33.748740 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-eb726fdb-e90e-4062-9e0d-acac683727fc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:33.749173 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-eb726fdb-e90e-4062-9e0d-acac683727fc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:33.778094 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-eb726fdb-e90e-4062-9e0d-acac683727fc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041905 Jul 11 11:35:33.778679 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 791/1573] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:33 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:35:33.782097 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-96573a52-8f45-443d-8511-cc8b4d7e037a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:33.782730 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-96573a52-8f45-443d-8511-cc8b4d7e037a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:33.789417 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-aeac6a57-345a-46a8-9d2a-92de64d4d86c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:33.790154 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-96573a52-8f45-443d-8511-cc8b4d7e037a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:33.790330 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-aeac6a57-345a-46a8-9d2a-92de64d4d86c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:33.790614 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-96573a52-8f45-443d-8511-cc8b4d7e037a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:33.791415 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-96573a52-8f45-443d-8511-cc8b4d7e037a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:33.791854 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-96573a52-8f45-443d-8511-cc8b4d7e037a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:33.796253 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-aeac6a57-345a-46a8-9d2a-92de64d4d86c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:33.796691 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-aeac6a57-345a-46a8-9d2a-92de64d4d86c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:33.797454 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-aeac6a57-345a-46a8-9d2a-92de64d4d86c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:33.797894 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-aeac6a57-345a-46a8-9d2a-92de64d4d86c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:33.826691 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-aeac6a57-345a-46a8-9d2a-92de64d4d86c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041369 Jul 11 11:35:33.827285 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 792/1574] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:33 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:35:33.917245 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-96573a52-8f45-443d-8511-cc8b4d7e037a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:33.925225 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-96573a52-8f45-443d-8511-cc8b4d7e037a tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.146953 Jul 11 11:35:33.925793 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 783/1575] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:35:33 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:35:34.000011 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-ea039f48-396f-4159-8c30-461c50f08a0b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:34.000622 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-ea039f48-396f-4159-8c30-461c50f08a0b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: f4031167-4227-4699-bbcf-d0bec5e3ca8b] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:34.007131 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ea039f48-396f-4159-8c30-461c50f08a0b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:34.007608 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ea039f48-396f-4159-8c30-461c50f08a0b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:34.008366 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ea039f48-396f-4159-8c30-461c50f08a0b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:34.008804 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ea039f48-396f-4159-8c30-461c50f08a0b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:34.152193 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-ea039f48-396f-4159-8c30-461c50f08a0b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:34.160551 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-ea039f48-396f-4159-8c30-461c50f08a0b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:34.162198 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-ea039f48-396f-4159-8c30-461c50f08a0b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:34.163323 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-ea039f48-396f-4159-8c30-461c50f08a0b tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/f4031167-4227-4699-bbcf-d0bec5e3ca8b" status: 200 len: 1407 microversion: 2.20 time: 0.167198 Jul 11 11:35:34.163916 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 793/1576] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:35:33 2022] GET /compute/v2.1/servers/f4031167-4227-4699-bbcf-d0bec5e3ca8b => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:35:34.790118 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-e7069a38-6327-4be5-878e-aed36b2b72e7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:34.791105 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-e7069a38-6327-4be5-878e-aed36b2b72e7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:34.797629 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e7069a38-6327-4be5-878e-aed36b2b72e7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:34.798079 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e7069a38-6327-4be5-878e-aed36b2b72e7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:34.798840 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e7069a38-6327-4be5-878e-aed36b2b72e7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:34.799299 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e7069a38-6327-4be5-878e-aed36b2b72e7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:34.827917 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-e7069a38-6327-4be5-878e-aed36b2b72e7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042310 Jul 11 11:35:34.828472 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 784/1577] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:34 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:35:34.837838 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-965633fb-233f-46f1-a8e8-80bad6665bad tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:34.838781 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-965633fb-233f-46f1-a8e8-80bad6665bad tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:34.845187 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-965633fb-233f-46f1-a8e8-80bad6665bad tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:34.845633 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-965633fb-233f-46f1-a8e8-80bad6665bad tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:34.846386 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-965633fb-233f-46f1-a8e8-80bad6665bad tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:34.846821 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-965633fb-233f-46f1-a8e8-80bad6665bad tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:34.876255 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-965633fb-233f-46f1-a8e8-80bad6665bad tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042288 Jul 11 11:35:34.876811 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 794/1578] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:34 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:35:34.942148 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-55a6f721-31e8-47d0-86c9-eb4652d4204d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:34.943570 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-55a6f721-31e8-47d0-86c9-eb4652d4204d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:34.949795 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-55a6f721-31e8-47d0-86c9-eb4652d4204d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:34.950245 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-55a6f721-31e8-47d0-86c9-eb4652d4204d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:34.951016 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-55a6f721-31e8-47d0-86c9-eb4652d4204d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:34.951484 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-55a6f721-31e8-47d0-86c9-eb4652d4204d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:35.088184 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-55a6f721-31e8-47d0-86c9-eb4652d4204d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:35.096070 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-55a6f721-31e8-47d0-86c9-eb4652d4204d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.158080 Jul 11 11:35:35.096640 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 785/1579] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:35:34 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:35:35.182118 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-bc740837-efd7-4a0c-8367-0b11ef49b3e9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:35.182798 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-bc740837-efd7-4a0c-8367-0b11ef49b3e9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: f4031167-4227-4699-bbcf-d0bec5e3ca8b] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:35.189524 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bc740837-efd7-4a0c-8367-0b11ef49b3e9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:35.189969 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bc740837-efd7-4a0c-8367-0b11ef49b3e9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:35.190730 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bc740837-efd7-4a0c-8367-0b11ef49b3e9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:35.191189 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bc740837-efd7-4a0c-8367-0b11ef49b3e9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:35.331271 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-bc740837-efd7-4a0c-8367-0b11ef49b3e9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:35.339179 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-bc740837-efd7-4a0c-8367-0b11ef49b3e9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:35.340702 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-bc740837-efd7-4a0c-8367-0b11ef49b3e9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:35.341798 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-bc740837-efd7-4a0c-8367-0b11ef49b3e9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/f4031167-4227-4699-bbcf-d0bec5e3ca8b" status: 200 len: 1407 microversion: 2.20 time: 0.164347 Jul 11 11:35:35.342357 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 795/1580] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:35:35 2022] GET /compute/v2.1/servers/f4031167-4227-4699-bbcf-d0bec5e3ca8b => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:35:35.839370 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-af15ff67-e593-4a03-a5b1-7b8759851582 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:35.840268 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-af15ff67-e593-4a03-a5b1-7b8759851582 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:35.846761 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-af15ff67-e593-4a03-a5b1-7b8759851582 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:35.847213 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-af15ff67-e593-4a03-a5b1-7b8759851582 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:35.848012 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-af15ff67-e593-4a03-a5b1-7b8759851582 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:35.848457 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-af15ff67-e593-4a03-a5b1-7b8759851582 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:35.877436 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-af15ff67-e593-4a03-a5b1-7b8759851582 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042159 Jul 11 11:35:35.878009 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 786/1581] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:35 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:35:35.887560 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-0f129e9b-cf72-443c-aa03-68a64947ddd5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:35.888473 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-0f129e9b-cf72-443c-aa03-68a64947ddd5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:35.894887 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0f129e9b-cf72-443c-aa03-68a64947ddd5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:35.895373 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0f129e9b-cf72-443c-aa03-68a64947ddd5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:35.896610 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0f129e9b-cf72-443c-aa03-68a64947ddd5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:35.897042 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0f129e9b-cf72-443c-aa03-68a64947ddd5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:35.925605 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-0f129e9b-cf72-443c-aa03-68a64947ddd5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041943 Jul 11 11:35:35.926151 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 796/1582] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:35 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:35:36.113115 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-03afb485-1221-4140-84fa-7fc5a286dcee tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:36.113692 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-03afb485-1221-4140-84fa-7fc5a286dcee tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:36.119699 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-03afb485-1221-4140-84fa-7fc5a286dcee tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:36.120156 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-03afb485-1221-4140-84fa-7fc5a286dcee tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:36.120920 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-03afb485-1221-4140-84fa-7fc5a286dcee tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:36.121358 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-03afb485-1221-4140-84fa-7fc5a286dcee tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:36.246287 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-03afb485-1221-4140-84fa-7fc5a286dcee tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:36.254105 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-03afb485-1221-4140-84fa-7fc5a286dcee tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.144905 Jul 11 11:35:36.254667 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 787/1583] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:35:36 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:35:36.359640 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-71eed10b-b456-4e4d-9bd2-9c417b255cd4 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:36.360267 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-71eed10b-b456-4e4d-9bd2-9c417b255cd4 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: f4031167-4227-4699-bbcf-d0bec5e3ca8b] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:36.367532 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-71eed10b-b456-4e4d-9bd2-9c417b255cd4 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:36.367915 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-71eed10b-b456-4e4d-9bd2-9c417b255cd4 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:36.368776 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-71eed10b-b456-4e4d-9bd2-9c417b255cd4 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:36.369210 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-71eed10b-b456-4e4d-9bd2-9c417b255cd4 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:36.500290 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-71eed10b-b456-4e4d-9bd2-9c417b255cd4 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:36.508526 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-71eed10b-b456-4e4d-9bd2-9c417b255cd4 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:36.510007 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-71eed10b-b456-4e4d-9bd2-9c417b255cd4 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:36.511081 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-71eed10b-b456-4e4d-9bd2-9c417b255cd4 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/f4031167-4227-4699-bbcf-d0bec5e3ca8b" status: 200 len: 1407 microversion: 2.20 time: 0.155378 Jul 11 11:35:36.511672 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 797/1584] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:35:36 2022] GET /compute/v2.1/servers/f4031167-4227-4699-bbcf-d0bec5e3ca8b => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:35:36.888967 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-c3487481-7541-4baa-8257-33a674a0aee8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:36.889903 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-c3487481-7541-4baa-8257-33a674a0aee8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:36.896550 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c3487481-7541-4baa-8257-33a674a0aee8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:36.897003 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c3487481-7541-4baa-8257-33a674a0aee8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:36.897765 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c3487481-7541-4baa-8257-33a674a0aee8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:36.898203 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c3487481-7541-4baa-8257-33a674a0aee8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:36.926533 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-c3487481-7541-4baa-8257-33a674a0aee8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041476 Jul 11 11:35:36.927878 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 788/1585] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:36 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:35:36.937057 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-76328cb2-c55c-4866-b77f-ea91dca0eb77 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:36.937983 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-76328cb2-c55c-4866-b77f-ea91dca0eb77 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:36.945441 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-76328cb2-c55c-4866-b77f-ea91dca0eb77 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:36.945892 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-76328cb2-c55c-4866-b77f-ea91dca0eb77 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:36.946648 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-76328cb2-c55c-4866-b77f-ea91dca0eb77 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:36.947086 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-76328cb2-c55c-4866-b77f-ea91dca0eb77 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:36.963753 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=100 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:35:36.976625 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-76328cb2-c55c-4866-b77f-ea91dca0eb77 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043436 Jul 11 11:35:36.977204 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 798/1586] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:36 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:35:37.190015 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [req-b746e7ac-ee0a-4b49-8835-18827ee9e5e8 req-46863e1b-40d5-4faf-a3dd-c20e7b253ac4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4031167-4227-4699-bbcf-d0bec5e3ca8b", "name": "network-vif-plugged", "status": "completed", "tag": "0bd9eb21-bcac-4a52-8d10-e7d23735f707"}]} {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:35:37.199124 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [req-b746e7ac-ee0a-4b49-8835-18827ee9e5e8 req-46863e1b-40d5-4faf-a3dd-c20e7b253ac4 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:37.199769 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [req-b746e7ac-ee0a-4b49-8835-18827ee9e5e8 req-46863e1b-40d5-4faf-a3dd-c20e7b253ac4 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:37.212034 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.compute.server_external_events [req-b746e7ac-ee0a-4b49-8835-18827ee9e5e8 req-46863e1b-40d5-4faf-a3dd-c20e7b253ac4 service nova] Creating event network-vif-plugged:0bd9eb21-bcac-4a52-8d10-e7d23735f707 for instance f4031167-4227-4699-bbcf-d0bec5e3ca8b on hv-cinder-84842 Jul 11 11:35:37.218181 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [req-b746e7ac-ee0a-4b49-8835-18827ee9e5e8 req-46863e1b-40d5-4faf-a3dd-c20e7b253ac4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084691 Jul 11 11:35:37.218840 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 789/1587] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 11:35:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:35:37.270315 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-fb79bb79-be6e-4687-a99a-9a8adb24ee55 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:37.271082 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-fb79bb79-be6e-4687-a99a-9a8adb24ee55 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:37.273928 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell0:SELECT=2 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:35:37.274696 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell0:SELECT=6 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:35:37.280116 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fb79bb79-be6e-4687-a99a-9a8adb24ee55 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:37.280507 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fb79bb79-be6e-4687-a99a-9a8adb24ee55 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:37.281302 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fb79bb79-be6e-4687-a99a-9a8adb24ee55 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:37.281789 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fb79bb79-be6e-4687-a99a-9a8adb24ee55 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:37.418373 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-fb79bb79-be6e-4687-a99a-9a8adb24ee55 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:37.426352 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-fb79bb79-be6e-4687-a99a-9a8adb24ee55 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.159874 Jul 11 11:35:37.426921 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 799/1588] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:35:37 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:35:37.530325 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-59e7f8e7-52f2-46a0-b93b-ac38b3ece66c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:37.530948 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-59e7f8e7-52f2-46a0-b93b-ac38b3ece66c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: f4031167-4227-4699-bbcf-d0bec5e3ca8b] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:37.534021 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell0:SELECT=6 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:35:37.537878 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-59e7f8e7-52f2-46a0-b93b-ac38b3ece66c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:37.538302 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-59e7f8e7-52f2-46a0-b93b-ac38b3ece66c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:37.539061 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-59e7f8e7-52f2-46a0-b93b-ac38b3ece66c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:37.539529 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-59e7f8e7-52f2-46a0-b93b-ac38b3ece66c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:37.673773 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-59e7f8e7-52f2-46a0-b93b-ac38b3ece66c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:37.682204 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-59e7f8e7-52f2-46a0-b93b-ac38b3ece66c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:37.689006 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-59e7f8e7-52f2-46a0-b93b-ac38b3ece66c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:37.689006 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-59e7f8e7-52f2-46a0-b93b-ac38b3ece66c tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/f4031167-4227-4699-bbcf-d0bec5e3ca8b" status: 200 len: 1407 microversion: 2.20 time: 0.158848 Jul 11 11:35:37.689006 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 790/1589] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:35:37 2022] GET /compute/v2.1/servers/f4031167-4227-4699-bbcf-d0bec5e3ca8b => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:35:37.938333 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-74998c1d-4d21-4675-b2d6-4ed4ef5fc371 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:37.939274 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-74998c1d-4d21-4675-b2d6-4ed4ef5fc371 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:37.946033 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-74998c1d-4d21-4675-b2d6-4ed4ef5fc371 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:37.946513 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-74998c1d-4d21-4675-b2d6-4ed4ef5fc371 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:37.947238 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-74998c1d-4d21-4675-b2d6-4ed4ef5fc371 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:37.947694 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-74998c1d-4d21-4675-b2d6-4ed4ef5fc371 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:37.977547 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-74998c1d-4d21-4675-b2d6-4ed4ef5fc371 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043129 Jul 11 11:35:37.978093 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 800/1590] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:37 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:35:37.987954 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-432aaa1c-e84f-4239-ace7-308061f0819b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:37.988866 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-432aaa1c-e84f-4239-ace7-308061f0819b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:37.996765 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-432aaa1c-e84f-4239-ace7-308061f0819b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:37.997214 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-432aaa1c-e84f-4239-ace7-308061f0819b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:37.998021 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-432aaa1c-e84f-4239-ace7-308061f0819b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:37.998451 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-432aaa1c-e84f-4239-ace7-308061f0819b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:38.027107 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-432aaa1c-e84f-4239-ace7-308061f0819b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042939 Jul 11 11:35:38.027697 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 791/1591] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:37 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:35:38.443925 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-11b1eb73-3c4c-450a-bef3-e92e68788672 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:38.444525 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-11b1eb73-3c4c-450a-bef3-e92e68788672 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:38.450370 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-11b1eb73-3c4c-450a-bef3-e92e68788672 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:38.450814 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-11b1eb73-3c4c-450a-bef3-e92e68788672 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:38.451602 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-11b1eb73-3c4c-450a-bef3-e92e68788672 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:38.452035 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-11b1eb73-3c4c-450a-bef3-e92e68788672 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:38.577248 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-11b1eb73-3c4c-450a-bef3-e92e68788672 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:38.585607 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-11b1eb73-3c4c-450a-bef3-e92e68788672 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.145728 Jul 11 11:35:38.586203 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 801/1592] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:35:38 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:35:38.703719 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-c923cc17-33cd-4246-b4de-c6289388f2e1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:38.704265 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-c923cc17-33cd-4246-b4de-c6289388f2e1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: f4031167-4227-4699-bbcf-d0bec5e3ca8b] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:38.710913 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c923cc17-33cd-4246-b4de-c6289388f2e1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:38.711392 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c923cc17-33cd-4246-b4de-c6289388f2e1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:38.712155 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c923cc17-33cd-4246-b4de-c6289388f2e1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:38.712593 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c923cc17-33cd-4246-b4de-c6289388f2e1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:38.842589 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-c923cc17-33cd-4246-b4de-c6289388f2e1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:38.844774 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=100 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:35:38.851088 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-c923cc17-33cd-4246-b4de-c6289388f2e1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:38.852630 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-c923cc17-33cd-4246-b4de-c6289388f2e1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:38.853740 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-c923cc17-33cd-4246-b4de-c6289388f2e1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/f4031167-4227-4699-bbcf-d0bec5e3ca8b" status: 200 len: 1407 microversion: 2.20 time: 0.154024 Jul 11 11:35:38.854492 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 792/1593] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:35:38 2022] GET /compute/v2.1/servers/f4031167-4227-4699-bbcf-d0bec5e3ca8b => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:35:38.989163 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-99e3803a-5800-4dc4-854d-1c4886fe4b34 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:38.990512 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-99e3803a-5800-4dc4-854d-1c4886fe4b34 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:38.997508 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-99e3803a-5800-4dc4-854d-1c4886fe4b34 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:38.997961 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-99e3803a-5800-4dc4-854d-1c4886fe4b34 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:38.998741 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-99e3803a-5800-4dc4-854d-1c4886fe4b34 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:38.999182 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-99e3803a-5800-4dc4-854d-1c4886fe4b34 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:39.028812 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-99e3803a-5800-4dc4-854d-1c4886fe4b34 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043696 Jul 11 11:35:39.029364 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 802/1594] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:38 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:35:39.039046 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-80c35ccc-59f8-4cfd-9e72-75cca30a930b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:39.040015 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-80c35ccc-59f8-4cfd-9e72-75cca30a930b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:39.049990 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-80c35ccc-59f8-4cfd-9e72-75cca30a930b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:39.050454 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-80c35ccc-59f8-4cfd-9e72-75cca30a930b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:39.051299 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-80c35ccc-59f8-4cfd-9e72-75cca30a930b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:39.051730 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-80c35ccc-59f8-4cfd-9e72-75cca30a930b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:39.083379 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-80c35ccc-59f8-4cfd-9e72-75cca30a930b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048578 Jul 11 11:35:39.085644 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 793/1595] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:39 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:35:39.603079 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-2b5c610d-3c22-4351-bdc3-68fc3771b01c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:39.603796 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-2b5c610d-3c22-4351-bdc3-68fc3771b01c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:39.606723 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:35:39.610207 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2b5c610d-3c22-4351-bdc3-68fc3771b01c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:39.610648 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2b5c610d-3c22-4351-bdc3-68fc3771b01c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:39.611455 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2b5c610d-3c22-4351-bdc3-68fc3771b01c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:39.611891 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2b5c610d-3c22-4351-bdc3-68fc3771b01c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:39.742104 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-2b5c610d-3c22-4351-bdc3-68fc3771b01c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:39.750088 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-2b5c610d-3c22-4351-bdc3-68fc3771b01c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.152036 Jul 11 11:35:39.750760 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 803/1596] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:35:39 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:35:39.871980 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-14d7c646-4fe5-45cc-97bd-f6c48b0ca4a0 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:39.872586 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-14d7c646-4fe5-45cc-97bd-f6c48b0ca4a0 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: f4031167-4227-4699-bbcf-d0bec5e3ca8b] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:39.878475 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-14d7c646-4fe5-45cc-97bd-f6c48b0ca4a0 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:39.878919 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-14d7c646-4fe5-45cc-97bd-f6c48b0ca4a0 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:39.879712 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-14d7c646-4fe5-45cc-97bd-f6c48b0ca4a0 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:39.880141 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-14d7c646-4fe5-45cc-97bd-f6c48b0ca4a0 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:40.013406 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-14d7c646-4fe5-45cc-97bd-f6c48b0ca4a0 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:40.022327 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-14d7c646-4fe5-45cc-97bd-f6c48b0ca4a0 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:40.023888 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-14d7c646-4fe5-45cc-97bd-f6c48b0ca4a0 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:40.025035 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-14d7c646-4fe5-45cc-97bd-f6c48b0ca4a0 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/f4031167-4227-4699-bbcf-d0bec5e3ca8b" status: 200 len: 1600 microversion: 2.20 time: 0.157161 Jul 11 11:35:40.026236 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 794/1597] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:35:39 2022] GET /compute/v2.1/servers/f4031167-4227-4699-bbcf-d0bec5e3ca8b => generated 1600 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 11:35:40.040661 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-3bde80c9-557d-457f-ac31-4c95f8192e5f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:40.041576 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-3bde80c9-557d-457f-ac31-4c95f8192e5f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:40.043011 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-8a52cf42-33f0-4252-9ee4-88b158d8f1aa tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:40.043594 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-8a52cf42-33f0-4252-9ee4-88b158d8f1aa tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: f4031167-4227-4699-bbcf-d0bec5e3ca8b] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:40.048043 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3bde80c9-557d-457f-ac31-4c95f8192e5f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:40.048630 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3bde80c9-557d-457f-ac31-4c95f8192e5f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:40.049399 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3bde80c9-557d-457f-ac31-4c95f8192e5f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:40.049541 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8a52cf42-33f0-4252-9ee4-88b158d8f1aa tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:40.049835 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3bde80c9-557d-457f-ac31-4c95f8192e5f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:40.049970 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8a52cf42-33f0-4252-9ee4-88b158d8f1aa tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:40.050733 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8a52cf42-33f0-4252-9ee4-88b158d8f1aa tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:40.051171 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8a52cf42-33f0-4252-9ee4-88b158d8f1aa tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:40.081559 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-3bde80c9-557d-457f-ac31-4c95f8192e5f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045109 Jul 11 11:35:40.082106 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 804/1598] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:40 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:35:40.094960 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-819c7e25-8333-434e-8af6-8a05db6081c7 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:40.095895 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-819c7e25-8333-434e-8af6-8a05db6081c7 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:40.101830 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-819c7e25-8333-434e-8af6-8a05db6081c7 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:40.102272 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-819c7e25-8333-434e-8af6-8a05db6081c7 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:40.103024 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-819c7e25-8333-434e-8af6-8a05db6081c7 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:40.103570 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-819c7e25-8333-434e-8af6-8a05db6081c7 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:40.132413 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-819c7e25-8333-434e-8af6-8a05db6081c7 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041176 Jul 11 11:35:40.132975 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 805/1599] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:40 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:35:40.133623 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-8a52cf42-33f0-4252-9ee4-88b158d8f1aa tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/f4031167-4227-4699-bbcf-d0bec5e3ca8b/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.094284 Jul 11 11:35:40.134312 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 795/1600] 10.222.0.26 () {60 vars in 1315 bytes} [Mon Jul 11 11:35:40 2022] GET /compute/v2.1/servers/f4031167-4227-4699-bbcf-d0bec5e3ca8b/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 11 11:35:40.767234 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-617ad719-72d4-42cb-a7c3-e45e636deed5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:40.767876 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-617ad719-72d4-42cb-a7c3-e45e636deed5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:40.774481 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-617ad719-72d4-42cb-a7c3-e45e636deed5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:40.774935 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-617ad719-72d4-42cb-a7c3-e45e636deed5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:40.775781 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-617ad719-72d4-42cb-a7c3-e45e636deed5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:40.776168 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-617ad719-72d4-42cb-a7c3-e45e636deed5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:40.903866 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-617ad719-72d4-42cb-a7c3-e45e636deed5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:40.912261 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-617ad719-72d4-42cb-a7c3-e45e636deed5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.148785 Jul 11 11:35:40.912851 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 806/1601] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:35:40 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:35:41.093819 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-3d680592-963e-428a-a527-1683115774aa tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:41.099119 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-3d680592-963e-428a-a527-1683115774aa tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:41.101481 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3d680592-963e-428a-a527-1683115774aa tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:41.101926 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3d680592-963e-428a-a527-1683115774aa tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:41.102691 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3d680592-963e-428a-a527-1683115774aa tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:41.103125 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3d680592-963e-428a-a527-1683115774aa tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:41.135359 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-3d680592-963e-428a-a527-1683115774aa tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045415 Jul 11 11:35:41.135928 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 796/1602] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:41 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:35:41.143192 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-c199a3b5-18f6-4ca9-9f23-3e8c53988e1d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:41.144126 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-c199a3b5-18f6-4ca9-9f23-3e8c53988e1d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:41.150572 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c199a3b5-18f6-4ca9-9f23-3e8c53988e1d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:41.151065 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c199a3b5-18f6-4ca9-9f23-3e8c53988e1d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:41.151851 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c199a3b5-18f6-4ca9-9f23-3e8c53988e1d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:41.152280 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c199a3b5-18f6-4ca9-9f23-3e8c53988e1d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:41.182669 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-c199a3b5-18f6-4ca9-9f23-3e8c53988e1d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043323 Jul 11 11:35:41.184202 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 807/1603] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:41 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:35:41.351699 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [req-14fe3c07-c9a8-460c-881a-6c3c542b5705 req-adc024ee-5e58-404b-a861-04ede783679d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4031167-4227-4699-bbcf-d0bec5e3ca8b", "tag": "0bd9eb21-bcac-4a52-8d10-e7d23735f707"}]} {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:35:41.359853 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [req-14fe3c07-c9a8-460c-881a-6c3c542b5705 req-adc024ee-5e58-404b-a861-04ede783679d service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:41.360293 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [req-14fe3c07-c9a8-460c-881a-6c3c542b5705 req-adc024ee-5e58-404b-a861-04ede783679d service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:41.372458 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.compute.server_external_events [req-14fe3c07-c9a8-460c-881a-6c3c542b5705 req-adc024ee-5e58-404b-a861-04ede783679d service nova] Creating event network-changed:0bd9eb21-bcac-4a52-8d10-e7d23735f707 for instance f4031167-4227-4699-bbcf-d0bec5e3ca8b on hv-cinder-84842 Jul 11 11:35:41.378010 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [req-14fe3c07-c9a8-460c-881a-6c3c542b5705 req-adc024ee-5e58-404b-a861-04ede783679d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030021 Jul 11 11:35:41.378690 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 797/1604] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 11:35:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:35:41.929149 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-90da994a-603a-4719-b597-0b7a36fe29de tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:41.929765 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-90da994a-603a-4719-b597-0b7a36fe29de tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:41.935873 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-90da994a-603a-4719-b597-0b7a36fe29de tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:41.936322 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-90da994a-603a-4719-b597-0b7a36fe29de tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:41.937084 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-90da994a-603a-4719-b597-0b7a36fe29de tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:41.937516 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-90da994a-603a-4719-b597-0b7a36fe29de tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:42.080520 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-90da994a-603a-4719-b597-0b7a36fe29de tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:42.097178 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-90da994a-603a-4719-b597-0b7a36fe29de tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.171982 Jul 11 11:35:42.097950 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 808/1605] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:35:41 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:35:42.147638 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-88ae336d-abe2-4af7-b458-331105790580 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:42.148667 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-88ae336d-abe2-4af7-b458-331105790580 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:42.150603 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:35:42.155640 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-88ae336d-abe2-4af7-b458-331105790580 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:42.156093 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-88ae336d-abe2-4af7-b458-331105790580 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:42.156860 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-88ae336d-abe2-4af7-b458-331105790580 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:42.157298 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-88ae336d-abe2-4af7-b458-331105790580 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:42.188189 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-88ae336d-abe2-4af7-b458-331105790580 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045872 Jul 11 11:35:42.189052 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 798/1606] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:42 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:35:42.195649 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-d14bb99c-3b42-437b-ac67-82fb8ed3a4f4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:42.196616 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-d14bb99c-3b42-437b-ac67-82fb8ed3a4f4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:42.203361 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d14bb99c-3b42-437b-ac67-82fb8ed3a4f4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:42.203807 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d14bb99c-3b42-437b-ac67-82fb8ed3a4f4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:42.204748 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d14bb99c-3b42-437b-ac67-82fb8ed3a4f4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:42.205379 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d14bb99c-3b42-437b-ac67-82fb8ed3a4f4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:42.236791 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-d14bb99c-3b42-437b-ac67-82fb8ed3a4f4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045315 Jul 11 11:35:42.237392 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 809/1607] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:42 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:35:43.118616 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-ef3eb7b6-8131-4843-a9ac-1a0ddedf2303 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:43.119424 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-ef3eb7b6-8131-4843-a9ac-1a0ddedf2303 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:43.127063 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ef3eb7b6-8131-4843-a9ac-1a0ddedf2303 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:43.132697 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ef3eb7b6-8131-4843-a9ac-1a0ddedf2303 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:43.132697 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ef3eb7b6-8131-4843-a9ac-1a0ddedf2303 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:43.132697 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ef3eb7b6-8131-4843-a9ac-1a0ddedf2303 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:43.200387 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-f9a0b815-b76c-4cd5-8f27-1405ebc26643 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:43.201372 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-f9a0b815-b76c-4cd5-8f27-1405ebc26643 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:43.208938 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f9a0b815-b76c-4cd5-8f27-1405ebc26643 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:43.209446 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f9a0b815-b76c-4cd5-8f27-1405ebc26643 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:43.210208 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f9a0b815-b76c-4cd5-8f27-1405ebc26643 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:43.212281 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f9a0b815-b76c-4cd5-8f27-1405ebc26643 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:43.241016 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-f9a0b815-b76c-4cd5-8f27-1405ebc26643 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044768 Jul 11 11:35:43.241769 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 810/1608] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:43 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:35:43.247435 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-8f4b94bd-c2fe-493c-ab83-782683bf2581 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:43.248342 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-8f4b94bd-c2fe-493c-ab83-782683bf2581 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:43.254097 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8f4b94bd-c2fe-493c-ab83-782683bf2581 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:43.258198 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8f4b94bd-c2fe-493c-ab83-782683bf2581 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:43.258198 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8f4b94bd-c2fe-493c-ab83-782683bf2581 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:43.258198 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8f4b94bd-c2fe-493c-ab83-782683bf2581 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:43.264734 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-ef3eb7b6-8131-4843-a9ac-1a0ddedf2303 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:43.273252 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-ef3eb7b6-8131-4843-a9ac-1a0ddedf2303 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.159757 Jul 11 11:35:43.282734 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 799/1609] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:35:43 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:35:43.287536 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-8f4b94bd-c2fe-493c-ab83-782683bf2581 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043187 Jul 11 11:35:43.288161 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 811/1610] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:43 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:35:44.253615 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-fb823851-c753-41fd-a28f-fb12c5adffd9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:44.254525 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-fb823851-c753-41fd-a28f-fb12c5adffd9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:44.262081 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fb823851-c753-41fd-a28f-fb12c5adffd9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:44.262526 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fb823851-c753-41fd-a28f-fb12c5adffd9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:44.263303 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fb823851-c753-41fd-a28f-fb12c5adffd9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:44.263741 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fb823851-c753-41fd-a28f-fb12c5adffd9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:44.289841 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-55eca640-8863-4345-adef-bfc606a0b461 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:44.290560 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-55eca640-8863-4345-adef-bfc606a0b461 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:44.291655 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-fb823851-c753-41fd-a28f-fb12c5adffd9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041960 Jul 11 11:35:44.292413 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 800/1611] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:44 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:35:44.297249 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-55eca640-8863-4345-adef-bfc606a0b461 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:44.297697 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-55eca640-8863-4345-adef-bfc606a0b461 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:44.298468 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-55eca640-8863-4345-adef-bfc606a0b461 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:44.298905 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-55eca640-8863-4345-adef-bfc606a0b461 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:44.300092 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-8cb55d01-7f44-4b1d-9666-35162de28ee1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:44.301001 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-8cb55d01-7f44-4b1d-9666-35162de28ee1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:44.307711 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8cb55d01-7f44-4b1d-9666-35162de28ee1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:44.308159 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8cb55d01-7f44-4b1d-9666-35162de28ee1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:44.308916 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8cb55d01-7f44-4b1d-9666-35162de28ee1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:44.309355 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8cb55d01-7f44-4b1d-9666-35162de28ee1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:44.338696 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-8cb55d01-7f44-4b1d-9666-35162de28ee1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042203 Jul 11 11:35:44.339406 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 801/1612] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:44 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:35:44.430337 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-55eca640-8863-4345-adef-bfc606a0b461 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:44.438124 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-55eca640-8863-4345-adef-bfc606a0b461 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.152191 Jul 11 11:35:44.438688 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 812/1613] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:35:44 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:35:45.303859 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-aefb18f1-00f4-4fab-b0cd-5c9390eee2a5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:45.304783 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-aefb18f1-00f4-4fab-b0cd-5c9390eee2a5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:45.311307 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-aefb18f1-00f4-4fab-b0cd-5c9390eee2a5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:45.311757 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-aefb18f1-00f4-4fab-b0cd-5c9390eee2a5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:45.312517 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-aefb18f1-00f4-4fab-b0cd-5c9390eee2a5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:45.312957 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-aefb18f1-00f4-4fab-b0cd-5c9390eee2a5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:45.341047 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-aefb18f1-00f4-4fab-b0cd-5c9390eee2a5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041730 Jul 11 11:35:45.341533 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 802/1614] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:45 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:35:45.350663 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-ed59d0af-b706-4ab1-80a9-66cdefc81c3f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:45.351629 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-ed59d0af-b706-4ab1-80a9-66cdefc81c3f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:45.358095 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ed59d0af-b706-4ab1-80a9-66cdefc81c3f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:45.358547 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ed59d0af-b706-4ab1-80a9-66cdefc81c3f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:45.359336 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ed59d0af-b706-4ab1-80a9-66cdefc81c3f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:45.359777 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ed59d0af-b706-4ab1-80a9-66cdefc81c3f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:45.388006 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-ed59d0af-b706-4ab1-80a9-66cdefc81c3f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041955 Jul 11 11:35:45.388551 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 813/1615] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:45 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:35:45.455232 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-10e2c07d-7237-4fe0-8a4b-7ff422a2b463 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:45.455859 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-10e2c07d-7237-4fe0-8a4b-7ff422a2b463 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:45.461913 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-10e2c07d-7237-4fe0-8a4b-7ff422a2b463 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:45.462361 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-10e2c07d-7237-4fe0-8a4b-7ff422a2b463 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:45.463121 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-10e2c07d-7237-4fe0-8a4b-7ff422a2b463 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:45.463616 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-10e2c07d-7237-4fe0-8a4b-7ff422a2b463 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:45.592167 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-10e2c07d-7237-4fe0-8a4b-7ff422a2b463 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:45.600692 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-10e2c07d-7237-4fe0-8a4b-7ff422a2b463 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.149320 Jul 11 11:35:45.601259 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 803/1616] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:35:45 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:35:46.353674 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-70d5510f-bf70-4d2d-a02a-0d2e907fda9d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:46.354631 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-70d5510f-bf70-4d2d-a02a-0d2e907fda9d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:46.361196 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-70d5510f-bf70-4d2d-a02a-0d2e907fda9d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:46.361646 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-70d5510f-bf70-4d2d-a02a-0d2e907fda9d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:46.362410 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-70d5510f-bf70-4d2d-a02a-0d2e907fda9d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:46.362845 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-70d5510f-bf70-4d2d-a02a-0d2e907fda9d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:46.391281 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-70d5510f-bf70-4d2d-a02a-0d2e907fda9d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042351 Jul 11 11:35:46.391830 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 814/1617] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:46 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:35:46.400051 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-eaa4e6b2-10e2-4491-af37-6451e67325a4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:46.400979 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-eaa4e6b2-10e2-4491-af37-6451e67325a4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:46.407370 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-eaa4e6b2-10e2-4491-af37-6451e67325a4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:46.407824 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-eaa4e6b2-10e2-4491-af37-6451e67325a4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:46.408587 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-eaa4e6b2-10e2-4491-af37-6451e67325a4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:46.409027 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-eaa4e6b2-10e2-4491-af37-6451e67325a4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:46.437526 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-eaa4e6b2-10e2-4491-af37-6451e67325a4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041970 Jul 11 11:35:46.438067 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 804/1618] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:46 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:35:46.617740 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-8d971221-9800-44b9-b396-92d889ac72c8 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:46.618308 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-8d971221-9800-44b9-b396-92d889ac72c8 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:46.624336 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8d971221-9800-44b9-b396-92d889ac72c8 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:46.624786 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8d971221-9800-44b9-b396-92d889ac72c8 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:46.625550 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8d971221-9800-44b9-b396-92d889ac72c8 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:46.625987 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8d971221-9800-44b9-b396-92d889ac72c8 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:46.629857 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=100 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:35:46.750348 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-8d971221-9800-44b9-b396-92d889ac72c8 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:46.758679 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-8d971221-9800-44b9-b396-92d889ac72c8 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.145063 Jul 11 11:35:46.759269 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 815/1619] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:35:46 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:35:47.402398 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-4f486c21-7582-4806-852d-dacb185c01d9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:47.403348 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-4f486c21-7582-4806-852d-dacb185c01d9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:47.409787 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4f486c21-7582-4806-852d-dacb185c01d9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:47.410229 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4f486c21-7582-4806-852d-dacb185c01d9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:47.410977 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4f486c21-7582-4806-852d-dacb185c01d9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:47.411440 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4f486c21-7582-4806-852d-dacb185c01d9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:47.439532 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-4f486c21-7582-4806-852d-dacb185c01d9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041002 Jul 11 11:35:47.440016 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 805/1620] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:47 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:35:47.449724 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-89dbefe4-0402-43ed-abf0-0678ca44579a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:47.450662 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-89dbefe4-0402-43ed-abf0-0678ca44579a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:47.457170 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-89dbefe4-0402-43ed-abf0-0678ca44579a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:47.457593 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-89dbefe4-0402-43ed-abf0-0678ca44579a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:47.458338 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-89dbefe4-0402-43ed-abf0-0678ca44579a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:47.458766 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-89dbefe4-0402-43ed-abf0-0678ca44579a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:47.486424 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-89dbefe4-0402-43ed-abf0-0678ca44579a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040603 Jul 11 11:35:47.486964 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 816/1621] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:47 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:35:47.775665 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-8a193121-337c-4582-8184-7eb95ed68256 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:47.776279 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-8a193121-337c-4582-8184-7eb95ed68256 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:47.782311 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8a193121-337c-4582-8184-7eb95ed68256 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:47.782764 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8a193121-337c-4582-8184-7eb95ed68256 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:47.783549 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8a193121-337c-4582-8184-7eb95ed68256 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:47.783987 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8a193121-337c-4582-8184-7eb95ed68256 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:47.909295 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-8a193121-337c-4582-8184-7eb95ed68256 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:47.917937 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-8a193121-337c-4582-8184-7eb95ed68256 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.146054 Jul 11 11:35:47.927850 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 806/1622] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:35:47 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:35:48.451450 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-6abb7736-b1dc-46a4-987d-e8de5dc46d9e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:48.452367 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-6abb7736-b1dc-46a4-987d-e8de5dc46d9e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:48.459429 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6abb7736-b1dc-46a4-987d-e8de5dc46d9e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:48.459873 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6abb7736-b1dc-46a4-987d-e8de5dc46d9e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:48.460633 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6abb7736-b1dc-46a4-987d-e8de5dc46d9e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:48.461062 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6abb7736-b1dc-46a4-987d-e8de5dc46d9e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:48.488620 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-6abb7736-b1dc-46a4-987d-e8de5dc46d9e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041099 Jul 11 11:35:48.489156 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 817/1623] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:48 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:35:48.497952 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-ea038c86-344d-4671-81fb-980d66e7e08f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:48.498874 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-ea038c86-344d-4671-81fb-980d66e7e08f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:48.505807 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ea038c86-344d-4671-81fb-980d66e7e08f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:48.506254 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ea038c86-344d-4671-81fb-980d66e7e08f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:48.507009 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ea038c86-344d-4671-81fb-980d66e7e08f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:48.507483 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ea038c86-344d-4671-81fb-980d66e7e08f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:48.536848 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-ea038c86-344d-4671-81fb-980d66e7e08f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042892 Jul 11 11:35:48.537392 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 807/1624] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:48 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:35:48.935293 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-7d72e1a4-da37-47e7-b31e-fecd73a20c7e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:48.935905 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-7d72e1a4-da37-47e7-b31e-fecd73a20c7e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:48.941903 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7d72e1a4-da37-47e7-b31e-fecd73a20c7e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:48.942351 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7d72e1a4-da37-47e7-b31e-fecd73a20c7e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:48.943973 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7d72e1a4-da37-47e7-b31e-fecd73a20c7e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:48.944405 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7d72e1a4-da37-47e7-b31e-fecd73a20c7e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:49.075553 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-7d72e1a4-da37-47e7-b31e-fecd73a20c7e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:49.083329 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-7d72e1a4-da37-47e7-b31e-fecd73a20c7e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.151835 Jul 11 11:35:49.083901 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 818/1625] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:35:48 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:35:49.499922 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-23d32263-44dc-43e9-8b97-f63249ead195 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:49.500860 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-23d32263-44dc-43e9-8b97-f63249ead195 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:49.507308 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-23d32263-44dc-43e9-8b97-f63249ead195 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:49.507765 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-23d32263-44dc-43e9-8b97-f63249ead195 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:49.508528 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-23d32263-44dc-43e9-8b97-f63249ead195 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:49.508966 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-23d32263-44dc-43e9-8b97-f63249ead195 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:49.538218 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-23d32263-44dc-43e9-8b97-f63249ead195 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042189 Jul 11 11:35:49.538762 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 808/1626] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:49 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:35:49.548184 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-9b946bed-6e7f-4226-be33-02c3e5fcb85f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:49.549226 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-9b946bed-6e7f-4226-be33-02c3e5fcb85f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:49.555600 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9b946bed-6e7f-4226-be33-02c3e5fcb85f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:49.556044 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9b946bed-6e7f-4226-be33-02c3e5fcb85f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:49.556797 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9b946bed-6e7f-4226-be33-02c3e5fcb85f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:49.557226 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9b946bed-6e7f-4226-be33-02c3e5fcb85f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:49.585679 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-9b946bed-6e7f-4226-be33-02c3e5fcb85f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041434 Jul 11 11:35:49.586218 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 819/1627] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:49 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:35:50.100337 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-44dc6ebc-34ae-441c-bcdf-c0c347fed0ee tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:50.100952 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-44dc6ebc-34ae-441c-bcdf-c0c347fed0ee tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:50.107051 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-44dc6ebc-34ae-441c-bcdf-c0c347fed0ee tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:50.107535 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-44dc6ebc-34ae-441c-bcdf-c0c347fed0ee tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:50.108341 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-44dc6ebc-34ae-441c-bcdf-c0c347fed0ee tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:50.108782 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-44dc6ebc-34ae-441c-bcdf-c0c347fed0ee tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:50.247466 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-44dc6ebc-34ae-441c-bcdf-c0c347fed0ee tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:50.256394 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-44dc6ebc-34ae-441c-bcdf-c0c347fed0ee tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.160036 Jul 11 11:35:50.256976 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 809/1628] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:35:50 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:35:50.549583 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-850c0b91-7ec7-4bcd-a313-743f44b5260c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:50.550501 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-850c0b91-7ec7-4bcd-a313-743f44b5260c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:50.557586 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-850c0b91-7ec7-4bcd-a313-743f44b5260c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:50.558031 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-850c0b91-7ec7-4bcd-a313-743f44b5260c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:50.558787 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-850c0b91-7ec7-4bcd-a313-743f44b5260c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:50.559216 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-850c0b91-7ec7-4bcd-a313-743f44b5260c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:50.587357 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-850c0b91-7ec7-4bcd-a313-743f44b5260c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041605 Jul 11 11:35:50.587910 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 820/1629] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:50 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:35:50.597083 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-f29c2b1b-a7b7-404a-b7fa-76dffe676cf0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:50.600697 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-f29c2b1b-a7b7-404a-b7fa-76dffe676cf0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:50.605348 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f29c2b1b-a7b7-404a-b7fa-76dffe676cf0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:50.605804 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f29c2b1b-a7b7-404a-b7fa-76dffe676cf0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:50.606571 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f29c2b1b-a7b7-404a-b7fa-76dffe676cf0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:50.607029 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f29c2b1b-a7b7-404a-b7fa-76dffe676cf0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:50.621042 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=100 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:35:50.636735 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-f29c2b1b-a7b7-404a-b7fa-76dffe676cf0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043517 Jul 11 11:35:50.637306 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 810/1630] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:50 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:35:51.273255 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-f58a04d2-c6c1-4eed-9e37-69b1eecaf7db tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:51.273880 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-f58a04d2-c6c1-4eed-9e37-69b1eecaf7db tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:51.279891 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f58a04d2-c6c1-4eed-9e37-69b1eecaf7db tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:51.280337 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f58a04d2-c6c1-4eed-9e37-69b1eecaf7db tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:51.281149 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f58a04d2-c6c1-4eed-9e37-69b1eecaf7db tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:51.281613 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f58a04d2-c6c1-4eed-9e37-69b1eecaf7db tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:51.409094 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-f58a04d2-c6c1-4eed-9e37-69b1eecaf7db tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:51.416883 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-f58a04d2-c6c1-4eed-9e37-69b1eecaf7db tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.148134 Jul 11 11:35:51.417826 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 821/1631] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:35:51 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:35:51.598260 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-94e349ad-c870-4201-8718-ee0b903c69af tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:51.599192 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-94e349ad-c870-4201-8718-ee0b903c69af tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:51.605730 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-94e349ad-c870-4201-8718-ee0b903c69af tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:51.606183 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-94e349ad-c870-4201-8718-ee0b903c69af tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:51.606952 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-94e349ad-c870-4201-8718-ee0b903c69af tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:51.607426 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-94e349ad-c870-4201-8718-ee0b903c69af tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:51.636066 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-94e349ad-c870-4201-8718-ee0b903c69af tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042063 Jul 11 11:35:51.636560 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 811/1632] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:51 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:35:51.648469 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-e8fbe731-343d-408e-8097-e41f4a737a7e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:51.649382 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-e8fbe731-343d-408e-8097-e41f4a737a7e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:51.655761 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e8fbe731-343d-408e-8097-e41f4a737a7e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:51.656200 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e8fbe731-343d-408e-8097-e41f4a737a7e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:51.656942 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e8fbe731-343d-408e-8097-e41f4a737a7e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:51.657373 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e8fbe731-343d-408e-8097-e41f4a737a7e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:51.686848 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-e8fbe731-343d-408e-8097-e41f4a737a7e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042786 Jul 11 11:35:51.687417 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 822/1633] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:51 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:35:52.433552 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-ed3afc88-4956-4d4e-ab4b-92565bac1ae6 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:52.434159 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-ed3afc88-4956-4d4e-ab4b-92565bac1ae6 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:52.440161 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ed3afc88-4956-4d4e-ab4b-92565bac1ae6 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:52.440900 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ed3afc88-4956-4d4e-ab4b-92565bac1ae6 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:52.441662 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ed3afc88-4956-4d4e-ab4b-92565bac1ae6 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:52.442089 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ed3afc88-4956-4d4e-ab4b-92565bac1ae6 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:52.570880 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-ed3afc88-4956-4d4e-ab4b-92565bac1ae6 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:52.578885 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-ed3afc88-4956-4d4e-ab4b-92565bac1ae6 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.149191 Jul 11 11:35:52.579505 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 812/1634] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:35:52 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:35:52.648084 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-3f0ed356-3cca-4912-8942-441179774c1f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:52.649004 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-3f0ed356-3cca-4912-8942-441179774c1f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:52.654973 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3f0ed356-3cca-4912-8942-441179774c1f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:52.655453 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3f0ed356-3cca-4912-8942-441179774c1f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:52.656209 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3f0ed356-3cca-4912-8942-441179774c1f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:52.656675 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3f0ed356-3cca-4912-8942-441179774c1f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:52.685016 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-3f0ed356-3cca-4912-8942-441179774c1f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041578 Jul 11 11:35:52.685495 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 823/1635] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:52 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:35:52.698111 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-597b04c1-bf6c-43c7-9694-5170676a1a87 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:52.699036 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-597b04c1-bf6c-43c7-9694-5170676a1a87 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:52.705410 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-597b04c1-bf6c-43c7-9694-5170676a1a87 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:52.705857 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-597b04c1-bf6c-43c7-9694-5170676a1a87 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:52.706613 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-597b04c1-bf6c-43c7-9694-5170676a1a87 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:52.707112 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-597b04c1-bf6c-43c7-9694-5170676a1a87 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:52.735688 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-597b04c1-bf6c-43c7-9694-5170676a1a87 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041418 Jul 11 11:35:52.736225 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 813/1636] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:52 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:35:53.595646 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-73b4db35-1e1d-425b-a9ed-138f33313fac tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:53.596280 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-73b4db35-1e1d-425b-a9ed-138f33313fac tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:53.602693 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-73b4db35-1e1d-425b-a9ed-138f33313fac tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:53.603133 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-73b4db35-1e1d-425b-a9ed-138f33313fac tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:53.603918 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-73b4db35-1e1d-425b-a9ed-138f33313fac tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:53.604344 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-73b4db35-1e1d-425b-a9ed-138f33313fac tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:53.696195 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-685c69db-0d8f-49bc-b119-44222a9c4d37 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:53.697121 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-685c69db-0d8f-49bc-b119-44222a9c4d37 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:53.703582 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-685c69db-0d8f-49bc-b119-44222a9c4d37 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:53.704278 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-685c69db-0d8f-49bc-b119-44222a9c4d37 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:53.707770 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-685c69db-0d8f-49bc-b119-44222a9c4d37 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:53.707770 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-685c69db-0d8f-49bc-b119-44222a9c4d37 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:53.731635 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-73b4db35-1e1d-425b-a9ed-138f33313fac tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:53.735172 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-685c69db-0d8f-49bc-b119-44222a9c4d37 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042507 Jul 11 11:35:53.735172 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 814/1637] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:53 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:35:53.740620 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-73b4db35-1e1d-425b-a9ed-138f33313fac tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.148285 Jul 11 11:35:53.741174 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 824/1638] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:35:53 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:35:53.746957 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-85589088-e742-4f39-9829-a3b9c0657b29 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:53.747895 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-85589088-e742-4f39-9829-a3b9c0657b29 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:53.753795 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-85589088-e742-4f39-9829-a3b9c0657b29 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:53.754240 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-85589088-e742-4f39-9829-a3b9c0657b29 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:53.754989 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-85589088-e742-4f39-9829-a3b9c0657b29 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:53.755479 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-85589088-e742-4f39-9829-a3b9c0657b29 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:53.783152 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-85589088-e742-4f39-9829-a3b9c0657b29 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040131 Jul 11 11:35:53.783720 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 815/1639] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:53 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:35:54.746346 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-484ac97a-7bb2-49f8-bef8-6a2bb78d838e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:54.747418 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-484ac97a-7bb2-49f8-bef8-6a2bb78d838e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:54.754190 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-484ac97a-7bb2-49f8-bef8-6a2bb78d838e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:54.754632 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-484ac97a-7bb2-49f8-bef8-6a2bb78d838e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:54.755416 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-484ac97a-7bb2-49f8-bef8-6a2bb78d838e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:54.755845 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-484ac97a-7bb2-49f8-bef8-6a2bb78d838e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:54.757363 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-4eaf180f-5c36-4805-97db-34d02dac5099 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:54.757978 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-4eaf180f-5c36-4805-97db-34d02dac5099 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:54.765122 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4eaf180f-5c36-4805-97db-34d02dac5099 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:54.765585 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4eaf180f-5c36-4805-97db-34d02dac5099 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:54.766351 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4eaf180f-5c36-4805-97db-34d02dac5099 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:54.766791 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4eaf180f-5c36-4805-97db-34d02dac5099 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:54.785506 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-484ac97a-7bb2-49f8-bef8-6a2bb78d838e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042996 Jul 11 11:35:54.786067 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 825/1640] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:54 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:35:54.794784 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-b9a25b66-6eef-403d-97f1-59b65b7cce9f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:54.795722 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-b9a25b66-6eef-403d-97f1-59b65b7cce9f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:54.801603 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b9a25b66-6eef-403d-97f1-59b65b7cce9f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:54.802554 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b9a25b66-6eef-403d-97f1-59b65b7cce9f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:54.803344 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b9a25b66-6eef-403d-97f1-59b65b7cce9f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:54.803779 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b9a25b66-6eef-403d-97f1-59b65b7cce9f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:54.834204 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-b9a25b66-6eef-403d-97f1-59b65b7cce9f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043002 Jul 11 11:35:54.834801 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 826/1641] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:54 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:35:54.899164 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-4eaf180f-5c36-4805-97db-34d02dac5099 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:54.907188 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-4eaf180f-5c36-4805-97db-34d02dac5099 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.153636 Jul 11 11:35:54.907780 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 816/1642] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:35:54 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:35:55.796242 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-044d6b0e-e68d-44f8-adeb-8d56f186cc9a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:55.797156 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-044d6b0e-e68d-44f8-adeb-8d56f186cc9a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:55.803307 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-044d6b0e-e68d-44f8-adeb-8d56f186cc9a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:55.803759 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-044d6b0e-e68d-44f8-adeb-8d56f186cc9a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:55.804510 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-044d6b0e-e68d-44f8-adeb-8d56f186cc9a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:55.804943 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-044d6b0e-e68d-44f8-adeb-8d56f186cc9a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:55.833127 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-044d6b0e-e68d-44f8-adeb-8d56f186cc9a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040817 Jul 11 11:35:55.834269 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 827/1643] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:55 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:35:55.845082 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-61248b5f-cf57-4e8b-b9fa-db6ae8c2fc6c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:55.845997 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-61248b5f-cf57-4e8b-b9fa-db6ae8c2fc6c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:55.852697 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-61248b5f-cf57-4e8b-b9fa-db6ae8c2fc6c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:55.853137 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-61248b5f-cf57-4e8b-b9fa-db6ae8c2fc6c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:55.853896 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-61248b5f-cf57-4e8b-b9fa-db6ae8c2fc6c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:55.854324 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-61248b5f-cf57-4e8b-b9fa-db6ae8c2fc6c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:55.883916 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-61248b5f-cf57-4e8b-b9fa-db6ae8c2fc6c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042611 Jul 11 11:35:55.884556 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 817/1644] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:55 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:35:55.923819 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-8ea16765-67ef-4542-8676-7167c4954b73 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:55.924432 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-8ea16765-67ef-4542-8676-7167c4954b73 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:55.930400 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8ea16765-67ef-4542-8676-7167c4954b73 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:55.930846 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8ea16765-67ef-4542-8676-7167c4954b73 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:55.931624 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8ea16765-67ef-4542-8676-7167c4954b73 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:55.932055 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8ea16765-67ef-4542-8676-7167c4954b73 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:56.059434 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-8ea16765-67ef-4542-8676-7167c4954b73 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:56.067339 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-8ea16765-67ef-4542-8676-7167c4954b73 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.147278 Jul 11 11:35:56.068457 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 828/1645] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:35:55 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:35:56.845333 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-a2c92dd6-9027-41d1-bad9-fa7efdb850cf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:56.846261 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-a2c92dd6-9027-41d1-bad9-fa7efdb850cf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:56.853022 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a2c92dd6-9027-41d1-bad9-fa7efdb850cf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:56.853477 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a2c92dd6-9027-41d1-bad9-fa7efdb850cf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:56.854277 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a2c92dd6-9027-41d1-bad9-fa7efdb850cf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:56.854714 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a2c92dd6-9027-41d1-bad9-fa7efdb850cf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:56.883722 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-a2c92dd6-9027-41d1-bad9-fa7efdb850cf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042234 Jul 11 11:35:56.884272 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 818/1646] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:56 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:35:56.895584 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-10349163-aa43-4e10-b5df-509f95c323b7 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:56.896991 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-10349163-aa43-4e10-b5df-509f95c323b7 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:56.903541 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-10349163-aa43-4e10-b5df-509f95c323b7 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:56.903991 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-10349163-aa43-4e10-b5df-509f95c323b7 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:56.904751 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-10349163-aa43-4e10-b5df-509f95c323b7 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:56.905183 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-10349163-aa43-4e10-b5df-509f95c323b7 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:56.935368 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-10349163-aa43-4e10-b5df-509f95c323b7 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043754 Jul 11 11:35:56.935931 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 829/1647] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:56 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:35:57.085358 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-cfea8524-dbd8-4644-87cd-841c34d1d388 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:57.085970 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-cfea8524-dbd8-4644-87cd-841c34d1d388 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:57.092070 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cfea8524-dbd8-4644-87cd-841c34d1d388 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:57.092522 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cfea8524-dbd8-4644-87cd-841c34d1d388 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:57.093284 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cfea8524-dbd8-4644-87cd-841c34d1d388 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:57.093722 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cfea8524-dbd8-4644-87cd-841c34d1d388 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:57.222487 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-cfea8524-dbd8-4644-87cd-841c34d1d388 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:57.230844 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-cfea8524-dbd8-4644-87cd-841c34d1d388 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.149943 Jul 11 11:35:57.231443 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 819/1648] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:35:57 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:35:57.895066 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-ccd0ef99-1a4b-427e-9aa9-ea1c50b4cb88 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:57.896026 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-ccd0ef99-1a4b-427e-9aa9-ea1c50b4cb88 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:57.902564 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ccd0ef99-1a4b-427e-9aa9-ea1c50b4cb88 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:57.903012 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ccd0ef99-1a4b-427e-9aa9-ea1c50b4cb88 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:57.903815 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ccd0ef99-1a4b-427e-9aa9-ea1c50b4cb88 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:57.904275 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ccd0ef99-1a4b-427e-9aa9-ea1c50b4cb88 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:57.932693 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-ccd0ef99-1a4b-427e-9aa9-ea1c50b4cb88 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041564 Jul 11 11:35:57.933246 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 830/1649] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:57 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:35:57.946701 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-66c833db-48fa-4499-b8f0-158ce8f26479 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:57.947678 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-66c833db-48fa-4499-b8f0-158ce8f26479 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:57.955419 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-66c833db-48fa-4499-b8f0-158ce8f26479 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:57.955873 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-66c833db-48fa-4499-b8f0-158ce8f26479 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:57.956641 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-66c833db-48fa-4499-b8f0-158ce8f26479 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:57.957110 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-66c833db-48fa-4499-b8f0-158ce8f26479 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:57.986294 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-66c833db-48fa-4499-b8f0-158ce8f26479 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044333 Jul 11 11:35:57.986849 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 820/1650] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:57 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:35:58.247541 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-eb97fbff-0e07-46f0-bc7a-adb852c481ef tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:58.248150 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-eb97fbff-0e07-46f0-bc7a-adb852c481ef tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:58.254170 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-eb97fbff-0e07-46f0-bc7a-adb852c481ef tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:58.254625 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-eb97fbff-0e07-46f0-bc7a-adb852c481ef tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:58.255432 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-eb97fbff-0e07-46f0-bc7a-adb852c481ef tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:58.255871 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-eb97fbff-0e07-46f0-bc7a-adb852c481ef tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:58.384386 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-eb97fbff-0e07-46f0-bc7a-adb852c481ef tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:58.387946 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=100 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:35:58.392692 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-eb97fbff-0e07-46f0-bc7a-adb852c481ef tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.149220 Jul 11 11:35:58.393264 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 831/1651] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:35:58 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:35:58.943769 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-e4a46340-f873-4a39-9d8a-d2deef3dff22 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:58.944690 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-e4a46340-f873-4a39-9d8a-d2deef3dff22 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:58.950851 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e4a46340-f873-4a39-9d8a-d2deef3dff22 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:58.951477 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e4a46340-f873-4a39-9d8a-d2deef3dff22 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:58.952070 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e4a46340-f873-4a39-9d8a-d2deef3dff22 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:58.952499 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e4a46340-f873-4a39-9d8a-d2deef3dff22 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:58.981279 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-e4a46340-f873-4a39-9d8a-d2deef3dff22 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041775 Jul 11 11:35:58.981825 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 821/1652] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:58 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:35:58.997864 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-8ec8055c-875e-41da-b3f4-677561fc6dc4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:58.998809 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-8ec8055c-875e-41da-b3f4-677561fc6dc4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:59.005914 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8ec8055c-875e-41da-b3f4-677561fc6dc4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:59.006360 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8ec8055c-875e-41da-b3f4-677561fc6dc4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:59.007119 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8ec8055c-875e-41da-b3f4-677561fc6dc4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:59.007588 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8ec8055c-875e-41da-b3f4-677561fc6dc4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:59.035602 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-8ec8055c-875e-41da-b3f4-677561fc6dc4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041553 Jul 11 11:35:59.039765 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 832/1653] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:58 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:35:59.409218 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-81df8343-17b7-41b4-84c9-417ab68e3608 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:59.409825 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-81df8343-17b7-41b4-84c9-417ab68e3608 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:35:59.416425 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-81df8343-17b7-41b4-84c9-417ab68e3608 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:59.416871 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-81df8343-17b7-41b4-84c9-417ab68e3608 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:59.417626 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-81df8343-17b7-41b4-84c9-417ab68e3608 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:35:59.418058 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-81df8343-17b7-41b4-84c9-417ab68e3608 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:35:59.547796 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-81df8343-17b7-41b4-84c9-417ab68e3608 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:35:59.555930 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-81df8343-17b7-41b4-84c9-417ab68e3608 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.150630 Jul 11 11:35:59.556496 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 822/1654] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:35:59 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:35:59.993260 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-ed4e556c-d726-490b-94df-071cc74097a7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:35:59.994318 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-ed4e556c-d726-490b-94df-071cc74097a7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:00.000612 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ed4e556c-d726-490b-94df-071cc74097a7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:00.007875 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ed4e556c-d726-490b-94df-071cc74097a7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:00.007875 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ed4e556c-d726-490b-94df-071cc74097a7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:00.007875 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ed4e556c-d726-490b-94df-071cc74097a7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:00.031541 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-ed4e556c-d726-490b-94df-071cc74097a7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042709 Jul 11 11:36:00.032093 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 833/1655] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:35:59 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:00.047734 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-fe9c7448-1239-4b72-a511-ad6389379daf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:00.048754 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-fe9c7448-1239-4b72-a511-ad6389379daf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:00.055855 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fe9c7448-1239-4b72-a511-ad6389379daf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:00.056299 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fe9c7448-1239-4b72-a511-ad6389379daf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:00.057056 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fe9c7448-1239-4b72-a511-ad6389379daf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:00.057486 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fe9c7448-1239-4b72-a511-ad6389379daf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:00.086843 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-fe9c7448-1239-4b72-a511-ad6389379daf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043105 Jul 11 11:36:00.087417 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 823/1656] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:00 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:00.573603 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-c8625b82-9d10-4c52-96aa-fcb542f36af4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:00.574251 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-c8625b82-9d10-4c52-96aa-fcb542f36af4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:00.580135 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c8625b82-9d10-4c52-96aa-fcb542f36af4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:00.580580 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c8625b82-9d10-4c52-96aa-fcb542f36af4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:00.581344 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c8625b82-9d10-4c52-96aa-fcb542f36af4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:00.581776 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c8625b82-9d10-4c52-96aa-fcb542f36af4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:00.942448 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-c8625b82-9d10-4c52-96aa-fcb542f36af4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:36:00.951050 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-c8625b82-9d10-4c52-96aa-fcb542f36af4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.381277 Jul 11 11:36:00.951652 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 834/1657] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:36:00 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:36:01.045986 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-a255ef8a-2e46-4c28-817e-ceb3970ba2d8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:01.046993 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-a255ef8a-2e46-4c28-817e-ceb3970ba2d8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:01.053919 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a255ef8a-2e46-4c28-817e-ceb3970ba2d8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:01.055169 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a255ef8a-2e46-4c28-817e-ceb3970ba2d8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:01.055962 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a255ef8a-2e46-4c28-817e-ceb3970ba2d8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:01.056404 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a255ef8a-2e46-4c28-817e-ceb3970ba2d8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:01.086247 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-a255ef8a-2e46-4c28-817e-ceb3970ba2d8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044273 Jul 11 11:36:01.086802 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 824/1658] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:01 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:01.097894 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-019ef5e5-f56c-437f-8199-617be78eb497 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:01.098813 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-019ef5e5-f56c-437f-8199-617be78eb497 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:01.105179 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-019ef5e5-f56c-437f-8199-617be78eb497 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:01.105628 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-019ef5e5-f56c-437f-8199-617be78eb497 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:01.106383 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-019ef5e5-f56c-437f-8199-617be78eb497 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:01.106815 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-019ef5e5-f56c-437f-8199-617be78eb497 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:01.135133 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-019ef5e5-f56c-437f-8199-617be78eb497 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041150 Jul 11 11:36:01.135703 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 835/1659] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:01 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:01.968323 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-cfca826b-4058-4a71-b1cd-7c1967649d46 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:01.968934 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-cfca826b-4058-4a71-b1cd-7c1967649d46 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:01.975459 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cfca826b-4058-4a71-b1cd-7c1967649d46 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:01.975905 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cfca826b-4058-4a71-b1cd-7c1967649d46 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:01.976667 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cfca826b-4058-4a71-b1cd-7c1967649d46 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:01.977102 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cfca826b-4058-4a71-b1cd-7c1967649d46 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:02.097768 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-d16507c3-4647-4e17-af12-1b78a294ce0d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:02.099615 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-d16507c3-4647-4e17-af12-1b78a294ce0d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:02.106244 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d16507c3-4647-4e17-af12-1b78a294ce0d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:02.106351 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-cfca826b-4058-4a71-b1cd-7c1967649d46 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:36:02.106778 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d16507c3-4647-4e17-af12-1b78a294ce0d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:02.107424 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d16507c3-4647-4e17-af12-1b78a294ce0d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:02.107939 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d16507c3-4647-4e17-af12-1b78a294ce0d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:02.115643 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-cfca826b-4058-4a71-b1cd-7c1967649d46 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.150944 Jul 11 11:36:02.116208 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 825/1660] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:36:01 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:36:02.137165 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-d16507c3-4647-4e17-af12-1b78a294ce0d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043332 Jul 11 11:36:02.137718 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 836/1661] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:02 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:36:02.146407 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-67bb7c12-fce9-4f9e-978f-9a6a3d560b37 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:02.147371 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-67bb7c12-fce9-4f9e-978f-9a6a3d560b37 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:02.153557 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-67bb7c12-fce9-4f9e-978f-9a6a3d560b37 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:02.154010 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-67bb7c12-fce9-4f9e-978f-9a6a3d560b37 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:02.154771 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-67bb7c12-fce9-4f9e-978f-9a6a3d560b37 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:02.155212 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-67bb7c12-fce9-4f9e-978f-9a6a3d560b37 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:02.183668 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-67bb7c12-fce9-4f9e-978f-9a6a3d560b37 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041698 Jul 11 11:36:02.184213 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 826/1662] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:02 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:03.132448 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-308c2798-f3a2-4a35-836c-501481bf3532 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:03.133057 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-308c2798-f3a2-4a35-836c-501481bf3532 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:03.139607 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-308c2798-f3a2-4a35-836c-501481bf3532 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:03.140058 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-308c2798-f3a2-4a35-836c-501481bf3532 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:03.140847 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-308c2798-f3a2-4a35-836c-501481bf3532 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:03.141280 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-308c2798-f3a2-4a35-836c-501481bf3532 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:03.148357 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-15f0d9eb-1f36-4a8d-a35b-82d600eff2ce tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:03.149558 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-15f0d9eb-1f36-4a8d-a35b-82d600eff2ce tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:03.156230 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-15f0d9eb-1f36-4a8d-a35b-82d600eff2ce tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:03.156756 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-15f0d9eb-1f36-4a8d-a35b-82d600eff2ce tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:03.157673 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-15f0d9eb-1f36-4a8d-a35b-82d600eff2ce tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:03.158279 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-15f0d9eb-1f36-4a8d-a35b-82d600eff2ce tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:03.161872 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=100 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:36:03.190647 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-15f0d9eb-1f36-4a8d-a35b-82d600eff2ce tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046109 Jul 11 11:36:03.191231 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 827/1663] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:03 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:36:03.196524 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-d58a477d-9095-4816-9325-68c12bfe8166 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:03.197433 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-d58a477d-9095-4816-9325-68c12bfe8166 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:03.203481 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d58a477d-9095-4816-9325-68c12bfe8166 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:03.203931 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d58a477d-9095-4816-9325-68c12bfe8166 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:03.204694 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d58a477d-9095-4816-9325-68c12bfe8166 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:03.205131 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d58a477d-9095-4816-9325-68c12bfe8166 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:03.234398 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-d58a477d-9095-4816-9325-68c12bfe8166 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042118 Jul 11 11:36:03.234964 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 828/1664] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:03 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:03.278765 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-308c2798-f3a2-4a35-836c-501481bf3532 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:36:03.287115 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-308c2798-f3a2-4a35-836c-501481bf3532 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.158601 Jul 11 11:36:03.287713 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 837/1665] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:36:03 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:36:04.202135 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-f477e2e5-a0b3-445c-82a0-22b5f2429964 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:04.207039 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-f477e2e5-a0b3-445c-82a0-22b5f2429964 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:04.210305 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f477e2e5-a0b3-445c-82a0-22b5f2429964 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:04.210755 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f477e2e5-a0b3-445c-82a0-22b5f2429964 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:04.211545 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f477e2e5-a0b3-445c-82a0-22b5f2429964 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:04.211983 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f477e2e5-a0b3-445c-82a0-22b5f2429964 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:04.240628 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-f477e2e5-a0b3-445c-82a0-22b5f2429964 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042241 Jul 11 11:36:04.241086 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 829/1666] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:04 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:04.246091 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-7db95712-8f13-4aae-9aaf-8dfc71a7143d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:04.247039 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-7db95712-8f13-4aae-9aaf-8dfc71a7143d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:04.253452 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7db95712-8f13-4aae-9aaf-8dfc71a7143d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:04.253931 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7db95712-8f13-4aae-9aaf-8dfc71a7143d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:04.254714 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7db95712-8f13-4aae-9aaf-8dfc71a7143d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:04.255684 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7db95712-8f13-4aae-9aaf-8dfc71a7143d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:04.285739 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-7db95712-8f13-4aae-9aaf-8dfc71a7143d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043774 Jul 11 11:36:04.286306 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 838/1667] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:04 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:04.303854 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-a583fca8-599a-4424-b166-73ee640cad6d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:04.304472 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-a583fca8-599a-4424-b166-73ee640cad6d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:04.310565 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a583fca8-599a-4424-b166-73ee640cad6d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:04.311915 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a583fca8-599a-4424-b166-73ee640cad6d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:04.311915 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a583fca8-599a-4424-b166-73ee640cad6d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:04.312228 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a583fca8-599a-4424-b166-73ee640cad6d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:04.443507 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-a583fca8-599a-4424-b166-73ee640cad6d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:36:04.451273 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-a583fca8-599a-4424-b166-73ee640cad6d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.151265 Jul 11 11:36:04.451828 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 830/1668] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:36:04 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:36:05.251486 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-6a0c1073-c848-4499-b909-2080c7b8912a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:05.252630 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-6a0c1073-c848-4499-b909-2080c7b8912a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:05.259365 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6a0c1073-c848-4499-b909-2080c7b8912a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:05.259638 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6a0c1073-c848-4499-b909-2080c7b8912a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:05.260395 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6a0c1073-c848-4499-b909-2080c7b8912a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:05.260829 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6a0c1073-c848-4499-b909-2080c7b8912a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:05.290715 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-6a0c1073-c848-4499-b909-2080c7b8912a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043130 Jul 11 11:36:05.291275 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 839/1669] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:05 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:05.297337 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-e3b2260b-85f2-44a1-8b5b-b1c89750a4b9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:05.298256 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-e3b2260b-85f2-44a1-8b5b-b1c89750a4b9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:05.304686 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e3b2260b-85f2-44a1-8b5b-b1c89750a4b9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:05.305136 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e3b2260b-85f2-44a1-8b5b-b1c89750a4b9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:05.305895 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e3b2260b-85f2-44a1-8b5b-b1c89750a4b9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:05.306330 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e3b2260b-85f2-44a1-8b5b-b1c89750a4b9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:05.335364 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-e3b2260b-85f2-44a1-8b5b-b1c89750a4b9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041921 Jul 11 11:36:05.335857 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 831/1670] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:05 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:05.468225 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-c2150bd5-e0e5-4be5-bc95-200e06d2c5a9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:05.468838 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-c2150bd5-e0e5-4be5-bc95-200e06d2c5a9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:05.475357 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c2150bd5-e0e5-4be5-bc95-200e06d2c5a9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:05.475804 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c2150bd5-e0e5-4be5-bc95-200e06d2c5a9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:05.476556 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c2150bd5-e0e5-4be5-bc95-200e06d2c5a9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:05.476983 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c2150bd5-e0e5-4be5-bc95-200e06d2c5a9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:05.604513 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-c2150bd5-e0e5-4be5-bc95-200e06d2c5a9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:36:05.612272 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-c2150bd5-e0e5-4be5-bc95-200e06d2c5a9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.147897 Jul 11 11:36:05.612834 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 840/1671] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:36:05 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:36:06.303978 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-5df7b674-6085-4c4e-af8c-aecdf2c1d1fc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:06.304903 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-5df7b674-6085-4c4e-af8c-aecdf2c1d1fc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:06.311283 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5df7b674-6085-4c4e-af8c-aecdf2c1d1fc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:06.311804 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5df7b674-6085-4c4e-af8c-aecdf2c1d1fc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:06.312567 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5df7b674-6085-4c4e-af8c-aecdf2c1d1fc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:06.312997 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5df7b674-6085-4c4e-af8c-aecdf2c1d1fc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:06.346081 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-10334def-f136-4de5-be1c-922da00adb20 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:06.347747 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-10334def-f136-4de5-be1c-922da00adb20 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:06.353006 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-5df7b674-6085-4c4e-af8c-aecdf2c1d1fc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053788 Jul 11 11:36:06.353839 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 832/1672] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:06 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:36:06.360181 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-10334def-f136-4de5-be1c-922da00adb20 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:06.360937 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-10334def-f136-4de5-be1c-922da00adb20 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:06.362377 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-10334def-f136-4de5-be1c-922da00adb20 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:06.363050 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-10334def-f136-4de5-be1c-922da00adb20 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:06.400590 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-10334def-f136-4de5-be1c-922da00adb20 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058450 Jul 11 11:36:06.401153 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 841/1673] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:06 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:36:06.629904 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-07b07883-082f-411d-a84b-20b0e90f93c8 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:06.631022 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-07b07883-082f-411d-a84b-20b0e90f93c8 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:06.636998 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-07b07883-082f-411d-a84b-20b0e90f93c8 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:06.637444 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-07b07883-082f-411d-a84b-20b0e90f93c8 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:06.638204 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-07b07883-082f-411d-a84b-20b0e90f93c8 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:06.638633 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-07b07883-082f-411d-a84b-20b0e90f93c8 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:06.763372 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-07b07883-082f-411d-a84b-20b0e90f93c8 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:36:06.771131 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-07b07883-082f-411d-a84b-20b0e90f93c8 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.145170 Jul 11 11:36:06.771718 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 833/1674] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:36:06 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:36:07.364560 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-42f40a46-7742-455f-a978-2b57f404f87f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:07.367428 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-42f40a46-7742-455f-a978-2b57f404f87f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:07.375570 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-42f40a46-7742-455f-a978-2b57f404f87f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:07.376029 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-42f40a46-7742-455f-a978-2b57f404f87f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:07.376835 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-42f40a46-7742-455f-a978-2b57f404f87f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:07.377272 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-42f40a46-7742-455f-a978-2b57f404f87f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:07.407399 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-42f40a46-7742-455f-a978-2b57f404f87f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046776 Jul 11 11:36:07.407954 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 842/1675] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:07 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:07.412715 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-64adb339-30aa-4623-ac1c-c155f8278590 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:07.413823 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-64adb339-30aa-4623-ac1c-c155f8278590 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:07.423915 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-64adb339-30aa-4623-ac1c-c155f8278590 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:07.424367 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-64adb339-30aa-4623-ac1c-c155f8278590 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:07.425132 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-64adb339-30aa-4623-ac1c-c155f8278590 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:07.425564 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-64adb339-30aa-4623-ac1c-c155f8278590 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:07.455365 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-64adb339-30aa-4623-ac1c-c155f8278590 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047170 Jul 11 11:36:07.455935 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 834/1676] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:07 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:36:07.788416 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-d4c91c52-5d92-43cd-9b63-606769190104 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:07.789054 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-d4c91c52-5d92-43cd-9b63-606769190104 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:07.795082 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d4c91c52-5d92-43cd-9b63-606769190104 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:07.795571 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d4c91c52-5d92-43cd-9b63-606769190104 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:07.796320 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d4c91c52-5d92-43cd-9b63-606769190104 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:07.796747 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d4c91c52-5d92-43cd-9b63-606769190104 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:07.923510 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-d4c91c52-5d92-43cd-9b63-606769190104 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:36:07.931886 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-d4c91c52-5d92-43cd-9b63-606769190104 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.147816 Jul 11 11:36:07.932459 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 843/1677] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:36:07 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:36:08.417798 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-a46377f4-a1fb-4d71-8121-4ef6ce4804cc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:08.418723 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-a46377f4-a1fb-4d71-8121-4ef6ce4804cc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:08.425253 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a46377f4-a1fb-4d71-8121-4ef6ce4804cc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:08.425701 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a46377f4-a1fb-4d71-8121-4ef6ce4804cc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:08.426456 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a46377f4-a1fb-4d71-8121-4ef6ce4804cc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:08.427416 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a46377f4-a1fb-4d71-8121-4ef6ce4804cc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:08.456198 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-a46377f4-a1fb-4d71-8121-4ef6ce4804cc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042272 Jul 11 11:36:08.456750 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 835/1678] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:08 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:08.467488 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-d6f6e0a3-0dc1-4c82-a5cd-e2c4ec503c78 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:08.468400 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-d6f6e0a3-0dc1-4c82-a5cd-e2c4ec503c78 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:08.475289 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d6f6e0a3-0dc1-4c82-a5cd-e2c4ec503c78 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:08.475720 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d6f6e0a3-0dc1-4c82-a5cd-e2c4ec503c78 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:08.476464 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d6f6e0a3-0dc1-4c82-a5cd-e2c4ec503c78 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:08.476890 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d6f6e0a3-0dc1-4c82-a5cd-e2c4ec503c78 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:08.505929 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-d6f6e0a3-0dc1-4c82-a5cd-e2c4ec503c78 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042369 Jul 11 11:36:08.506467 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 844/1679] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:08 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:08.949522 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-ca315d64-8025-4372-a858-3a10100eaedb tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:08.950149 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-ca315d64-8025-4372-a858-3a10100eaedb tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:08.956106 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ca315d64-8025-4372-a858-3a10100eaedb tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:08.956545 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ca315d64-8025-4372-a858-3a10100eaedb tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:08.957291 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ca315d64-8025-4372-a858-3a10100eaedb tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:08.957725 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ca315d64-8025-4372-a858-3a10100eaedb tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:09.089830 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-ca315d64-8025-4372-a858-3a10100eaedb tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:36:09.097729 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-ca315d64-8025-4372-a858-3a10100eaedb tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.152102 Jul 11 11:36:09.098295 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 836/1680] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:36:08 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:36:09.467590 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-e8c220d0-b37f-4f02-b45b-9e9ee341a903 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:09.468516 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-e8c220d0-b37f-4f02-b45b-9e9ee341a903 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:09.475160 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e8c220d0-b37f-4f02-b45b-9e9ee341a903 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:09.475634 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e8c220d0-b37f-4f02-b45b-9e9ee341a903 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:09.476395 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e8c220d0-b37f-4f02-b45b-9e9ee341a903 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:09.476821 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e8c220d0-b37f-4f02-b45b-9e9ee341a903 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:09.506724 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-e8c220d0-b37f-4f02-b45b-9e9ee341a903 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043094 Jul 11 11:36:09.507455 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 845/1681] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:09 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:09.516424 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-f0a191d6-239e-467c-8b20-73a5f82e1d76 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:09.517499 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-f0a191d6-239e-467c-8b20-73a5f82e1d76 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:09.523477 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f0a191d6-239e-467c-8b20-73a5f82e1d76 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:09.523925 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f0a191d6-239e-467c-8b20-73a5f82e1d76 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:09.524683 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f0a191d6-239e-467c-8b20-73a5f82e1d76 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:09.525122 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f0a191d6-239e-467c-8b20-73a5f82e1d76 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:09.555636 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-f0a191d6-239e-467c-8b20-73a5f82e1d76 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043162 Jul 11 11:36:09.556207 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 837/1682] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:09 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:10.113635 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-031d5b5d-ba4d-47df-aea3-fde616759153 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:10.114250 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-031d5b5d-ba4d-47df-aea3-fde616759153 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:10.116679 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_api:SELECT=85 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:36:10.121394 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-031d5b5d-ba4d-47df-aea3-fde616759153 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:10.124830 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-031d5b5d-ba4d-47df-aea3-fde616759153 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:10.124830 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-031d5b5d-ba4d-47df-aea3-fde616759153 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:10.124830 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-031d5b5d-ba4d-47df-aea3-fde616759153 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:10.248665 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-031d5b5d-ba4d-47df-aea3-fde616759153 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:36:10.256563 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-031d5b5d-ba4d-47df-aea3-fde616759153 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.146727 Jul 11 11:36:10.257126 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 846/1683] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:36:10 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:36:10.517868 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-9450088e-4be5-4ff4-a5df-d13c56e7994b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:10.518788 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-9450088e-4be5-4ff4-a5df-d13c56e7994b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:10.525189 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9450088e-4be5-4ff4-a5df-d13c56e7994b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:10.525632 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9450088e-4be5-4ff4-a5df-d13c56e7994b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:10.526382 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9450088e-4be5-4ff4-a5df-d13c56e7994b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:10.526812 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9450088e-4be5-4ff4-a5df-d13c56e7994b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:10.555225 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-9450088e-4be5-4ff4-a5df-d13c56e7994b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041287 Jul 11 11:36:10.555812 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 838/1684] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:10 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:10.566832 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-ac0dd6b5-1fdd-4e4c-acf7-d8f50275f5b0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:10.568765 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-ac0dd6b5-1fdd-4e4c-acf7-d8f50275f5b0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:10.575180 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ac0dd6b5-1fdd-4e4c-acf7-d8f50275f5b0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:10.575660 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ac0dd6b5-1fdd-4e4c-acf7-d8f50275f5b0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:10.576418 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ac0dd6b5-1fdd-4e4c-acf7-d8f50275f5b0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:10.576851 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ac0dd6b5-1fdd-4e4c-acf7-d8f50275f5b0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:10.604531 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-ac0dd6b5-1fdd-4e4c-acf7-d8f50275f5b0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041743 Jul 11 11:36:10.605076 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 847/1685] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:10 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:11.273044 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-4f9704f6-7400-4717-aedf-84fdf79de1f5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:11.273645 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-4f9704f6-7400-4717-aedf-84fdf79de1f5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:11.281483 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4f9704f6-7400-4717-aedf-84fdf79de1f5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:11.282002 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4f9704f6-7400-4717-aedf-84fdf79de1f5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:11.282796 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4f9704f6-7400-4717-aedf-84fdf79de1f5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:11.283231 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4f9704f6-7400-4717-aedf-84fdf79de1f5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:11.411301 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-4f9704f6-7400-4717-aedf-84fdf79de1f5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:36:11.419213 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-4f9704f6-7400-4717-aedf-84fdf79de1f5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.150072 Jul 11 11:36:11.422348 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 839/1686] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:36:11 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:36:11.566350 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-79a1cc00-e459-44a5-9db2-453e2bec88c0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:11.567289 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-79a1cc00-e459-44a5-9db2-453e2bec88c0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:11.574028 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-79a1cc00-e459-44a5-9db2-453e2bec88c0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:11.574485 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-79a1cc00-e459-44a5-9db2-453e2bec88c0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:11.575282 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-79a1cc00-e459-44a5-9db2-453e2bec88c0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:11.575722 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-79a1cc00-e459-44a5-9db2-453e2bec88c0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:11.592030 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=100 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:36:11.604790 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-79a1cc00-e459-44a5-9db2-453e2bec88c0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042536 Jul 11 11:36:11.605358 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 848/1687] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:11 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:11.616818 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-b7f6a565-6f27-4e2a-80eb-bdbcbb290f53 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:11.617680 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-b7f6a565-6f27-4e2a-80eb-bdbcbb290f53 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:11.624072 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b7f6a565-6f27-4e2a-80eb-bdbcbb290f53 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:11.624525 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b7f6a565-6f27-4e2a-80eb-bdbcbb290f53 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:11.625283 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b7f6a565-6f27-4e2a-80eb-bdbcbb290f53 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:11.625749 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b7f6a565-6f27-4e2a-80eb-bdbcbb290f53 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:11.653480 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-b7f6a565-6f27-4e2a-80eb-bdbcbb290f53 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041338 Jul 11 11:36:11.654030 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 840/1688] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:11 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:12.441968 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-22e538de-c5d1-4ab3-b51e-89bd40db1d48 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:12.443643 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-22e538de-c5d1-4ab3-b51e-89bd40db1d48 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:12.449618 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-22e538de-c5d1-4ab3-b51e-89bd40db1d48 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:12.450061 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-22e538de-c5d1-4ab3-b51e-89bd40db1d48 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:12.450808 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-22e538de-c5d1-4ab3-b51e-89bd40db1d48 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:12.451234 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-22e538de-c5d1-4ab3-b51e-89bd40db1d48 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:12.578698 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-22e538de-c5d1-4ab3-b51e-89bd40db1d48 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:36:12.586557 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-22e538de-c5d1-4ab3-b51e-89bd40db1d48 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.148725 Jul 11 11:36:12.587117 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 849/1689] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:36:12 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:36:12.616879 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-5e5e7cef-db04-4d76-ae1a-4afcc4dfe65d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:12.617801 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-5e5e7cef-db04-4d76-ae1a-4afcc4dfe65d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:12.624092 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5e5e7cef-db04-4d76-ae1a-4afcc4dfe65d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:12.624542 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5e5e7cef-db04-4d76-ae1a-4afcc4dfe65d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:12.625298 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5e5e7cef-db04-4d76-ae1a-4afcc4dfe65d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:12.625735 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5e5e7cef-db04-4d76-ae1a-4afcc4dfe65d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:12.655471 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-5e5e7cef-db04-4d76-ae1a-4afcc4dfe65d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043113 Jul 11 11:36:12.656078 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 841/1690] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:12 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:12.665837 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-dd76aa06-953b-4739-96c1-cb75e78ddd6a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:12.667091 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-dd76aa06-953b-4739-96c1-cb75e78ddd6a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:12.673529 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-dd76aa06-953b-4739-96c1-cb75e78ddd6a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:12.673970 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-dd76aa06-953b-4739-96c1-cb75e78ddd6a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:12.674746 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-dd76aa06-953b-4739-96c1-cb75e78ddd6a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:12.675172 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-dd76aa06-953b-4739-96c1-cb75e78ddd6a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:12.705986 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-dd76aa06-953b-4739-96c1-cb75e78ddd6a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044778 Jul 11 11:36:12.706459 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 850/1691] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:12 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:13.667157 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-21565022-aef9-4e0f-ae49-4f1b33d8ea7d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:13.668098 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-21565022-aef9-4e0f-ae49-4f1b33d8ea7d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:13.674190 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-21565022-aef9-4e0f-ae49-4f1b33d8ea7d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:13.674667 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-21565022-aef9-4e0f-ae49-4f1b33d8ea7d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:13.675457 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-21565022-aef9-4e0f-ae49-4f1b33d8ea7d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:13.675897 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-21565022-aef9-4e0f-ae49-4f1b33d8ea7d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:13.745557 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-2fe7e47c-bfa8-427e-9c5a-1f7ca9668838 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:13.746539 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-2fe7e47c-bfa8-427e-9c5a-1f7ca9668838 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:13.752681 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2fe7e47c-bfa8-427e-9c5a-1f7ca9668838 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:13.754542 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2fe7e47c-bfa8-427e-9c5a-1f7ca9668838 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:13.754542 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2fe7e47c-bfa8-427e-9c5a-1f7ca9668838 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:13.754542 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2fe7e47c-bfa8-427e-9c5a-1f7ca9668838 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:13.787437 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-2fe7e47c-bfa8-427e-9c5a-1f7ca9668838 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.124311 Jul 11 11:36:13.788116 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 851/1692] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:13 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:13.857985 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-0a7bacce-9688-4f08-9eb7-a38be248fd71 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:13.858848 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-0a7bacce-9688-4f08-9eb7-a38be248fd71 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:13.864393 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-21565022-aef9-4e0f-ae49-4f1b33d8ea7d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:36:13.865014 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0a7bacce-9688-4f08-9eb7-a38be248fd71 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:13.865467 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0a7bacce-9688-4f08-9eb7-a38be248fd71 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:13.866234 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0a7bacce-9688-4f08-9eb7-a38be248fd71 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:13.866673 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0a7bacce-9688-4f08-9eb7-a38be248fd71 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:13.872761 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-21565022-aef9-4e0f-ae49-4f1b33d8ea7d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.272722 Jul 11 11:36:13.873426 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 842/1693] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:36:13 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:36:13.897427 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-0a7bacce-9688-4f08-9eb7-a38be248fd71 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108369 Jul 11 11:36:13.898014 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 852/1694] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:13 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:14.798855 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-dad0f64f-e73e-4ece-9872-e130fa07b79c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:14.799836 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-dad0f64f-e73e-4ece-9872-e130fa07b79c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:14.802733 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_api:SELECT=90 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:36:14.807510 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-dad0f64f-e73e-4ece-9872-e130fa07b79c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:14.807960 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-dad0f64f-e73e-4ece-9872-e130fa07b79c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:14.808725 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-dad0f64f-e73e-4ece-9872-e130fa07b79c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:14.809165 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-dad0f64f-e73e-4ece-9872-e130fa07b79c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:14.833798 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=100 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:36:14.838183 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-dad0f64f-e73e-4ece-9872-e130fa07b79c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043333 Jul 11 11:36:14.838733 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 843/1695] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:14 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:14.890027 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-8b8ea14a-a776-4c88-99e0-da39b5d5159b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:14.890630 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-8b8ea14a-a776-4c88-99e0-da39b5d5159b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:14.897525 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8b8ea14a-a776-4c88-99e0-da39b5d5159b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:14.897969 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8b8ea14a-a776-4c88-99e0-da39b5d5159b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:14.898713 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8b8ea14a-a776-4c88-99e0-da39b5d5159b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:14.899140 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8b8ea14a-a776-4c88-99e0-da39b5d5159b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:14.910221 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-e0e0f31a-e8a3-4a9e-a6d4-9b8c1657906b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:14.911748 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-e0e0f31a-e8a3-4a9e-a6d4-9b8c1657906b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:14.918275 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e0e0f31a-e8a3-4a9e-a6d4-9b8c1657906b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:14.918729 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e0e0f31a-e8a3-4a9e-a6d4-9b8c1657906b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:14.919588 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e0e0f31a-e8a3-4a9e-a6d4-9b8c1657906b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:14.920031 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e0e0f31a-e8a3-4a9e-a6d4-9b8c1657906b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:14.948915 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-e0e0f31a-e8a3-4a9e-a6d4-9b8c1657906b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042874 Jul 11 11:36:14.949786 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 844/1696] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:14 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:36:15.068813 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-8b8ea14a-a776-4c88-99e0-da39b5d5159b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:36:15.076725 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-8b8ea14a-a776-4c88-99e0-da39b5d5159b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.190561 Jul 11 11:36:15.077296 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 853/1697] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:36:14 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:36:15.433112 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-ef5a8636-7fa2-4d54-bf91-4cf5d3759a49 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:15.433647 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-ef5a8636-7fa2-4d54-bf91-4cf5d3759a49 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: f4031167-4227-4699-bbcf-d0bec5e3ca8b] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:15.439588 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ef5a8636-7fa2-4d54-bf91-4cf5d3759a49 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:15.440035 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ef5a8636-7fa2-4d54-bf91-4cf5d3759a49 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:15.440795 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ef5a8636-7fa2-4d54-bf91-4cf5d3759a49 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:15.441235 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ef5a8636-7fa2-4d54-bf91-4cf5d3759a49 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:15.468366 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-ef5a8636-7fa2-4d54-bf91-4cf5d3759a49 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/f4031167-4227-4699-bbcf-d0bec5e3ca8b/ips" status: 200 len: 153 microversion: 2.20 time: 0.106742 Jul 11 11:36:15.468949 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 845/1698] 10.222.0.26 () {60 vars in 1288 bytes} [Mon Jul 11 11:36:15 2022] GET /compute/v2.1/servers/f4031167-4227-4699-bbcf-d0bec5e3ca8b/ips => generated 153 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 11:36:15.849551 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-fda0a6b8-02af-4adb-9ad4-2d43ea33b85a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:15.850422 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-fda0a6b8-02af-4adb-9ad4-2d43ea33b85a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:15.856452 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fda0a6b8-02af-4adb-9ad4-2d43ea33b85a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:15.856897 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fda0a6b8-02af-4adb-9ad4-2d43ea33b85a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:15.857650 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fda0a6b8-02af-4adb-9ad4-2d43ea33b85a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:15.858080 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fda0a6b8-02af-4adb-9ad4-2d43ea33b85a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:15.887427 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-fda0a6b8-02af-4adb-9ad4-2d43ea33b85a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041918 Jul 11 11:36:15.887983 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 854/1699] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:15 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:15.960143 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-ffeea79d-9589-498a-b908-169ebf631c6f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:15.961061 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-ffeea79d-9589-498a-b908-169ebf631c6f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:15.967628 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ffeea79d-9589-498a-b908-169ebf631c6f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:15.968078 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ffeea79d-9589-498a-b908-169ebf631c6f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:15.968829 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ffeea79d-9589-498a-b908-169ebf631c6f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:15.969260 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ffeea79d-9589-498a-b908-169ebf631c6f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:16.003313 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-ffeea79d-9589-498a-b908-169ebf631c6f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047018 Jul 11 11:36:16.003877 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 846/1700] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:15 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:16.094069 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-48beec40-8e23-458d-9de1-70f13bf8174d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:16.094670 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-48beec40-8e23-458d-9de1-70f13bf8174d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:16.101910 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-48beec40-8e23-458d-9de1-70f13bf8174d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:16.102352 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-48beec40-8e23-458d-9de1-70f13bf8174d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:16.103103 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-48beec40-8e23-458d-9de1-70f13bf8174d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:16.103554 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-48beec40-8e23-458d-9de1-70f13bf8174d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:16.236678 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-48beec40-8e23-458d-9de1-70f13bf8174d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:36:16.245061 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-48beec40-8e23-458d-9de1-70f13bf8174d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.155167 Jul 11 11:36:16.245652 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 855/1701] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:36:16 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:36:16.898651 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-fb7247de-f376-4131-bb42-90610f4922e0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:16.899610 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-fb7247de-f376-4131-bb42-90610f4922e0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:16.905544 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fb7247de-f376-4131-bb42-90610f4922e0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:16.905991 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fb7247de-f376-4131-bb42-90610f4922e0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:16.906768 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fb7247de-f376-4131-bb42-90610f4922e0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:16.907187 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fb7247de-f376-4131-bb42-90610f4922e0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:16.934762 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-fb7247de-f376-4131-bb42-90610f4922e0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040745 Jul 11 11:36:16.935395 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 847/1702] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:16 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:17.013929 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-ea772ef8-d6e7-4cd2-a3d8-346dbfea0c8a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:17.014848 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-ea772ef8-d6e7-4cd2-a3d8-346dbfea0c8a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:17.021404 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ea772ef8-d6e7-4cd2-a3d8-346dbfea0c8a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:17.021851 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ea772ef8-d6e7-4cd2-a3d8-346dbfea0c8a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:17.022610 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ea772ef8-d6e7-4cd2-a3d8-346dbfea0c8a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:17.023044 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ea772ef8-d6e7-4cd2-a3d8-346dbfea0c8a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:17.052458 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-ea772ef8-d6e7-4cd2-a3d8-346dbfea0c8a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042418 Jul 11 11:36:17.053030 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 856/1703] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:17 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:17.261879 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-d5c14e05-c778-4efb-bc7d-8d58e6dcd46f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:17.262490 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-d5c14e05-c778-4efb-bc7d-8d58e6dcd46f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:17.268827 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d5c14e05-c778-4efb-bc7d-8d58e6dcd46f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:17.269281 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d5c14e05-c778-4efb-bc7d-8d58e6dcd46f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:17.270034 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d5c14e05-c778-4efb-bc7d-8d58e6dcd46f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:17.270469 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d5c14e05-c778-4efb-bc7d-8d58e6dcd46f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:17.395823 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-d5c14e05-c778-4efb-bc7d-8d58e6dcd46f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:36:17.403549 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-d5c14e05-c778-4efb-bc7d-8d58e6dcd46f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.145442 Jul 11 11:36:17.404110 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 848/1704] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:36:17 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:36:17.946107 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-17baaaa2-e3c0-407a-9738-1a641d50443b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:17.947060 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-17baaaa2-e3c0-407a-9738-1a641d50443b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:17.953742 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-17baaaa2-e3c0-407a-9738-1a641d50443b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:17.954190 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-17baaaa2-e3c0-407a-9738-1a641d50443b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:17.954946 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-17baaaa2-e3c0-407a-9738-1a641d50443b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:17.955410 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-17baaaa2-e3c0-407a-9738-1a641d50443b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:17.984455 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-17baaaa2-e3c0-407a-9738-1a641d50443b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042675 Jul 11 11:36:17.985015 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 857/1705] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:17 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:18.064188 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-b7a85b11-4575-49b1-977c-82564acf13ba tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:18.065039 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-b7a85b11-4575-49b1-977c-82564acf13ba tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:18.071419 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b7a85b11-4575-49b1-977c-82564acf13ba tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:18.071869 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b7a85b11-4575-49b1-977c-82564acf13ba tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:18.072632 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b7a85b11-4575-49b1-977c-82564acf13ba tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:18.073069 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b7a85b11-4575-49b1-977c-82564acf13ba tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:18.102725 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-b7a85b11-4575-49b1-977c-82564acf13ba tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042500 Jul 11 11:36:18.103308 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 849/1706] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:18 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:18.422194 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-9b5486fe-6ce5-49f4-85f6-94dd85618305 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:18.422807 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-9b5486fe-6ce5-49f4-85f6-94dd85618305 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:18.428848 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9b5486fe-6ce5-49f4-85f6-94dd85618305 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:18.429293 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9b5486fe-6ce5-49f4-85f6-94dd85618305 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:18.430044 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9b5486fe-6ce5-49f4-85f6-94dd85618305 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:18.430474 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9b5486fe-6ce5-49f4-85f6-94dd85618305 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:18.557202 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-9b5486fe-6ce5-49f4-85f6-94dd85618305 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:36:18.565350 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-9b5486fe-6ce5-49f4-85f6-94dd85618305 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.146996 Jul 11 11:36:18.565905 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 858/1707] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:36:18 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:36:18.996574 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-f0a68f99-ee60-4114-af36-1654b94bbaf3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:18.997495 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-f0a68f99-ee60-4114-af36-1654b94bbaf3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:19.004072 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f0a68f99-ee60-4114-af36-1654b94bbaf3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:19.004561 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f0a68f99-ee60-4114-af36-1654b94bbaf3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:19.005318 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f0a68f99-ee60-4114-af36-1654b94bbaf3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:19.005756 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f0a68f99-ee60-4114-af36-1654b94bbaf3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:19.033694 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-f0a68f99-ee60-4114-af36-1654b94bbaf3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041169 Jul 11 11:36:19.034248 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 850/1708] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:18 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:19.114960 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-bfa27c05-73c9-4ae2-b6cf-0fdade86999e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:19.115900 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-bfa27c05-73c9-4ae2-b6cf-0fdade86999e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:19.122299 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bfa27c05-73c9-4ae2-b6cf-0fdade86999e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:19.122744 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bfa27c05-73c9-4ae2-b6cf-0fdade86999e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:19.123529 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bfa27c05-73c9-4ae2-b6cf-0fdade86999e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:19.123967 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bfa27c05-73c9-4ae2-b6cf-0fdade86999e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:19.152311 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-bfa27c05-73c9-4ae2-b6cf-0fdade86999e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041917 Jul 11 11:36:19.152907 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 859/1709] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:19 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:19.582028 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-6d10ecd1-37a0-47f4-8860-ce3dc0442664 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:19.582635 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-6d10ecd1-37a0-47f4-8860-ce3dc0442664 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:19.589213 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6d10ecd1-37a0-47f4-8860-ce3dc0442664 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:19.589665 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6d10ecd1-37a0-47f4-8860-ce3dc0442664 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:19.590421 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6d10ecd1-37a0-47f4-8860-ce3dc0442664 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:19.590854 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6d10ecd1-37a0-47f4-8860-ce3dc0442664 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:19.717694 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-6d10ecd1-37a0-47f4-8860-ce3dc0442664 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:36:19.726086 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-6d10ecd1-37a0-47f4-8860-ce3dc0442664 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.147871 Jul 11 11:36:19.726655 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 851/1710] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:36:19 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:36:20.045677 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-96f1495e-9fd1-420a-bc61-61886830c433 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:20.046693 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-96f1495e-9fd1-420a-bc61-61886830c433 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:20.052918 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-96f1495e-9fd1-420a-bc61-61886830c433 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:20.053374 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-96f1495e-9fd1-420a-bc61-61886830c433 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:20.054200 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-96f1495e-9fd1-420a-bc61-61886830c433 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:20.054643 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-96f1495e-9fd1-420a-bc61-61886830c433 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:20.085216 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-96f1495e-9fd1-420a-bc61-61886830c433 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043448 Jul 11 11:36:20.085814 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 860/1711] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:20 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:20.163776 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-d7321913-f61e-415d-ae62-a7e955cb4343 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:20.164698 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-d7321913-f61e-415d-ae62-a7e955cb4343 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:20.171178 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d7321913-f61e-415d-ae62-a7e955cb4343 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:20.171681 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d7321913-f61e-415d-ae62-a7e955cb4343 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:20.172438 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d7321913-f61e-415d-ae62-a7e955cb4343 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:20.172875 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d7321913-f61e-415d-ae62-a7e955cb4343 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:20.203506 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-d7321913-f61e-415d-ae62-a7e955cb4343 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043618 Jul 11 11:36:20.204129 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 852/1712] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:20 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:20.743755 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-7c5dbfa5-f090-473e-b72e-cb41b33164a7 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:20.744369 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-7c5dbfa5-f090-473e-b72e-cb41b33164a7 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:20.750754 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7c5dbfa5-f090-473e-b72e-cb41b33164a7 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:20.751202 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7c5dbfa5-f090-473e-b72e-cb41b33164a7 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:20.751986 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7c5dbfa5-f090-473e-b72e-cb41b33164a7 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:20.752419 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7c5dbfa5-f090-473e-b72e-cb41b33164a7 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:20.880855 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-7c5dbfa5-f090-473e-b72e-cb41b33164a7 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:36:20.888628 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-7c5dbfa5-f090-473e-b72e-cb41b33164a7 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.149319 Jul 11 11:36:20.889183 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 861/1713] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:36:20 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:36:21.096499 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-97ab171e-f5be-454c-bb66-70f54213882a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:21.097355 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-97ab171e-f5be-454c-bb66-70f54213882a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:21.103938 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-97ab171e-f5be-454c-bb66-70f54213882a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:21.104376 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-97ab171e-f5be-454c-bb66-70f54213882a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:21.105119 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-97ab171e-f5be-454c-bb66-70f54213882a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:21.105548 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-97ab171e-f5be-454c-bb66-70f54213882a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:21.134090 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-97ab171e-f5be-454c-bb66-70f54213882a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041565 Jul 11 11:36:21.134912 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 853/1714] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:21 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:21.214670 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-4876548e-a337-4fbd-a052-60f1b4c5acee tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:21.215620 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-4876548e-a337-4fbd-a052-60f1b4c5acee tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:21.221724 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4876548e-a337-4fbd-a052-60f1b4c5acee tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:21.222172 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4876548e-a337-4fbd-a052-60f1b4c5acee tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:21.222930 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4876548e-a337-4fbd-a052-60f1b4c5acee tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:21.223388 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4876548e-a337-4fbd-a052-60f1b4c5acee tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:21.252080 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-4876548e-a337-4fbd-a052-60f1b4c5acee tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041194 Jul 11 11:36:21.252506 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 862/1715] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:21 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:21.906286 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-8267d969-d8a2-407e-8a04-16cd6021c7c4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:21.907167 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-8267d969-d8a2-407e-8a04-16cd6021c7c4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:21.914681 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8267d969-d8a2-407e-8a04-16cd6021c7c4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:21.915133 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8267d969-d8a2-407e-8a04-16cd6021c7c4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:21.915919 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8267d969-d8a2-407e-8a04-16cd6021c7c4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:21.916361 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8267d969-d8a2-407e-8a04-16cd6021c7c4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:22.048806 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-8267d969-d8a2-407e-8a04-16cd6021c7c4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:36:22.056790 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-8267d969-d8a2-407e-8a04-16cd6021c7c4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.154733 Jul 11 11:36:22.057359 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 854/1716] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:36:21 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:36:22.145726 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-c7aca2f5-74f4-425c-831e-1e0613a01849 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:22.146644 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-c7aca2f5-74f4-425c-831e-1e0613a01849 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:22.152787 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c7aca2f5-74f4-425c-831e-1e0613a01849 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:22.153233 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c7aca2f5-74f4-425c-831e-1e0613a01849 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:22.153991 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c7aca2f5-74f4-425c-831e-1e0613a01849 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:22.154418 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c7aca2f5-74f4-425c-831e-1e0613a01849 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:22.183495 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-c7aca2f5-74f4-425c-831e-1e0613a01849 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041575 Jul 11 11:36:22.184032 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 863/1717] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:22 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:36:22.263156 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-b66fe001-b88c-40bb-bcd1-77d3c5ac89d4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:22.264093 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-b66fe001-b88c-40bb-bcd1-77d3c5ac89d4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:22.270032 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b66fe001-b88c-40bb-bcd1-77d3c5ac89d4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:22.270471 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b66fe001-b88c-40bb-bcd1-77d3c5ac89d4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:22.271223 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b66fe001-b88c-40bb-bcd1-77d3c5ac89d4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:22.271704 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b66fe001-b88c-40bb-bcd1-77d3c5ac89d4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:22.299692 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-b66fe001-b88c-40bb-bcd1-77d3c5ac89d4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040368 Jul 11 11:36:22.300225 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 855/1718] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:22 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:23.073798 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-72179b37-caee-4f65-8332-2613c94584aa tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:23.074413 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-72179b37-caee-4f65-8332-2613c94584aa tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:23.080646 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-72179b37-caee-4f65-8332-2613c94584aa tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:23.081100 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-72179b37-caee-4f65-8332-2613c94584aa tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:23.081864 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-72179b37-caee-4f65-8332-2613c94584aa tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:23.082300 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-72179b37-caee-4f65-8332-2613c94584aa tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:23.195006 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-554c0775-b765-44fb-837a-28fa7cea2aa6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:23.196420 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-554c0775-b765-44fb-837a-28fa7cea2aa6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:23.203271 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-554c0775-b765-44fb-837a-28fa7cea2aa6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:23.203745 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-554c0775-b765-44fb-837a-28fa7cea2aa6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:23.204512 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-554c0775-b765-44fb-837a-28fa7cea2aa6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:23.204950 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-554c0775-b765-44fb-837a-28fa7cea2aa6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:23.208479 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-72179b37-caee-4f65-8332-2613c94584aa tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:36:23.216622 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-72179b37-caee-4f65-8332-2613c94584aa tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.146650 Jul 11 11:36:23.217188 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 864/1719] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:36:23 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:36:23.234493 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-554c0775-b765-44fb-837a-28fa7cea2aa6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044323 Jul 11 11:36:23.237108 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 856/1720] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:23 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:36:23.311493 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-135394d1-ba42-4648-832f-e1dca47a0019 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:23.312414 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-135394d1-ba42-4648-832f-e1dca47a0019 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:23.319194 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-135394d1-ba42-4648-832f-e1dca47a0019 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:23.319667 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-135394d1-ba42-4648-832f-e1dca47a0019 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:23.320422 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-135394d1-ba42-4648-832f-e1dca47a0019 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:23.320857 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-135394d1-ba42-4648-832f-e1dca47a0019 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:23.324463 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=100 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:36:23.348836 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-135394d1-ba42-4648-832f-e1dca47a0019 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041315 Jul 11 11:36:23.349382 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 865/1721] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:23 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:24.237853 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-19cbd691-c678-44fe-9c49-02ebe2dce282 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:24.238388 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-19cbd691-c678-44fe-9c49-02ebe2dce282 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:24.244879 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-19cbd691-c678-44fe-9c49-02ebe2dce282 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:24.245325 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-19cbd691-c678-44fe-9c49-02ebe2dce282 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:24.246073 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-19cbd691-c678-44fe-9c49-02ebe2dce282 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:24.246503 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-19cbd691-c678-44fe-9c49-02ebe2dce282 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:24.248145 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-c64b54d1-5ded-49e9-b83c-a2320b490732 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:24.249067 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-c64b54d1-5ded-49e9-b83c-a2320b490732 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:24.256127 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c64b54d1-5ded-49e9-b83c-a2320b490732 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:24.256583 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c64b54d1-5ded-49e9-b83c-a2320b490732 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:24.257844 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c64b54d1-5ded-49e9-b83c-a2320b490732 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:24.257844 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c64b54d1-5ded-49e9-b83c-a2320b490732 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:24.288156 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-c64b54d1-5ded-49e9-b83c-a2320b490732 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044124 Jul 11 11:36:24.288737 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 866/1722] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:24 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:36:24.360411 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-962d7a16-10b1-457f-95be-db76c319b9ce tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:24.361341 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-962d7a16-10b1-457f-95be-db76c319b9ce tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:24.367358 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-962d7a16-10b1-457f-95be-db76c319b9ce tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:24.367813 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-962d7a16-10b1-457f-95be-db76c319b9ce tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:24.368582 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-962d7a16-10b1-457f-95be-db76c319b9ce tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:24.369021 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-962d7a16-10b1-457f-95be-db76c319b9ce tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:24.374403 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-19cbd691-c678-44fe-9c49-02ebe2dce282 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:36:24.382674 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-19cbd691-c678-44fe-9c49-02ebe2dce282 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.148701 Jul 11 11:36:24.383238 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 857/1723] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:36:24 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:36:24.398225 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-962d7a16-10b1-457f-95be-db76c319b9ce tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041720 Jul 11 11:36:24.398775 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 867/1724] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:24 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:36:25.299896 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-7ae2e114-9306-4266-975f-a2933257d3c9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:25.300816 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-7ae2e114-9306-4266-975f-a2933257d3c9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:25.307286 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7ae2e114-9306-4266-975f-a2933257d3c9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:25.307725 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7ae2e114-9306-4266-975f-a2933257d3c9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:25.308474 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7ae2e114-9306-4266-975f-a2933257d3c9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:25.308908 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7ae2e114-9306-4266-975f-a2933257d3c9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:25.338522 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-7ae2e114-9306-4266-975f-a2933257d3c9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042435 Jul 11 11:36:25.339007 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 858/1725] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:25 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:25.399453 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-5046f561-cd75-43c0-bb4e-86b342566b97 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:25.400059 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-5046f561-cd75-43c0-bb4e-86b342566b97 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:25.406394 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5046f561-cd75-43c0-bb4e-86b342566b97 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:25.406836 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5046f561-cd75-43c0-bb4e-86b342566b97 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:25.407613 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5046f561-cd75-43c0-bb4e-86b342566b97 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:25.408042 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5046f561-cd75-43c0-bb4e-86b342566b97 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:25.409768 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-cdd44810-2f2b-46b8-8082-5b84bffe2ce2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:25.410709 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-cdd44810-2f2b-46b8-8082-5b84bffe2ce2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:25.416967 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cdd44810-2f2b-46b8-8082-5b84bffe2ce2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:25.417418 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cdd44810-2f2b-46b8-8082-5b84bffe2ce2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:25.418199 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cdd44810-2f2b-46b8-8082-5b84bffe2ce2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:25.422621 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cdd44810-2f2b-46b8-8082-5b84bffe2ce2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:25.457334 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-cdd44810-2f2b-46b8-8082-5b84bffe2ce2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051332 Jul 11 11:36:25.458020 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 859/1726] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:25 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:36:25.559841 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-5046f561-cd75-43c0-bb4e-86b342566b97 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:36:25.568759 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-5046f561-cd75-43c0-bb4e-86b342566b97 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.172909 Jul 11 11:36:25.569325 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 868/1727] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:36:25 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:36:26.349465 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-98a8b460-51b0-4e0d-a3d9-81042207c9a8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:26.350319 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-98a8b460-51b0-4e0d-a3d9-81042207c9a8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:26.356780 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-98a8b460-51b0-4e0d-a3d9-81042207c9a8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:26.357235 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-98a8b460-51b0-4e0d-a3d9-81042207c9a8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:26.358007 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-98a8b460-51b0-4e0d-a3d9-81042207c9a8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:26.358451 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-98a8b460-51b0-4e0d-a3d9-81042207c9a8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:26.383908 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=100 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:36:26.388264 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-98a8b460-51b0-4e0d-a3d9-81042207c9a8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042920 Jul 11 11:36:26.388827 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 860/1728] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:26 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:26.468824 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-8bebacae-04c5-47d3-aed9-6d1671b07de4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:26.469770 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-8bebacae-04c5-47d3-aed9-6d1671b07de4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:26.476725 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8bebacae-04c5-47d3-aed9-6d1671b07de4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:26.477170 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8bebacae-04c5-47d3-aed9-6d1671b07de4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:26.477924 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8bebacae-04c5-47d3-aed9-6d1671b07de4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:26.478356 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8bebacae-04c5-47d3-aed9-6d1671b07de4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:26.506757 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-8bebacae-04c5-47d3-aed9-6d1671b07de4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041844 Jul 11 11:36:26.507322 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 869/1729] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:26 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:26.585412 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-e70af1ff-1503-4178-aa22-46af4e1cad9c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:26.586022 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-e70af1ff-1503-4178-aa22-46af4e1cad9c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:26.593133 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e70af1ff-1503-4178-aa22-46af4e1cad9c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:26.593579 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e70af1ff-1503-4178-aa22-46af4e1cad9c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:26.594347 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e70af1ff-1503-4178-aa22-46af4e1cad9c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:26.594782 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e70af1ff-1503-4178-aa22-46af4e1cad9c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:26.730353 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-e70af1ff-1503-4178-aa22-46af4e1cad9c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:36:26.738267 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-e70af1ff-1503-4178-aa22-46af4e1cad9c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.156669 Jul 11 11:36:26.738837 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 861/1730] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:36:26 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:36:27.400121 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-1934ed43-283f-4213-99f7-45dc75e97ae6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:27.401069 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-1934ed43-283f-4213-99f7-45dc75e97ae6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:27.407355 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1934ed43-283f-4213-99f7-45dc75e97ae6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:27.407800 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1934ed43-283f-4213-99f7-45dc75e97ae6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:27.408552 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1934ed43-283f-4213-99f7-45dc75e97ae6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:27.408981 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1934ed43-283f-4213-99f7-45dc75e97ae6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:27.438230 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-1934ed43-283f-4213-99f7-45dc75e97ae6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042185 Jul 11 11:36:27.438763 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 870/1731] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:27 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:27.518373 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-1e5ee60c-ffcf-477c-8d69-d48aa25ba7bb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:27.519430 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-1e5ee60c-ffcf-477c-8d69-d48aa25ba7bb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:27.525966 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1e5ee60c-ffcf-477c-8d69-d48aa25ba7bb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:27.526413 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1e5ee60c-ffcf-477c-8d69-d48aa25ba7bb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:27.527209 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1e5ee60c-ffcf-477c-8d69-d48aa25ba7bb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:27.527770 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1e5ee60c-ffcf-477c-8d69-d48aa25ba7bb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:27.558492 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-1e5ee60c-ffcf-477c-8d69-d48aa25ba7bb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044089 Jul 11 11:36:27.559054 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 862/1732] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:27 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:27.755962 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-f7bbecd6-5b32-4f08-8b1a-e2572813dee8 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:27.756547 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-f7bbecd6-5b32-4f08-8b1a-e2572813dee8 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:27.763208 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f7bbecd6-5b32-4f08-8b1a-e2572813dee8 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:27.763680 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f7bbecd6-5b32-4f08-8b1a-e2572813dee8 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:27.764436 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f7bbecd6-5b32-4f08-8b1a-e2572813dee8 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:27.764863 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f7bbecd6-5b32-4f08-8b1a-e2572813dee8 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:27.894507 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-f7bbecd6-5b32-4f08-8b1a-e2572813dee8 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:36:27.902793 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-f7bbecd6-5b32-4f08-8b1a-e2572813dee8 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.150815 Jul 11 11:36:27.904797 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 871/1733] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:36:27 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:36:28.450165 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-1c12cad8-b301-477a-8eb4-3c16a21b3a92 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:28.451090 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-1c12cad8-b301-477a-8eb4-3c16a21b3a92 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:28.457085 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1c12cad8-b301-477a-8eb4-3c16a21b3a92 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:28.457532 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1c12cad8-b301-477a-8eb4-3c16a21b3a92 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:28.458287 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1c12cad8-b301-477a-8eb4-3c16a21b3a92 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:28.458722 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1c12cad8-b301-477a-8eb4-3c16a21b3a92 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:28.486355 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-1c12cad8-b301-477a-8eb4-3c16a21b3a92 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040312 Jul 11 11:36:28.486898 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 863/1734] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:28 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:28.570704 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-db7c5600-eb81-4062-89f5-f8b5c84d2381 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:28.571679 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-db7c5600-eb81-4062-89f5-f8b5c84d2381 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:28.577776 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-db7c5600-eb81-4062-89f5-f8b5c84d2381 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:28.578226 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-db7c5600-eb81-4062-89f5-f8b5c84d2381 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:28.578986 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-db7c5600-eb81-4062-89f5-f8b5c84d2381 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:28.579463 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-db7c5600-eb81-4062-89f5-f8b5c84d2381 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:28.606865 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-db7c5600-eb81-4062-89f5-f8b5c84d2381 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040919 Jul 11 11:36:28.607437 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 872/1735] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:28 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:28.920651 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-4c0fd831-c679-4fb8-b487-8cbc04b21f31 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:28.921350 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-4c0fd831-c679-4fb8-b487-8cbc04b21f31 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:28.928540 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4c0fd831-c679-4fb8-b487-8cbc04b21f31 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:28.928983 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4c0fd831-c679-4fb8-b487-8cbc04b21f31 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:28.929731 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4c0fd831-c679-4fb8-b487-8cbc04b21f31 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:28.930156 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4c0fd831-c679-4fb8-b487-8cbc04b21f31 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:29.057615 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-4c0fd831-c679-4fb8-b487-8cbc04b21f31 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:36:29.065618 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-4c0fd831-c679-4fb8-b487-8cbc04b21f31 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.149225 Jul 11 11:36:29.066180 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 864/1736] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:36:28 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:36:29.498474 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-193de435-65b3-4405-aff8-78a12d5449ab tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:29.499445 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-193de435-65b3-4405-aff8-78a12d5449ab tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:29.506397 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-193de435-65b3-4405-aff8-78a12d5449ab tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:29.506851 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-193de435-65b3-4405-aff8-78a12d5449ab tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:29.507657 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-193de435-65b3-4405-aff8-78a12d5449ab tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:29.508084 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-193de435-65b3-4405-aff8-78a12d5449ab tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:29.536640 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-193de435-65b3-4405-aff8-78a12d5449ab tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042074 Jul 11 11:36:29.537185 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 873/1737] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:29 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:29.618211 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-5982e1bd-f25e-4e22-8387-3b143275edd6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:29.619131 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-5982e1bd-f25e-4e22-8387-3b143275edd6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:29.625119 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5982e1bd-f25e-4e22-8387-3b143275edd6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:29.625565 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5982e1bd-f25e-4e22-8387-3b143275edd6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:29.626313 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5982e1bd-f25e-4e22-8387-3b143275edd6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:29.626745 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5982e1bd-f25e-4e22-8387-3b143275edd6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:29.655382 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-5982e1bd-f25e-4e22-8387-3b143275edd6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041082 Jul 11 11:36:29.655920 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 865/1738] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:29 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:30.085564 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-bc432d95-764b-4d50-8dcb-3a63eadb62a3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:30.086164 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-bc432d95-764b-4d50-8dcb-3a63eadb62a3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:30.092540 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bc432d95-764b-4d50-8dcb-3a63eadb62a3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:30.093330 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bc432d95-764b-4d50-8dcb-3a63eadb62a3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:30.093720 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bc432d95-764b-4d50-8dcb-3a63eadb62a3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:30.094152 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bc432d95-764b-4d50-8dcb-3a63eadb62a3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:30.231406 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-bc432d95-764b-4d50-8dcb-3a63eadb62a3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:36:30.240203 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-bc432d95-764b-4d50-8dcb-3a63eadb62a3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.160156 Jul 11 11:36:30.240787 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 874/1739] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:36:30 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:36:30.548320 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-3f49fed0-a744-47a5-8794-f2e5e4f25e2c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:30.549262 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-3f49fed0-a744-47a5-8794-f2e5e4f25e2c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:30.556283 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3f49fed0-a744-47a5-8794-f2e5e4f25e2c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:30.556727 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3f49fed0-a744-47a5-8794-f2e5e4f25e2c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:30.557476 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3f49fed0-a744-47a5-8794-f2e5e4f25e2c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:30.557913 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3f49fed0-a744-47a5-8794-f2e5e4f25e2c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:30.586739 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-3f49fed0-a744-47a5-8794-f2e5e4f25e2c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042318 Jul 11 11:36:30.587321 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 866/1740] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:30 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:30.667330 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-3e632658-0d0f-46ac-b4d2-2dd0900c8a86 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:30.668244 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-3e632658-0d0f-46ac-b4d2-2dd0900c8a86 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:30.674539 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3e632658-0d0f-46ac-b4d2-2dd0900c8a86 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:30.674978 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3e632658-0d0f-46ac-b4d2-2dd0900c8a86 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:30.675771 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3e632658-0d0f-46ac-b4d2-2dd0900c8a86 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:30.676204 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3e632658-0d0f-46ac-b4d2-2dd0900c8a86 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:30.705994 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-3e632658-0d0f-46ac-b4d2-2dd0900c8a86 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042563 Jul 11 11:36:30.706735 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 875/1741] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:30 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:31.120633 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 11:36:31.120793 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Mon Jul 11 11:36:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 11:36:31.257745 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-9c6eb6db-6e79-4cc7-b0f7-23230afc2532 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:31.258352 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-9c6eb6db-6e79-4cc7-b0f7-23230afc2532 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:31.264300 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9c6eb6db-6e79-4cc7-b0f7-23230afc2532 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:31.264729 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9c6eb6db-6e79-4cc7-b0f7-23230afc2532 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:31.265475 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9c6eb6db-6e79-4cc7-b0f7-23230afc2532 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:31.265903 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9c6eb6db-6e79-4cc7-b0f7-23230afc2532 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:31.390713 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-9c6eb6db-6e79-4cc7-b0f7-23230afc2532 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:36:31.398745 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-9c6eb6db-6e79-4cc7-b0f7-23230afc2532 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.145528 Jul 11 11:36:31.399316 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 867/1742] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:36:31 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:36:31.598208 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-a19a2a9d-bd3e-4d1a-9f7e-cce59ea95ca6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:31.599050 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-a19a2a9d-bd3e-4d1a-9f7e-cce59ea95ca6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:31.605176 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a19a2a9d-bd3e-4d1a-9f7e-cce59ea95ca6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:31.605621 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a19a2a9d-bd3e-4d1a-9f7e-cce59ea95ca6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:31.606376 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a19a2a9d-bd3e-4d1a-9f7e-cce59ea95ca6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:31.606805 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a19a2a9d-bd3e-4d1a-9f7e-cce59ea95ca6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:31.635879 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-a19a2a9d-bd3e-4d1a-9f7e-cce59ea95ca6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041689 Jul 11 11:36:31.636419 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 876/1743] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:31 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:31.717756 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-8641ab10-2165-4d4e-8d33-743022cc96b5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:31.718691 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-8641ab10-2165-4d4e-8d33-743022cc96b5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:31.725796 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8641ab10-2165-4d4e-8d33-743022cc96b5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:31.726251 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8641ab10-2165-4d4e-8d33-743022cc96b5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:31.727007 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8641ab10-2165-4d4e-8d33-743022cc96b5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:31.727474 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8641ab10-2165-4d4e-8d33-743022cc96b5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:31.755931 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-8641ab10-2165-4d4e-8d33-743022cc96b5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042101 Jul 11 11:36:31.756476 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 868/1744] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:31 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:32.414363 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-bdab90e3-2224-4468-a09f-7721e3d029da tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:32.414974 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-bdab90e3-2224-4468-a09f-7721e3d029da tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:32.421390 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bdab90e3-2224-4468-a09f-7721e3d029da tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:32.421834 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bdab90e3-2224-4468-a09f-7721e3d029da tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:32.422587 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bdab90e3-2224-4468-a09f-7721e3d029da tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:32.423016 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bdab90e3-2224-4468-a09f-7721e3d029da tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:32.552294 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-bdab90e3-2224-4468-a09f-7721e3d029da tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:36:32.560470 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-bdab90e3-2224-4468-a09f-7721e3d029da tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.149945 Jul 11 11:36:32.561036 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 877/1745] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:36:32 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:36:32.647270 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-5e3e8eb4-2664-4908-b22f-9b689f2b49ac tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:32.648276 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-5e3e8eb4-2664-4908-b22f-9b689f2b49ac tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:32.654261 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5e3e8eb4-2664-4908-b22f-9b689f2b49ac tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:32.654706 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5e3e8eb4-2664-4908-b22f-9b689f2b49ac tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:32.655505 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5e3e8eb4-2664-4908-b22f-9b689f2b49ac tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:32.655945 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5e3e8eb4-2664-4908-b22f-9b689f2b49ac tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:32.684383 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-5e3e8eb4-2664-4908-b22f-9b689f2b49ac tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041024 Jul 11 11:36:32.684867 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 869/1746] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:32 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:32.767311 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-8141cda7-0014-44fa-b667-6900c23171a0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:32.768274 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-8141cda7-0014-44fa-b667-6900c23171a0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:32.774201 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8141cda7-0014-44fa-b667-6900c23171a0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:32.774652 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8141cda7-0014-44fa-b667-6900c23171a0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:32.775446 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8141cda7-0014-44fa-b667-6900c23171a0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:32.775885 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8141cda7-0014-44fa-b667-6900c23171a0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:32.804763 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-8141cda7-0014-44fa-b667-6900c23171a0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041472 Jul 11 11:36:32.805312 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 878/1747] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:32 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:33.576917 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-25ecf2f2-8002-483a-b2c5-ebeb67683ab5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:33.577528 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-25ecf2f2-8002-483a-b2c5-ebeb67683ab5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:33.584900 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-25ecf2f2-8002-483a-b2c5-ebeb67683ab5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:33.585347 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-25ecf2f2-8002-483a-b2c5-ebeb67683ab5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:33.586104 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-25ecf2f2-8002-483a-b2c5-ebeb67683ab5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:33.586544 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-25ecf2f2-8002-483a-b2c5-ebeb67683ab5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:33.696783 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-3b4ef301-db86-46d8-b262-8b91b941a535 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:33.697702 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-3b4ef301-db86-46d8-b262-8b91b941a535 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:33.704106 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3b4ef301-db86-46d8-b262-8b91b941a535 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:33.704547 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3b4ef301-db86-46d8-b262-8b91b941a535 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:33.705300 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3b4ef301-db86-46d8-b262-8b91b941a535 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:33.705725 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3b4ef301-db86-46d8-b262-8b91b941a535 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:33.717250 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-25ecf2f2-8002-483a-b2c5-ebeb67683ab5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:36:33.725156 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-25ecf2f2-8002-483a-b2c5-ebeb67683ab5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.152108 Jul 11 11:36:33.725734 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 870/1748] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:36:33 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:36:33.734563 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-3b4ef301-db86-46d8-b262-8b91b941a535 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042499 Jul 11 11:36:33.735161 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 879/1749] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:33 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:36:33.815285 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-5df55994-3d60-48d2-981f-b5a85427ad99 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:33.816191 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-5df55994-3d60-48d2-981f-b5a85427ad99 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:33.822891 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5df55994-3d60-48d2-981f-b5a85427ad99 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:33.823378 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5df55994-3d60-48d2-981f-b5a85427ad99 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:33.824133 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5df55994-3d60-48d2-981f-b5a85427ad99 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:33.824563 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5df55994-3d60-48d2-981f-b5a85427ad99 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:33.853149 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-5df55994-3d60-48d2-981f-b5a85427ad99 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041890 Jul 11 11:36:33.853656 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 871/1750] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:33 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:34.742290 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-9a8dcce3-0a00-4690-ad01-fd03ef0bd576 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:34.743603 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-9a8dcce3-0a00-4690-ad01-fd03ef0bd576 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:34.747880 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-20d5ba40-50f2-4b3f-bd98-8732bf61aa82 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:34.749056 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-20d5ba40-50f2-4b3f-bd98-8732bf61aa82 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:34.750319 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9a8dcce3-0a00-4690-ad01-fd03ef0bd576 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:34.750853 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9a8dcce3-0a00-4690-ad01-fd03ef0bd576 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:34.751720 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9a8dcce3-0a00-4690-ad01-fd03ef0bd576 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:34.752158 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9a8dcce3-0a00-4690-ad01-fd03ef0bd576 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:34.757743 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-20d5ba40-50f2-4b3f-bd98-8732bf61aa82 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:34.758236 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-20d5ba40-50f2-4b3f-bd98-8732bf61aa82 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:34.759054 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-20d5ba40-50f2-4b3f-bd98-8732bf61aa82 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:34.759612 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-20d5ba40-50f2-4b3f-bd98-8732bf61aa82 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:34.796068 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-20d5ba40-50f2-4b3f-bd98-8732bf61aa82 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053589 Jul 11 11:36:34.796868 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 872/1751] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:34 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:34.865223 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-1ce18d02-ba88-4a8a-887e-1e5c24181c3f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:34.866466 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-1ce18d02-ba88-4a8a-887e-1e5c24181c3f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:34.873059 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1ce18d02-ba88-4a8a-887e-1e5c24181c3f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:34.873587 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1ce18d02-ba88-4a8a-887e-1e5c24181c3f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:34.874364 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1ce18d02-ba88-4a8a-887e-1e5c24181c3f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:34.874803 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1ce18d02-ba88-4a8a-887e-1e5c24181c3f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:34.882171 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-9a8dcce3-0a00-4690-ad01-fd03ef0bd576 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:36:34.889971 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-9a8dcce3-0a00-4690-ad01-fd03ef0bd576 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.151838 Jul 11 11:36:34.890539 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 880/1752] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:36:34 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:36:34.904853 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-1ce18d02-ba88-4a8a-887e-1e5c24181c3f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044152 Jul 11 11:36:34.905405 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 873/1753] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:34 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:36:35.812194 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-0bfc09cf-cbd3-45f4-997e-966a5d654af2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:35.813109 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-0bfc09cf-cbd3-45f4-997e-966a5d654af2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:35.820622 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0bfc09cf-cbd3-45f4-997e-966a5d654af2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:35.821066 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0bfc09cf-cbd3-45f4-997e-966a5d654af2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:35.821827 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0bfc09cf-cbd3-45f4-997e-966a5d654af2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:35.822255 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0bfc09cf-cbd3-45f4-997e-966a5d654af2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:35.846960 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=100 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:36:35.851445 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-0bfc09cf-cbd3-45f4-997e-966a5d654af2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047334 Jul 11 11:36:35.851998 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 881/1754] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:35 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:35.907380 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-2e8ee364-05ab-45db-a1f4-e496e641b76b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:35.908103 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-2e8ee364-05ab-45db-a1f4-e496e641b76b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:35.914847 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2e8ee364-05ab-45db-a1f4-e496e641b76b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:35.915330 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2e8ee364-05ab-45db-a1f4-e496e641b76b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:35.916100 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2e8ee364-05ab-45db-a1f4-e496e641b76b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:35.916207 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-5b370f69-102e-4318-bb4b-aeb1b0822f3f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:35.916543 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2e8ee364-05ab-45db-a1f4-e496e641b76b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:35.917105 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-5b370f69-102e-4318-bb4b-aeb1b0822f3f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:35.923501 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5b370f69-102e-4318-bb4b-aeb1b0822f3f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:35.923952 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5b370f69-102e-4318-bb4b-aeb1b0822f3f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:35.924714 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5b370f69-102e-4318-bb4b-aeb1b0822f3f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:35.925264 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5b370f69-102e-4318-bb4b-aeb1b0822f3f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:35.954973 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-5b370f69-102e-4318-bb4b-aeb1b0822f3f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042776 Jul 11 11:36:35.955573 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 882/1755] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:35 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:36:36.045613 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-2e8ee364-05ab-45db-a1f4-e496e641b76b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:36:36.060216 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-2e8ee364-05ab-45db-a1f4-e496e641b76b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.156621 Jul 11 11:36:36.060894 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 874/1756] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:36:35 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:36:36.863003 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-4f0d9237-c15e-4590-8cc5-cd576b311811 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:36.864449 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-4f0d9237-c15e-4590-8cc5-cd576b311811 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:36.870882 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4f0d9237-c15e-4590-8cc5-cd576b311811 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:36.871431 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4f0d9237-c15e-4590-8cc5-cd576b311811 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:36.872194 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4f0d9237-c15e-4590-8cc5-cd576b311811 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:36.872628 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4f0d9237-c15e-4590-8cc5-cd576b311811 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:36.901784 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-4f0d9237-c15e-4590-8cc5-cd576b311811 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042723 Jul 11 11:36:36.902346 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 883/1757] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:36 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:36.966456 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-146c4378-15ba-45e1-8d3b-7c4dedd373a1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:36.967546 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-146c4378-15ba-45e1-8d3b-7c4dedd373a1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:36.974507 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-146c4378-15ba-45e1-8d3b-7c4dedd373a1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:36.974957 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-146c4378-15ba-45e1-8d3b-7c4dedd373a1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:36.975754 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-146c4378-15ba-45e1-8d3b-7c4dedd373a1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:36.976191 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-146c4378-15ba-45e1-8d3b-7c4dedd373a1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:37.004427 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-146c4378-15ba-45e1-8d3b-7c4dedd373a1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041907 Jul 11 11:36:37.010334 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 875/1758] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:36 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:37.077892 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-55f324be-8cb7-459f-9e68-8dd710f8b614 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:37.078583 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-55f324be-8cb7-459f-9e68-8dd710f8b614 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:37.084629 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-55f324be-8cb7-459f-9e68-8dd710f8b614 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:37.085084 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-55f324be-8cb7-459f-9e68-8dd710f8b614 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:37.085828 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-55f324be-8cb7-459f-9e68-8dd710f8b614 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:37.086260 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-55f324be-8cb7-459f-9e68-8dd710f8b614 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:37.213172 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-55f324be-8cb7-459f-9e68-8dd710f8b614 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:36:37.220958 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-55f324be-8cb7-459f-9e68-8dd710f8b614 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.147021 Jul 11 11:36:37.221521 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 884/1759] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:36:37 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:36:37.913901 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-4651431d-26f5-4473-92b2-d10b522d14e8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:37.914828 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-4651431d-26f5-4473-92b2-d10b522d14e8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:37.920866 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4651431d-26f5-4473-92b2-d10b522d14e8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:37.921316 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4651431d-26f5-4473-92b2-d10b522d14e8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:37.922075 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4651431d-26f5-4473-92b2-d10b522d14e8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:37.922514 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4651431d-26f5-4473-92b2-d10b522d14e8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:37.951093 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-4651431d-26f5-4473-92b2-d10b522d14e8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041692 Jul 11 11:36:37.951679 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 876/1760] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:37 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:38.019963 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-07d0e3a7-05c8-47f8-be71-ff983916c5d6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:38.056914 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-07d0e3a7-05c8-47f8-be71-ff983916c5d6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:38.056914 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-07d0e3a7-05c8-47f8-be71-ff983916c5d6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:38.056914 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-07d0e3a7-05c8-47f8-be71-ff983916c5d6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:38.056914 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-07d0e3a7-05c8-47f8-be71-ff983916c5d6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:38.057297 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-07d0e3a7-05c8-47f8-be71-ff983916c5d6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:38.059881 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-07d0e3a7-05c8-47f8-be71-ff983916c5d6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043805 Jul 11 11:36:38.060440 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 885/1761] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:38 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:38.238776 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-72a7fad2-0d00-429f-ae6f-15fae0ed2455 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:38.239548 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-72a7fad2-0d00-429f-ae6f-15fae0ed2455 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:38.246500 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-72a7fad2-0d00-429f-ae6f-15fae0ed2455 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:38.246946 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-72a7fad2-0d00-429f-ae6f-15fae0ed2455 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:38.247847 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-72a7fad2-0d00-429f-ae6f-15fae0ed2455 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:38.248351 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-72a7fad2-0d00-429f-ae6f-15fae0ed2455 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:38.263204 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=100 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:36:38.378308 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-72a7fad2-0d00-429f-ae6f-15fae0ed2455 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:36:38.386056 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-72a7fad2-0d00-429f-ae6f-15fae0ed2455 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.151385 Jul 11 11:36:38.386615 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 877/1762] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:36:38 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:36:38.962578 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-df8eb34a-729b-4c5a-85a7-6f5894197f0c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:38.963513 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-df8eb34a-729b-4c5a-85a7-6f5894197f0c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:38.969542 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-df8eb34a-729b-4c5a-85a7-6f5894197f0c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:38.969980 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-df8eb34a-729b-4c5a-85a7-6f5894197f0c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:38.970756 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-df8eb34a-729b-4c5a-85a7-6f5894197f0c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:38.971183 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-df8eb34a-729b-4c5a-85a7-6f5894197f0c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:38.999681 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-df8eb34a-729b-4c5a-85a7-6f5894197f0c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041099 Jul 11 11:36:39.000224 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 886/1763] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:38 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:39.072161 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-8f9045d9-ad15-4e79-82db-9ca3994c39cc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:39.073082 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-8f9045d9-ad15-4e79-82db-9ca3994c39cc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:39.079316 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8f9045d9-ad15-4e79-82db-9ca3994c39cc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:39.079773 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8f9045d9-ad15-4e79-82db-9ca3994c39cc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:39.080537 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8f9045d9-ad15-4e79-82db-9ca3994c39cc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:39.080973 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8f9045d9-ad15-4e79-82db-9ca3994c39cc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:39.109207 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-8f9045d9-ad15-4e79-82db-9ca3994c39cc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041860 Jul 11 11:36:39.109758 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 878/1764] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:39 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:39.403420 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-a5d0d05b-2f0a-4d1c-a14d-fb3ac756e5ec tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:39.404063 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-a5d0d05b-2f0a-4d1c-a14d-fb3ac756e5ec tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:39.410464 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a5d0d05b-2f0a-4d1c-a14d-fb3ac756e5ec tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:39.410916 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a5d0d05b-2f0a-4d1c-a14d-fb3ac756e5ec tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:39.412202 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a5d0d05b-2f0a-4d1c-a14d-fb3ac756e5ec tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:39.412638 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a5d0d05b-2f0a-4d1c-a14d-fb3ac756e5ec tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:39.545903 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-a5d0d05b-2f0a-4d1c-a14d-fb3ac756e5ec tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:36:39.556219 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-a5d0d05b-2f0a-4d1c-a14d-fb3ac756e5ec tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.156699 Jul 11 11:36:39.556793 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 887/1765] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:36:39 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:36:40.011870 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-178f9e29-aab2-46a8-9eb9-b715398aee32 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:40.012784 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-178f9e29-aab2-46a8-9eb9-b715398aee32 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:40.018714 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-178f9e29-aab2-46a8-9eb9-b715398aee32 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:40.019157 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-178f9e29-aab2-46a8-9eb9-b715398aee32 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:40.019944 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-178f9e29-aab2-46a8-9eb9-b715398aee32 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:40.020377 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-178f9e29-aab2-46a8-9eb9-b715398aee32 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:40.048725 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-178f9e29-aab2-46a8-9eb9-b715398aee32 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040941 Jul 11 11:36:40.049269 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 879/1766] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:40 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:40.120631 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-89714b75-2bf3-4bdf-a4f9-15ca9cf8f95e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:40.121539 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-89714b75-2bf3-4bdf-a4f9-15ca9cf8f95e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:40.127542 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-89714b75-2bf3-4bdf-a4f9-15ca9cf8f95e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:40.127989 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-89714b75-2bf3-4bdf-a4f9-15ca9cf8f95e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:40.128763 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-89714b75-2bf3-4bdf-a4f9-15ca9cf8f95e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:40.129193 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-89714b75-2bf3-4bdf-a4f9-15ca9cf8f95e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:40.157699 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-89714b75-2bf3-4bdf-a4f9-15ca9cf8f95e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040998 Jul 11 11:36:40.158234 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 888/1767] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:40 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:40.583973 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-ce473392-903d-4bd6-b985-4935262a7959 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:40.584624 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-ce473392-903d-4bd6-b985-4935262a7959 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:40.590615 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ce473392-903d-4bd6-b985-4935262a7959 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:40.591065 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ce473392-903d-4bd6-b985-4935262a7959 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:40.591879 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ce473392-903d-4bd6-b985-4935262a7959 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:40.592320 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ce473392-903d-4bd6-b985-4935262a7959 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:40.717362 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-ce473392-903d-4bd6-b985-4935262a7959 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:36:40.725689 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-ce473392-903d-4bd6-b985-4935262a7959 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.145666 Jul 11 11:36:40.726253 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 880/1768] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:36:40 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:36:41.060687 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-951f3880-1624-4944-bfe6-ccd4ef57f143 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:41.061609 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-951f3880-1624-4944-bfe6-ccd4ef57f143 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:41.064049 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_api:SELECT=86 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:36:41.069145 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-951f3880-1624-4944-bfe6-ccd4ef57f143 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:41.069592 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-951f3880-1624-4944-bfe6-ccd4ef57f143 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:41.070403 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-951f3880-1624-4944-bfe6-ccd4ef57f143 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:41.070841 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-951f3880-1624-4944-bfe6-ccd4ef57f143 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:41.101311 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-951f3880-1624-4944-bfe6-ccd4ef57f143 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044770 Jul 11 11:36:41.101860 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 889/1769] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:41 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:41.169530 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-39b28cc1-19bf-469f-a3f6-a2610d2f11fe tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:41.170477 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-39b28cc1-19bf-469f-a3f6-a2610d2f11fe tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:41.176882 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-39b28cc1-19bf-469f-a3f6-a2610d2f11fe tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:41.177335 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-39b28cc1-19bf-469f-a3f6-a2610d2f11fe tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:41.178091 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-39b28cc1-19bf-469f-a3f6-a2610d2f11fe tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:41.178528 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-39b28cc1-19bf-469f-a3f6-a2610d2f11fe tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:41.207221 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-39b28cc1-19bf-469f-a3f6-a2610d2f11fe tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041566 Jul 11 11:36:41.207854 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 881/1770] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:41 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:41.742672 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-9321ab20-531d-4e1a-acad-5f2185c952e2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:41.743294 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-9321ab20-531d-4e1a-acad-5f2185c952e2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:41.749254 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9321ab20-531d-4e1a-acad-5f2185c952e2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:41.749695 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9321ab20-531d-4e1a-acad-5f2185c952e2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:41.750440 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9321ab20-531d-4e1a-acad-5f2185c952e2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:41.750888 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9321ab20-531d-4e1a-acad-5f2185c952e2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:41.875062 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-9321ab20-531d-4e1a-acad-5f2185c952e2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:36:41.887970 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-9321ab20-531d-4e1a-acad-5f2185c952e2 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.144710 Jul 11 11:36:41.887970 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 890/1771] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:36:41 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:36:42.112797 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-382029b9-7b58-4977-b846-4f665b5c4625 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:42.113716 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-382029b9-7b58-4977-b846-4f665b5c4625 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:42.120288 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-382029b9-7b58-4977-b846-4f665b5c4625 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:42.120729 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-382029b9-7b58-4977-b846-4f665b5c4625 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:42.121475 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-382029b9-7b58-4977-b846-4f665b5c4625 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:42.121903 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-382029b9-7b58-4977-b846-4f665b5c4625 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:42.151091 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-382029b9-7b58-4977-b846-4f665b5c4625 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042178 Jul 11 11:36:42.151595 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 882/1772] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:42 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:42.219260 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-ae1326d3-2f16-4587-89dd-d72d827c9e07 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:42.220207 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-ae1326d3-2f16-4587-89dd-d72d827c9e07 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:42.227033 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ae1326d3-2f16-4587-89dd-d72d827c9e07 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:42.227504 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ae1326d3-2f16-4587-89dd-d72d827c9e07 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:42.228275 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ae1326d3-2f16-4587-89dd-d72d827c9e07 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:42.228706 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ae1326d3-2f16-4587-89dd-d72d827c9e07 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:42.256983 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-ae1326d3-2f16-4587-89dd-d72d827c9e07 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041649 Jul 11 11:36:42.257524 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 891/1773] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:42 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:42.903159 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-2373f8ac-b7de-4f71-9d5f-185c0bd622d3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:42.903799 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-2373f8ac-b7de-4f71-9d5f-185c0bd622d3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:42.910211 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2373f8ac-b7de-4f71-9d5f-185c0bd622d3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:42.910658 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2373f8ac-b7de-4f71-9d5f-185c0bd622d3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:42.911456 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2373f8ac-b7de-4f71-9d5f-185c0bd622d3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:42.911894 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2373f8ac-b7de-4f71-9d5f-185c0bd622d3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:43.040831 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-2373f8ac-b7de-4f71-9d5f-185c0bd622d3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:36:43.048705 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-2373f8ac-b7de-4f71-9d5f-185c0bd622d3 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.149434 Jul 11 11:36:43.049647 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 883/1774] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:36:42 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:36:43.162354 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-a8bf048d-212e-4a78-a187-39b4f7f27395 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:43.163275 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-a8bf048d-212e-4a78-a187-39b4f7f27395 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:43.169355 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a8bf048d-212e-4a78-a187-39b4f7f27395 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:43.169794 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a8bf048d-212e-4a78-a187-39b4f7f27395 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:43.170541 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a8bf048d-212e-4a78-a187-39b4f7f27395 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:43.170971 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a8bf048d-212e-4a78-a187-39b4f7f27395 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:43.199199 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-a8bf048d-212e-4a78-a187-39b4f7f27395 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040732 Jul 11 11:36:43.199767 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 892/1775] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:43 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:43.268514 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-772d4213-8384-4e22-ad22-2263ab24b61d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:43.269394 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-772d4213-8384-4e22-ad22-2263ab24b61d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:43.275905 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-772d4213-8384-4e22-ad22-2263ab24b61d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:43.276355 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-772d4213-8384-4e22-ad22-2263ab24b61d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:43.277115 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-772d4213-8384-4e22-ad22-2263ab24b61d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:43.277552 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-772d4213-8384-4e22-ad22-2263ab24b61d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:43.305869 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-772d4213-8384-4e22-ad22-2263ab24b61d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041473 Jul 11 11:36:43.306416 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 884/1776] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:43 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:44.065236 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-7c9bd30c-ed17-4cb0-9cc8-d2608249ecff tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:44.065847 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-7c9bd30c-ed17-4cb0-9cc8-d2608249ecff tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:44.072652 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7c9bd30c-ed17-4cb0-9cc8-d2608249ecff tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:44.073095 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7c9bd30c-ed17-4cb0-9cc8-d2608249ecff tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:44.073848 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7c9bd30c-ed17-4cb0-9cc8-d2608249ecff tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:44.074277 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7c9bd30c-ed17-4cb0-9cc8-d2608249ecff tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:44.204456 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-7c9bd30c-ed17-4cb0-9cc8-d2608249ecff tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:36:44.210578 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-e0fa5651-c801-448a-892a-3580eaad7266 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:44.211621 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-e0fa5651-c801-448a-892a-3580eaad7266 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:44.213136 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-7c9bd30c-ed17-4cb0-9cc8-d2608249ecff tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.151612 Jul 11 11:36:44.213872 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 893/1777] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:36:44 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:36:44.218521 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e0fa5651-c801-448a-892a-3580eaad7266 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:44.218964 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e0fa5651-c801-448a-892a-3580eaad7266 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:44.219751 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e0fa5651-c801-448a-892a-3580eaad7266 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:44.220180 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e0fa5651-c801-448a-892a-3580eaad7266 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:44.248587 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-e0fa5651-c801-448a-892a-3580eaad7266 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042408 Jul 11 11:36:44.249063 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 885/1778] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:44 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:36:44.316896 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-f9685837-bacb-4053-9235-ae6c6bfb3739 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:44.317803 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-f9685837-bacb-4053-9235-ae6c6bfb3739 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:44.323959 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f9685837-bacb-4053-9235-ae6c6bfb3739 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:44.324400 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f9685837-bacb-4053-9235-ae6c6bfb3739 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:44.325149 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f9685837-bacb-4053-9235-ae6c6bfb3739 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:44.325575 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f9685837-bacb-4053-9235-ae6c6bfb3739 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:44.354172 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-f9685837-bacb-4053-9235-ae6c6bfb3739 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041172 Jul 11 11:36:44.354714 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 894/1779] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:44 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:45.230324 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-a2ec803b-9448-481f-bbeb-4803f8dd1b2c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:45.230928 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-a2ec803b-9448-481f-bbeb-4803f8dd1b2c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:45.233241 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_api:SELECT=86 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:36:45.237954 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a2ec803b-9448-481f-bbeb-4803f8dd1b2c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:45.238403 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a2ec803b-9448-481f-bbeb-4803f8dd1b2c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:45.239160 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a2ec803b-9448-481f-bbeb-4803f8dd1b2c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:45.239618 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a2ec803b-9448-481f-bbeb-4803f8dd1b2c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:45.260085 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-16b866e6-a0c4-4189-825b-20c356f3dafc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:45.261065 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-16b866e6-a0c4-4189-825b-20c356f3dafc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:45.267591 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-16b866e6-a0c4-4189-825b-20c356f3dafc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:45.268044 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-16b866e6-a0c4-4189-825b-20c356f3dafc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:45.268812 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-16b866e6-a0c4-4189-825b-20c356f3dafc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:45.269247 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-16b866e6-a0c4-4189-825b-20c356f3dafc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:45.299480 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-16b866e6-a0c4-4189-825b-20c356f3dafc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043263 Jul 11 11:36:45.300055 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 895/1780] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:45 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:45.366202 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-a2ec803b-9448-481f-bbeb-4803f8dd1b2c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:36:45.366533 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-da5b1c70-f74b-46de-ace2-06997d0440ac tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:45.367388 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-da5b1c70-f74b-46de-ace2-06997d0440ac tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:45.373514 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-da5b1c70-f74b-46de-ace2-06997d0440ac tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:45.373964 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-da5b1c70-f74b-46de-ace2-06997d0440ac tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:45.374194 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-a2ec803b-9448-481f-bbeb-4803f8dd1b2c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.147698 Jul 11 11:36:45.374730 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-da5b1c70-f74b-46de-ace2-06997d0440ac tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:45.374846 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 886/1781] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:36:45 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:36:45.375165 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-da5b1c70-f74b-46de-ace2-06997d0440ac tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:45.403233 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-da5b1c70-f74b-46de-ace2-06997d0440ac tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041446 Jul 11 11:36:45.403799 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 896/1782] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:45 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:36:46.311599 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-e98b7f14-c5e7-4411-96e7-6e39f6f9cc7c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:46.313198 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-e98b7f14-c5e7-4411-96e7-6e39f6f9cc7c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:46.320522 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e98b7f14-c5e7-4411-96e7-6e39f6f9cc7c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:46.320975 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e98b7f14-c5e7-4411-96e7-6e39f6f9cc7c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:46.321744 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e98b7f14-c5e7-4411-96e7-6e39f6f9cc7c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:46.322183 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e98b7f14-c5e7-4411-96e7-6e39f6f9cc7c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:46.350054 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-e98b7f14-c5e7-4411-96e7-6e39f6f9cc7c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042402 Jul 11 11:36:46.350611 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 887/1783] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:46 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:46.391100 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-b905283f-2850-4e31-847e-5cea9875373c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:46.391831 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-b905283f-2850-4e31-847e-5cea9875373c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:46.398334 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b905283f-2850-4e31-847e-5cea9875373c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:46.398779 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b905283f-2850-4e31-847e-5cea9875373c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:46.399565 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b905283f-2850-4e31-847e-5cea9875373c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:46.399998 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b905283f-2850-4e31-847e-5cea9875373c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:46.413958 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-bcde36ae-af49-4ba6-bcb1-aa3daa654b7a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:46.414870 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-bcde36ae-af49-4ba6-bcb1-aa3daa654b7a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:46.420800 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-bcde36ae-af49-4ba6-bcb1-aa3daa654b7a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:46.421244 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-bcde36ae-af49-4ba6-bcb1-aa3daa654b7a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:46.421997 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-bcde36ae-af49-4ba6-bcb1-aa3daa654b7a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:46.422428 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-bcde36ae-af49-4ba6-bcb1-aa3daa654b7a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:46.452524 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-bcde36ae-af49-4ba6-bcb1-aa3daa654b7a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042425 Jul 11 11:36:46.453085 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 888/1784] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:46 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:36:46.526678 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-b905283f-2850-4e31-847e-5cea9875373c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:36:46.534494 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-b905283f-2850-4e31-847e-5cea9875373c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.147246 Jul 11 11:36:46.535048 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 897/1785] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:36:46 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:36:47.361614 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-30592157-eeee-4408-b515-8bc606fbf170 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:47.362528 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-30592157-eeee-4408-b515-8bc606fbf170 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:47.369467 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-30592157-eeee-4408-b515-8bc606fbf170 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:47.369912 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-30592157-eeee-4408-b515-8bc606fbf170 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:47.370668 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-30592157-eeee-4408-b515-8bc606fbf170 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:47.371099 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-30592157-eeee-4408-b515-8bc606fbf170 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:47.399095 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-30592157-eeee-4408-b515-8bc606fbf170 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041420 Jul 11 11:36:47.399806 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 889/1786] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:47 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:47.464191 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-31f63025-8655-41a5-9e72-992710cd3397 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:47.465113 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-31f63025-8655-41a5-9e72-992710cd3397 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:47.471549 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-31f63025-8655-41a5-9e72-992710cd3397 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:47.471998 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-31f63025-8655-41a5-9e72-992710cd3397 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:47.472781 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-31f63025-8655-41a5-9e72-992710cd3397 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:47.473243 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-31f63025-8655-41a5-9e72-992710cd3397 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:47.489543 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=100 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:36:47.504450 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-31f63025-8655-41a5-9e72-992710cd3397 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044168 Jul 11 11:36:47.505007 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 898/1787] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:47 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:47.551134 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-844fc579-4241-4128-973a-ad28e02f2c2f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:47.551775 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-844fc579-4241-4128-973a-ad28e02f2c2f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:47.558471 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-844fc579-4241-4128-973a-ad28e02f2c2f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:47.558914 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-844fc579-4241-4128-973a-ad28e02f2c2f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:47.559756 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-844fc579-4241-4128-973a-ad28e02f2c2f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:47.560187 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-844fc579-4241-4128-973a-ad28e02f2c2f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:47.692154 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-844fc579-4241-4128-973a-ad28e02f2c2f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:36:47.700402 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-844fc579-4241-4128-973a-ad28e02f2c2f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.153030 Jul 11 11:36:47.701057 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 890/1788] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:36:47 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:36:48.411191 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-14cba9d4-4db7-4ff4-a9b4-7da8038bc48a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:48.412130 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-14cba9d4-4db7-4ff4-a9b4-7da8038bc48a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:48.418232 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-14cba9d4-4db7-4ff4-a9b4-7da8038bc48a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:48.418682 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-14cba9d4-4db7-4ff4-a9b4-7da8038bc48a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:48.419467 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-14cba9d4-4db7-4ff4-a9b4-7da8038bc48a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:48.419904 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-14cba9d4-4db7-4ff4-a9b4-7da8038bc48a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:48.448108 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-14cba9d4-4db7-4ff4-a9b4-7da8038bc48a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041394 Jul 11 11:36:48.448646 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 899/1789] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:48 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:48.522524 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-ceab82d6-e8e6-48e1-8653-aa85d4151318 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:48.523461 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-ceab82d6-e8e6-48e1-8653-aa85d4151318 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:48.529876 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ceab82d6-e8e6-48e1-8653-aa85d4151318 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:48.530324 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ceab82d6-e8e6-48e1-8653-aa85d4151318 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:48.531073 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ceab82d6-e8e6-48e1-8653-aa85d4151318 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:48.531540 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ceab82d6-e8e6-48e1-8653-aa85d4151318 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:48.561031 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-ceab82d6-e8e6-48e1-8653-aa85d4151318 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043054 Jul 11 11:36:48.561577 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 891/1790] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:48 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:48.716900 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-3ea67501-c320-465c-af75-a1eecc00847e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:48.717507 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-3ea67501-c320-465c-af75-a1eecc00847e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:48.723985 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3ea67501-c320-465c-af75-a1eecc00847e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:48.724433 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3ea67501-c320-465c-af75-a1eecc00847e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:48.725216 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3ea67501-c320-465c-af75-a1eecc00847e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:48.725673 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3ea67501-c320-465c-af75-a1eecc00847e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:48.853960 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-3ea67501-c320-465c-af75-a1eecc00847e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:36:48.861730 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-3ea67501-c320-465c-af75-a1eecc00847e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.148775 Jul 11 11:36:48.862289 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 900/1791] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:36:48 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:36:49.458835 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-90010ac4-15ef-44f9-bd16-e62024d10169 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:49.459785 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-90010ac4-15ef-44f9-bd16-e62024d10169 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:49.465882 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-90010ac4-15ef-44f9-bd16-e62024d10169 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:49.466332 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-90010ac4-15ef-44f9-bd16-e62024d10169 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:49.467084 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-90010ac4-15ef-44f9-bd16-e62024d10169 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:49.467551 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-90010ac4-15ef-44f9-bd16-e62024d10169 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:49.497556 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-90010ac4-15ef-44f9-bd16-e62024d10169 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042719 Jul 11 11:36:49.498103 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 892/1792] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:49 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:49.572706 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-ddfa1008-ba09-4e9e-b9a8-8faea72b575f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:49.573791 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-ddfa1008-ba09-4e9e-b9a8-8faea72b575f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:49.580559 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ddfa1008-ba09-4e9e-b9a8-8faea72b575f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:49.581003 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ddfa1008-ba09-4e9e-b9a8-8faea72b575f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:49.581750 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ddfa1008-ba09-4e9e-b9a8-8faea72b575f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:49.582175 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ddfa1008-ba09-4e9e-b9a8-8faea72b575f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:49.610070 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-ddfa1008-ba09-4e9e-b9a8-8faea72b575f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041584 Jul 11 11:36:49.610615 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 901/1793] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:49 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:49.879011 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-dac38810-d26d-4274-923a-32953aa91b90 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:49.879651 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-dac38810-d26d-4274-923a-32953aa91b90 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:49.886073 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-dac38810-d26d-4274-923a-32953aa91b90 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:49.886524 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-dac38810-d26d-4274-923a-32953aa91b90 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:49.887303 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-dac38810-d26d-4274-923a-32953aa91b90 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:49.887746 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-dac38810-d26d-4274-923a-32953aa91b90 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:50.017163 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-dac38810-d26d-4274-923a-32953aa91b90 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:36:50.025557 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-dac38810-d26d-4274-923a-32953aa91b90 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.150435 Jul 11 11:36:50.026129 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 893/1794] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:36:49 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:36:50.509102 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-2fe5ef33-bf0d-4bd9-bba4-041219dcf0d7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:50.510015 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-2fe5ef33-bf0d-4bd9-bba4-041219dcf0d7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:50.516444 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2fe5ef33-bf0d-4bd9-bba4-041219dcf0d7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:50.516883 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2fe5ef33-bf0d-4bd9-bba4-041219dcf0d7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:50.517629 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2fe5ef33-bf0d-4bd9-bba4-041219dcf0d7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:50.518055 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2fe5ef33-bf0d-4bd9-bba4-041219dcf0d7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:50.545575 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-2fe5ef33-bf0d-4bd9-bba4-041219dcf0d7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041028 Jul 11 11:36:50.546112 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 902/1795] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:50 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:50.621896 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-88c42d9c-2b92-4b6b-93ee-97e6325ed109 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:50.622815 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-88c42d9c-2b92-4b6b-93ee-97e6325ed109 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:50.628870 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-88c42d9c-2b92-4b6b-93ee-97e6325ed109 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:50.629326 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-88c42d9c-2b92-4b6b-93ee-97e6325ed109 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:50.630078 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-88c42d9c-2b92-4b6b-93ee-97e6325ed109 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:50.630513 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-88c42d9c-2b92-4b6b-93ee-97e6325ed109 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:50.633511 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=100 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:36:50.659620 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-88c42d9c-2b92-4b6b-93ee-97e6325ed109 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041620 Jul 11 11:36:50.660166 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 894/1796] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:50 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:51.042344 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-e1c6db1a-f515-4423-96e6-850c803e38d4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:51.042975 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-e1c6db1a-f515-4423-96e6-850c803e38d4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:51.049103 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e1c6db1a-f515-4423-96e6-850c803e38d4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:51.049487 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e1c6db1a-f515-4423-96e6-850c803e38d4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:51.050246 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e1c6db1a-f515-4423-96e6-850c803e38d4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:51.050676 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e1c6db1a-f515-4423-96e6-850c803e38d4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:51.179692 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-e1c6db1a-f515-4423-96e6-850c803e38d4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:36:51.187491 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-e1c6db1a-f515-4423-96e6-850c803e38d4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.149490 Jul 11 11:36:51.188052 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 903/1797] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:36:51 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:36:51.557116 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-b17de70b-a281-43a4-84cb-a01739a0df4c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:51.558036 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-b17de70b-a281-43a4-84cb-a01739a0df4c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:51.564976 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b17de70b-a281-43a4-84cb-a01739a0df4c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:51.565428 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b17de70b-a281-43a4-84cb-a01739a0df4c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:51.566185 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b17de70b-a281-43a4-84cb-a01739a0df4c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:51.566620 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b17de70b-a281-43a4-84cb-a01739a0df4c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:51.596142 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-b17de70b-a281-43a4-84cb-a01739a0df4c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042954 Jul 11 11:36:51.596692 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 895/1798] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:51 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:51.671154 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-b99bbe21-818a-4ddf-b053-6838fa2fb816 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:51.672107 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-b99bbe21-818a-4ddf-b053-6838fa2fb816 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:51.678651 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b99bbe21-818a-4ddf-b053-6838fa2fb816 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:51.679104 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b99bbe21-818a-4ddf-b053-6838fa2fb816 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:51.679907 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b99bbe21-818a-4ddf-b053-6838fa2fb816 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:51.680344 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b99bbe21-818a-4ddf-b053-6838fa2fb816 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:51.710245 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-b99bbe21-818a-4ddf-b053-6838fa2fb816 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042551 Jul 11 11:36:51.710803 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 904/1799] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:51 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:52.204008 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-7df0e7fa-c978-4a7d-a516-99be86c8727d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:52.204619 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-7df0e7fa-c978-4a7d-a516-99be86c8727d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:52.210588 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7df0e7fa-c978-4a7d-a516-99be86c8727d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:52.211044 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7df0e7fa-c978-4a7d-a516-99be86c8727d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:52.211855 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7df0e7fa-c978-4a7d-a516-99be86c8727d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:52.212295 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7df0e7fa-c978-4a7d-a516-99be86c8727d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:52.336097 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-7df0e7fa-c978-4a7d-a516-99be86c8727d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:36:52.343825 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-7df0e7fa-c978-4a7d-a516-99be86c8727d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.143633 Jul 11 11:36:52.344401 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 896/1800] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:36:52 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:36:52.607861 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-8071fa6d-13c7-4c83-891c-360c7c086690 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:52.608779 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-8071fa6d-13c7-4c83-891c-360c7c086690 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:52.614738 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8071fa6d-13c7-4c83-891c-360c7c086690 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:52.615188 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8071fa6d-13c7-4c83-891c-360c7c086690 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:52.616592 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8071fa6d-13c7-4c83-891c-360c7c086690 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:52.617022 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8071fa6d-13c7-4c83-891c-360c7c086690 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:52.645895 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-8071fa6d-13c7-4c83-891c-360c7c086690 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042225 Jul 11 11:36:52.646443 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 905/1801] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:52 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:52.721740 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-d3d665dc-55dc-4658-add6-cb33dfaa0444 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:52.722671 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-d3d665dc-55dc-4658-add6-cb33dfaa0444 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:52.729683 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d3d665dc-55dc-4658-add6-cb33dfaa0444 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:52.730137 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d3d665dc-55dc-4658-add6-cb33dfaa0444 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:52.730898 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d3d665dc-55dc-4658-add6-cb33dfaa0444 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:52.731378 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d3d665dc-55dc-4658-add6-cb33dfaa0444 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:52.759164 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-d3d665dc-55dc-4658-add6-cb33dfaa0444 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041475 Jul 11 11:36:52.759745 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 897/1802] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:52 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:53.360318 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-45cff7b2-bac5-43e9-a521-bfda5ee2cb59 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:53.360957 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-45cff7b2-bac5-43e9-a521-bfda5ee2cb59 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:53.366897 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-45cff7b2-bac5-43e9-a521-bfda5ee2cb59 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:53.367373 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-45cff7b2-bac5-43e9-a521-bfda5ee2cb59 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:53.368133 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-45cff7b2-bac5-43e9-a521-bfda5ee2cb59 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:53.368574 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-45cff7b2-bac5-43e9-a521-bfda5ee2cb59 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:53.494893 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-45cff7b2-bac5-43e9-a521-bfda5ee2cb59 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:36:53.502711 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-45cff7b2-bac5-43e9-a521-bfda5ee2cb59 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.146216 Jul 11 11:36:53.503607 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 906/1803] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:36:53 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:36:53.657529 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-4068824e-7f18-47fd-a384-bf438877fdc5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:53.658445 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-4068824e-7f18-47fd-a384-bf438877fdc5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:53.664448 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4068824e-7f18-47fd-a384-bf438877fdc5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:53.664890 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4068824e-7f18-47fd-a384-bf438877fdc5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:53.665641 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4068824e-7f18-47fd-a384-bf438877fdc5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:53.666071 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4068824e-7f18-47fd-a384-bf438877fdc5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:53.694873 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-4068824e-7f18-47fd-a384-bf438877fdc5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040444 Jul 11 11:36:53.695444 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 898/1804] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:53 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:53.770952 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-4e771736-f46c-4563-a64b-c3d1aa9a37d4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:53.771853 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-4e771736-f46c-4563-a64b-c3d1aa9a37d4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:53.778230 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4e771736-f46c-4563-a64b-c3d1aa9a37d4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:53.783559 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4e771736-f46c-4563-a64b-c3d1aa9a37d4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:53.783559 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4e771736-f46c-4563-a64b-c3d1aa9a37d4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:53.783559 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4e771736-f46c-4563-a64b-c3d1aa9a37d4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:53.809162 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-4e771736-f46c-4563-a64b-c3d1aa9a37d4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042466 Jul 11 11:36:53.812242 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 907/1805] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:53 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:54.519981 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-4bc62dd5-2bd2-42b1-8e5a-512059770d04 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:54.520571 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-4bc62dd5-2bd2-42b1-8e5a-512059770d04 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:54.527543 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4bc62dd5-2bd2-42b1-8e5a-512059770d04 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:54.527991 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4bc62dd5-2bd2-42b1-8e5a-512059770d04 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:54.528745 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4bc62dd5-2bd2-42b1-8e5a-512059770d04 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:54.529182 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4bc62dd5-2bd2-42b1-8e5a-512059770d04 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:54.661375 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-4bc62dd5-2bd2-42b1-8e5a-512059770d04 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:36:54.669366 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-4bc62dd5-2bd2-42b1-8e5a-512059770d04 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.153309 Jul 11 11:36:54.669941 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 899/1806] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:36:54 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:36:54.705810 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-3081ba2f-6eea-412a-a862-21ccb3bbb782 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:54.706719 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-3081ba2f-6eea-412a-a862-21ccb3bbb782 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:54.713614 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3081ba2f-6eea-412a-a862-21ccb3bbb782 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:54.714068 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3081ba2f-6eea-412a-a862-21ccb3bbb782 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:54.714836 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3081ba2f-6eea-412a-a862-21ccb3bbb782 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:54.715296 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3081ba2f-6eea-412a-a862-21ccb3bbb782 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:54.743270 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-3081ba2f-6eea-412a-a862-21ccb3bbb782 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041276 Jul 11 11:36:54.743821 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 908/1807] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:54 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:54.821470 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-2dec187a-848b-4502-b237-d29dbc90fa82 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:54.822403 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-2dec187a-848b-4502-b237-d29dbc90fa82 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:54.828435 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2dec187a-848b-4502-b237-d29dbc90fa82 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:54.828891 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2dec187a-848b-4502-b237-d29dbc90fa82 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:54.829661 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2dec187a-848b-4502-b237-d29dbc90fa82 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:54.830102 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2dec187a-848b-4502-b237-d29dbc90fa82 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:54.858306 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-2dec187a-848b-4502-b237-d29dbc90fa82 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041590 Jul 11 11:36:54.858791 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 900/1808] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:54 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:55.686078 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-a39ff086-bf3b-49b9-9c6c-4f25a8a32a76 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:55.686687 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-a39ff086-bf3b-49b9-9c6c-4f25a8a32a76 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:55.693201 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a39ff086-bf3b-49b9-9c6c-4f25a8a32a76 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:55.693649 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a39ff086-bf3b-49b9-9c6c-4f25a8a32a76 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:55.694665 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a39ff086-bf3b-49b9-9c6c-4f25a8a32a76 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:55.695099 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a39ff086-bf3b-49b9-9c6c-4f25a8a32a76 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:55.755040 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-644806a8-72c8-4f01-9cbd-19719874f6f3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:55.756580 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-644806a8-72c8-4f01-9cbd-19719874f6f3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:55.762937 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-644806a8-72c8-4f01-9cbd-19719874f6f3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:55.763426 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-644806a8-72c8-4f01-9cbd-19719874f6f3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:55.764193 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-644806a8-72c8-4f01-9cbd-19719874f6f3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:55.764627 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-644806a8-72c8-4f01-9cbd-19719874f6f3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:55.794717 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-644806a8-72c8-4f01-9cbd-19719874f6f3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043691 Jul 11 11:36:55.795521 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 901/1809] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:55 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:36:55.829983 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-a39ff086-bf3b-49b9-9c6c-4f25a8a32a76 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:36:55.839749 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-a39ff086-bf3b-49b9-9c6c-4f25a8a32a76 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.156126 Jul 11 11:36:55.839749 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 909/1810] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:36:55 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:36:55.869055 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-b71f8bc1-dde2-4712-9929-fc1634702c20 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:55.870011 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-b71f8bc1-dde2-4712-9929-fc1634702c20 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:55.876086 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b71f8bc1-dde2-4712-9929-fc1634702c20 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:55.876539 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b71f8bc1-dde2-4712-9929-fc1634702c20 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:55.877298 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b71f8bc1-dde2-4712-9929-fc1634702c20 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:55.877738 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b71f8bc1-dde2-4712-9929-fc1634702c20 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:55.907192 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-b71f8bc1-dde2-4712-9929-fc1634702c20 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042029 Jul 11 11:36:55.907791 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 902/1811] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:55 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:56.806875 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-35350577-7679-487d-97f8-2511e314e240 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:56.807822 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-35350577-7679-487d-97f8-2511e314e240 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:56.814280 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-35350577-7679-487d-97f8-2511e314e240 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:56.814735 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-35350577-7679-487d-97f8-2511e314e240 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:56.815515 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-35350577-7679-487d-97f8-2511e314e240 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:56.815978 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-35350577-7679-487d-97f8-2511e314e240 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:56.843839 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-35350577-7679-487d-97f8-2511e314e240 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041561 Jul 11 11:36:56.844439 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 910/1812] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:56 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:56.855622 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-8b9d9ad0-103c-43db-8e00-577fd274b572 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:56.856238 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-8b9d9ad0-103c-43db-8e00-577fd274b572 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:56.862652 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8b9d9ad0-103c-43db-8e00-577fd274b572 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:56.863105 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8b9d9ad0-103c-43db-8e00-577fd274b572 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:56.863908 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8b9d9ad0-103c-43db-8e00-577fd274b572 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:56.864355 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8b9d9ad0-103c-43db-8e00-577fd274b572 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:56.918897 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-224d54e4-6786-43e2-8bdc-0ca8975fc948 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:56.919852 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-224d54e4-6786-43e2-8bdc-0ca8975fc948 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:56.925852 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-224d54e4-6786-43e2-8bdc-0ca8975fc948 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:56.926426 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-224d54e4-6786-43e2-8bdc-0ca8975fc948 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:56.927195 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-224d54e4-6786-43e2-8bdc-0ca8975fc948 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:56.927653 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-224d54e4-6786-43e2-8bdc-0ca8975fc948 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:56.957188 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-224d54e4-6786-43e2-8bdc-0ca8975fc948 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042168 Jul 11 11:36:56.957763 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 911/1813] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:56 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:36:56.991783 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-8b9d9ad0-103c-43db-8e00-577fd274b572 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:36:56.999762 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-8b9d9ad0-103c-43db-8e00-577fd274b572 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.147864 Jul 11 11:36:57.000334 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 903/1814] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:36:56 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:36:57.855315 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-69fc6f1e-98cf-41b6-9d6b-18f5f8c3cd21 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:57.856233 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-69fc6f1e-98cf-41b6-9d6b-18f5f8c3cd21 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:57.862677 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-69fc6f1e-98cf-41b6-9d6b-18f5f8c3cd21 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:57.863125 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-69fc6f1e-98cf-41b6-9d6b-18f5f8c3cd21 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:57.863912 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-69fc6f1e-98cf-41b6-9d6b-18f5f8c3cd21 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:57.864344 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-69fc6f1e-98cf-41b6-9d6b-18f5f8c3cd21 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:57.892896 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-69fc6f1e-98cf-41b6-9d6b-18f5f8c3cd21 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041528 Jul 11 11:36:57.893450 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 912/1815] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:57 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:57.968728 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-ce1f3b10-6eea-4389-8604-e746835e0a06 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:57.969649 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-ce1f3b10-6eea-4389-8604-e746835e0a06 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:57.976062 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ce1f3b10-6eea-4389-8604-e746835e0a06 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:57.976506 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ce1f3b10-6eea-4389-8604-e746835e0a06 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:57.977255 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ce1f3b10-6eea-4389-8604-e746835e0a06 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:57.977685 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ce1f3b10-6eea-4389-8604-e746835e0a06 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:58.005839 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-ce1f3b10-6eea-4389-8604-e746835e0a06 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041041 Jul 11 11:36:58.006951 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 904/1816] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:57 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:58.015844 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-eae35259-ce4f-4cbc-93b4-0f649ec3dce9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:58.016450 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-eae35259-ce4f-4cbc-93b4-0f649ec3dce9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:58.022925 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-eae35259-ce4f-4cbc-93b4-0f649ec3dce9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:58.023400 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-eae35259-ce4f-4cbc-93b4-0f649ec3dce9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:58.024164 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-eae35259-ce4f-4cbc-93b4-0f649ec3dce9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:58.024599 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-eae35259-ce4f-4cbc-93b4-0f649ec3dce9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:58.150089 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-eae35259-ce4f-4cbc-93b4-0f649ec3dce9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:36:58.157870 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-eae35259-ce4f-4cbc-93b4-0f649ec3dce9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.145778 Jul 11 11:36:58.158439 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 913/1817] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:36:58 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:36:58.905766 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-56c6d6fa-f7ee-4a28-ab8d-4862e2c9f07d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:58.906599 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-56c6d6fa-f7ee-4a28-ab8d-4862e2c9f07d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:58.913160 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-56c6d6fa-f7ee-4a28-ab8d-4862e2c9f07d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:58.913601 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-56c6d6fa-f7ee-4a28-ab8d-4862e2c9f07d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:58.914353 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-56c6d6fa-f7ee-4a28-ab8d-4862e2c9f07d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:58.914783 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-56c6d6fa-f7ee-4a28-ab8d-4862e2c9f07d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:58.952701 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-56c6d6fa-f7ee-4a28-ab8d-4862e2c9f07d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050970 Jul 11 11:36:58.953264 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 905/1818] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:58 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:59.018046 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-e7123f40-dd9d-4ce0-9b0a-10c3d540b871 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:59.018960 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-e7123f40-dd9d-4ce0-9b0a-10c3d540b871 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:59.026132 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e7123f40-dd9d-4ce0-9b0a-10c3d540b871 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:59.026572 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e7123f40-dd9d-4ce0-9b0a-10c3d540b871 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:59.027347 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e7123f40-dd9d-4ce0-9b0a-10c3d540b871 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:59.027777 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e7123f40-dd9d-4ce0-9b0a-10c3d540b871 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:59.056744 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-e7123f40-dd9d-4ce0-9b0a-10c3d540b871 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042625 Jul 11 11:36:59.057303 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 914/1819] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:59 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:36:59.175133 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-db839ea0-496f-4ba9-acfa-1f9f0253eaae tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:59.175774 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-db839ea0-496f-4ba9-acfa-1f9f0253eaae tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:59.182138 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-db839ea0-496f-4ba9-acfa-1f9f0253eaae tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:59.182588 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-db839ea0-496f-4ba9-acfa-1f9f0253eaae tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:59.183377 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-db839ea0-496f-4ba9-acfa-1f9f0253eaae tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:59.183817 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-db839ea0-496f-4ba9-acfa-1f9f0253eaae tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:59.322061 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-db839ea0-496f-4ba9-acfa-1f9f0253eaae tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:36:59.329870 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-db839ea0-496f-4ba9-acfa-1f9f0253eaae tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.158628 Jul 11 11:36:59.330435 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 906/1820] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:36:59 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:36:59.964606 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-5b04e150-d1d0-45fa-a742-c6faec5e1203 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:36:59.965571 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-5b04e150-d1d0-45fa-a742-c6faec5e1203 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:36:59.971601 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5b04e150-d1d0-45fa-a742-c6faec5e1203 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:59.972045 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5b04e150-d1d0-45fa-a742-c6faec5e1203 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:59.972793 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5b04e150-d1d0-45fa-a742-c6faec5e1203 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:36:59.973224 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5b04e150-d1d0-45fa-a742-c6faec5e1203 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:36:59.977296 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=100 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:37:00.003038 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-5b04e150-d1d0-45fa-a742-c6faec5e1203 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042329 Jul 11 11:37:00.003799 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 915/1821] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:36:59 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:37:00.068389 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-ee816f72-7555-4638-aa47-039e66ad1818 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:37:00.069593 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-ee816f72-7555-4638-aa47-039e66ad1818 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:37:00.075826 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ee816f72-7555-4638-aa47-039e66ad1818 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:00.076229 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ee816f72-7555-4638-aa47-039e66ad1818 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:00.076989 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ee816f72-7555-4638-aa47-039e66ad1818 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:00.077418 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ee816f72-7555-4638-aa47-039e66ad1818 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:00.105331 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-ee816f72-7555-4638-aa47-039e66ad1818 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040945 Jul 11 11:37:00.105875 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 907/1822] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:37:00 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:37:00.349418 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-f9ae6359-715e-41f0-937a-8ef78f52c449 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:37:00.350452 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-f9ae6359-715e-41f0-937a-8ef78f52c449 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:37:00.359922 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f9ae6359-715e-41f0-937a-8ef78f52c449 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:00.360560 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f9ae6359-715e-41f0-937a-8ef78f52c449 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:00.361430 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f9ae6359-715e-41f0-937a-8ef78f52c449 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:00.361898 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f9ae6359-715e-41f0-937a-8ef78f52c449 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:00.506965 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-f9ae6359-715e-41f0-937a-8ef78f52c449 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:37:00.514711 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-f9ae6359-715e-41f0-937a-8ef78f52c449 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.170994 Jul 11 11:37:00.515283 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 916/1823] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:37:00 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:37:01.014382 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-fc511849-7f50-4db5-9ffe-40c9e9b5cfa2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:37:01.015343 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-fc511849-7f50-4db5-9ffe-40c9e9b5cfa2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:37:01.021793 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fc511849-7f50-4db5-9ffe-40c9e9b5cfa2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:01.022241 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fc511849-7f50-4db5-9ffe-40c9e9b5cfa2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:01.023000 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fc511849-7f50-4db5-9ffe-40c9e9b5cfa2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:01.023469 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fc511849-7f50-4db5-9ffe-40c9e9b5cfa2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:01.051444 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-fc511849-7f50-4db5-9ffe-40c9e9b5cfa2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041073 Jul 11 11:37:01.052005 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 908/1824] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:37:01 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:37:01.117403 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-011ca2c2-3616-4b2a-8695-5d594512048b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:37:01.118325 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-011ca2c2-3616-4b2a-8695-5d594512048b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:37:01.124350 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-011ca2c2-3616-4b2a-8695-5d594512048b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:01.124800 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-011ca2c2-3616-4b2a-8695-5d594512048b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:01.125561 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-011ca2c2-3616-4b2a-8695-5d594512048b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:01.125997 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-011ca2c2-3616-4b2a-8695-5d594512048b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:01.154715 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-011ca2c2-3616-4b2a-8695-5d594512048b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041766 Jul 11 11:37:01.155533 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 917/1825] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:37:01 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:37:01.532088 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-c61408cc-b3c2-4a11-9adc-91e2f7a42cc5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:37:01.532695 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-c61408cc-b3c2-4a11-9adc-91e2f7a42cc5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:37:01.538631 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c61408cc-b3c2-4a11-9adc-91e2f7a42cc5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:01.539072 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c61408cc-b3c2-4a11-9adc-91e2f7a42cc5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:01.539855 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c61408cc-b3c2-4a11-9adc-91e2f7a42cc5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:01.540286 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c61408cc-b3c2-4a11-9adc-91e2f7a42cc5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:01.672641 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-c61408cc-b3c2-4a11-9adc-91e2f7a42cc5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:37:01.686222 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-c61408cc-b3c2-4a11-9adc-91e2f7a42cc5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.157064 Jul 11 11:37:01.686222 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 909/1826] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:37:01 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:37:02.063557 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-6606b649-1d9a-4ac6-b8ec-22c967f71ec4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:37:02.064488 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-6606b649-1d9a-4ac6-b8ec-22c967f71ec4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:37:02.071613 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6606b649-1d9a-4ac6-b8ec-22c967f71ec4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:02.072062 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6606b649-1d9a-4ac6-b8ec-22c967f71ec4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:02.072831 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6606b649-1d9a-4ac6-b8ec-22c967f71ec4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:02.073262 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6606b649-1d9a-4ac6-b8ec-22c967f71ec4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:02.101886 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-6606b649-1d9a-4ac6-b8ec-22c967f71ec4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042453 Jul 11 11:37:02.102437 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 918/1827] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:37:02 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:37:02.166857 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-be78ed41-ead5-445b-a9bf-f9e860e0f27c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:37:02.167798 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-be78ed41-ead5-445b-a9bf-f9e860e0f27c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:37:02.174183 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-be78ed41-ead5-445b-a9bf-f9e860e0f27c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:02.174626 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-be78ed41-ead5-445b-a9bf-f9e860e0f27c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:02.175402 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-be78ed41-ead5-445b-a9bf-f9e860e0f27c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:02.175837 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-be78ed41-ead5-445b-a9bf-f9e860e0f27c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:02.200381 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=100 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:37:02.204687 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-be78ed41-ead5-445b-a9bf-f9e860e0f27c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042334 Jul 11 11:37:02.205226 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 910/1828] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:37:02 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:37:02.703002 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-b9c8691b-1155-4d29-8b86-39c1f68c35da tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:37:02.703649 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-b9c8691b-1155-4d29-8b86-39c1f68c35da tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:37:02.709615 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b9c8691b-1155-4d29-8b86-39c1f68c35da tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:02.710607 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b9c8691b-1155-4d29-8b86-39c1f68c35da tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:02.711415 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b9c8691b-1155-4d29-8b86-39c1f68c35da tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:02.711852 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b9c8691b-1155-4d29-8b86-39c1f68c35da tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:02.836547 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-b9c8691b-1155-4d29-8b86-39c1f68c35da tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:37:02.844331 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-b9c8691b-1155-4d29-8b86-39c1f68c35da tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.145212 Jul 11 11:37:02.844893 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 919/1829] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:37:02 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:37:03.113782 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-3ca39cf6-7a24-446d-bcb9-883b5284693f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:37:03.114695 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-3ca39cf6-7a24-446d-bcb9-883b5284693f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:37:03.121189 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3ca39cf6-7a24-446d-bcb9-883b5284693f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:03.121639 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3ca39cf6-7a24-446d-bcb9-883b5284693f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:03.122398 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3ca39cf6-7a24-446d-bcb9-883b5284693f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:03.122835 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3ca39cf6-7a24-446d-bcb9-883b5284693f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:03.152037 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-3ca39cf6-7a24-446d-bcb9-883b5284693f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042166 Jul 11 11:37:03.152595 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 911/1830] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:37:03 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:37:03.221816 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-33a7afca-8847-4db3-9460-4c39da07ec7c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:37:03.222817 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-33a7afca-8847-4db3-9460-4c39da07ec7c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:37:03.229262 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-33a7afca-8847-4db3-9460-4c39da07ec7c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:03.229713 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-33a7afca-8847-4db3-9460-4c39da07ec7c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:03.230470 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-33a7afca-8847-4db3-9460-4c39da07ec7c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:03.230962 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-33a7afca-8847-4db3-9460-4c39da07ec7c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:03.260313 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-33a7afca-8847-4db3-9460-4c39da07ec7c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042382 Jul 11 11:37:03.260857 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 920/1831] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:37:03 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:37:03.860861 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-6a5a41da-35e8-475c-bb93-e69f04e077d4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:37:03.861476 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-6a5a41da-35e8-475c-bb93-e69f04e077d4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:37:03.867869 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6a5a41da-35e8-475c-bb93-e69f04e077d4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:03.868313 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6a5a41da-35e8-475c-bb93-e69f04e077d4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:03.869065 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6a5a41da-35e8-475c-bb93-e69f04e077d4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:03.869496 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6a5a41da-35e8-475c-bb93-e69f04e077d4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:04.146943 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-6a5a41da-35e8-475c-bb93-e69f04e077d4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:37:04.155189 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-6a5a41da-35e8-475c-bb93-e69f04e077d4 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.298200 Jul 11 11:37:04.156081 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 912/1832] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:37:03 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:37:04.168186 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-84817ee9-4a9b-4054-ba95-1dea3a1c42f0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:37:04.169215 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-84817ee9-4a9b-4054-ba95-1dea3a1c42f0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:37:04.175454 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-84817ee9-4a9b-4054-ba95-1dea3a1c42f0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:04.175900 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-84817ee9-4a9b-4054-ba95-1dea3a1c42f0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:04.176647 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-84817ee9-4a9b-4054-ba95-1dea3a1c42f0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:04.177080 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-84817ee9-4a9b-4054-ba95-1dea3a1c42f0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:04.208497 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-84817ee9-4a9b-4054-ba95-1dea3a1c42f0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048583 Jul 11 11:37:04.209059 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 921/1833] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:37:04 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:37:04.272047 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-c8877f98-50a9-4424-ac24-90712693de1d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:37:04.272969 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-c8877f98-50a9-4424-ac24-90712693de1d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:37:04.278971 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c8877f98-50a9-4424-ac24-90712693de1d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:04.281124 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c8877f98-50a9-4424-ac24-90712693de1d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:04.281124 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c8877f98-50a9-4424-ac24-90712693de1d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:04.281124 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c8877f98-50a9-4424-ac24-90712693de1d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:04.310239 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-c8877f98-50a9-4424-ac24-90712693de1d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042250 Jul 11 11:37:04.310783 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 913/1834] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:37:04 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:37:05.171747 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-8103abb5-a63c-4225-8a38-6d33e0550803 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:37:05.172350 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-8103abb5-a63c-4225-8a38-6d33e0550803 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:37:05.178743 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8103abb5-a63c-4225-8a38-6d33e0550803 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:05.179199 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8103abb5-a63c-4225-8a38-6d33e0550803 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:05.179972 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8103abb5-a63c-4225-8a38-6d33e0550803 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:05.180399 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8103abb5-a63c-4225-8a38-6d33e0550803 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:05.219941 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-e6b1f8e7-771c-40ac-b823-207ac0ee5e36 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:37:05.220968 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-e6b1f8e7-771c-40ac-b823-207ac0ee5e36 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:37:05.228235 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e6b1f8e7-771c-40ac-b823-207ac0ee5e36 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:05.228675 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e6b1f8e7-771c-40ac-b823-207ac0ee5e36 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:05.229439 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e6b1f8e7-771c-40ac-b823-207ac0ee5e36 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:05.229867 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e6b1f8e7-771c-40ac-b823-207ac0ee5e36 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:05.259085 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-e6b1f8e7-771c-40ac-b823-207ac0ee5e36 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042970 Jul 11 11:37:05.259685 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 914/1835] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:37:05 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:37:05.306911 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-8103abb5-a63c-4225-8a38-6d33e0550803 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:37:05.314727 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-8103abb5-a63c-4225-8a38-6d33e0550803 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.147100 Jul 11 11:37:05.315310 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 922/1836] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:37:05 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:37:05.321737 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-f1dafc62-a3d5-49c5-8f31-3a102f29a512 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:37:05.322656 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-f1dafc62-a3d5-49c5-8f31-3a102f29a512 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:37:05.328572 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f1dafc62-a3d5-49c5-8f31-3a102f29a512 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:05.329022 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f1dafc62-a3d5-49c5-8f31-3a102f29a512 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:05.329782 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f1dafc62-a3d5-49c5-8f31-3a102f29a512 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:05.330218 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f1dafc62-a3d5-49c5-8f31-3a102f29a512 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:05.358845 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-f1dafc62-a3d5-49c5-8f31-3a102f29a512 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041811 Jul 11 11:37:05.359414 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 915/1837] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:37:05 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:37:06.274182 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-54873bc3-d662-4fc8-8b13-718f3c88b7ac tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:37:06.275542 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-54873bc3-d662-4fc8-8b13-718f3c88b7ac tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:37:06.282373 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-54873bc3-d662-4fc8-8b13-718f3c88b7ac tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:06.282815 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-54873bc3-d662-4fc8-8b13-718f3c88b7ac tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:06.283685 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-54873bc3-d662-4fc8-8b13-718f3c88b7ac tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:06.284185 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-54873bc3-d662-4fc8-8b13-718f3c88b7ac tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:06.314133 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-54873bc3-d662-4fc8-8b13-718f3c88b7ac tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047419 Jul 11 11:37:06.314696 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 923/1838] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:37:06 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:37:06.332306 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-04c717cf-9306-4dce-ac48-0aa02902ebe5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:37:06.332942 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-04c717cf-9306-4dce-ac48-0aa02902ebe5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:37:06.340916 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-04c717cf-9306-4dce-ac48-0aa02902ebe5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:06.344784 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-04c717cf-9306-4dce-ac48-0aa02902ebe5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:06.344784 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-04c717cf-9306-4dce-ac48-0aa02902ebe5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:06.344784 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-04c717cf-9306-4dce-ac48-0aa02902ebe5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:06.371663 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-f1e0eb4e-9fdc-416e-9727-d1be7fa6014d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:37:06.390766 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-f1e0eb4e-9fdc-416e-9727-d1be7fa6014d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:37:06.390766 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f1e0eb4e-9fdc-416e-9727-d1be7fa6014d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:06.390766 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f1e0eb4e-9fdc-416e-9727-d1be7fa6014d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:06.390766 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f1e0eb4e-9fdc-416e-9727-d1be7fa6014d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:06.391443 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f1e0eb4e-9fdc-416e-9727-d1be7fa6014d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:06.423834 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-f1e0eb4e-9fdc-416e-9727-d1be7fa6014d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056000 Jul 11 11:37:06.424315 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 924/1839] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:37:06 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:37:06.480654 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-04c717cf-9306-4dce-ac48-0aa02902ebe5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:37:06.488806 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-04c717cf-9306-4dce-ac48-0aa02902ebe5 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.160332 Jul 11 11:37:06.489390 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 916/1840] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:37:06 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:37:07.326035 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-1416a243-a609-481b-b944-259e6d16e3dd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:37:07.326874 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-1416a243-a609-481b-b944-259e6d16e3dd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:37:07.333443 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1416a243-a609-481b-b944-259e6d16e3dd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:07.333893 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1416a243-a609-481b-b944-259e6d16e3dd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:07.334651 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1416a243-a609-481b-b944-259e6d16e3dd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:07.335084 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1416a243-a609-481b-b944-259e6d16e3dd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:07.363177 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-1416a243-a609-481b-b944-259e6d16e3dd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041195 Jul 11 11:37:07.363941 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 925/1841] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:37:07 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:37:07.435719 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-b6c83a4d-3150-449b-b237-09f7a9e651c6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:37:07.436647 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-b6c83a4d-3150-449b-b237-09f7a9e651c6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:37:07.443038 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b6c83a4d-3150-449b-b237-09f7a9e651c6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:07.443520 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b6c83a4d-3150-449b-b237-09f7a9e651c6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:07.444548 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b6c83a4d-3150-449b-b237-09f7a9e651c6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:07.444983 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b6c83a4d-3150-449b-b237-09f7a9e651c6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:07.472657 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-b6c83a4d-3150-449b-b237-09f7a9e651c6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040950 Jul 11 11:37:07.473193 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 917/1842] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:37:07 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:37:07.506659 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-648c0f9b-56b3-4835-a929-90c5756c720f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:37:07.507337 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-648c0f9b-56b3-4835-a929-90c5756c720f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:37:07.513261 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-648c0f9b-56b3-4835-a929-90c5756c720f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:07.513792 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-648c0f9b-56b3-4835-a929-90c5756c720f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:07.514553 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-648c0f9b-56b3-4835-a929-90c5756c720f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:07.514979 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-648c0f9b-56b3-4835-a929-90c5756c720f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:07.645413 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-648c0f9b-56b3-4835-a929-90c5756c720f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:37:07.653574 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-648c0f9b-56b3-4835-a929-90c5756c720f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.151617 Jul 11 11:37:07.654133 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 926/1843] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:37:07 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:37:08.375740 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-30b8ab68-6ce2-4f03-a305-b364e546dc07 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:37:08.376592 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-30b8ab68-6ce2-4f03-a305-b364e546dc07 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:37:08.383798 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-30b8ab68-6ce2-4f03-a305-b364e546dc07 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:08.384443 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-30b8ab68-6ce2-4f03-a305-b364e546dc07 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:08.385210 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-30b8ab68-6ce2-4f03-a305-b364e546dc07 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:08.385643 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-30b8ab68-6ce2-4f03-a305-b364e546dc07 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:08.415996 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-30b8ab68-6ce2-4f03-a305-b364e546dc07 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044286 Jul 11 11:37:08.416549 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 918/1844] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:37:08 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:37:08.484014 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-c51656e5-34d9-4032-94a0-d1dccbee8ba6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:37:08.484923 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-c51656e5-34d9-4032-94a0-d1dccbee8ba6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:37:08.491973 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c51656e5-34d9-4032-94a0-d1dccbee8ba6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:08.492442 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c51656e5-34d9-4032-94a0-d1dccbee8ba6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:08.493189 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c51656e5-34d9-4032-94a0-d1dccbee8ba6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:08.493614 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c51656e5-34d9-4032-94a0-d1dccbee8ba6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:08.522270 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-c51656e5-34d9-4032-94a0-d1dccbee8ba6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042120 Jul 11 11:37:08.522826 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 927/1845] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:37:08 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:37:08.670720 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-98b2a13a-85d2-46d8-83fa-2b1ca6a1b45d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:37:08.671359 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-98b2a13a-85d2-46d8-83fa-2b1ca6a1b45d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:37:08.677757 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-98b2a13a-85d2-46d8-83fa-2b1ca6a1b45d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:08.678212 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-98b2a13a-85d2-46d8-83fa-2b1ca6a1b45d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:08.679580 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-98b2a13a-85d2-46d8-83fa-2b1ca6a1b45d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:08.680021 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-98b2a13a-85d2-46d8-83fa-2b1ca6a1b45d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:08.806205 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-98b2a13a-85d2-46d8-83fa-2b1ca6a1b45d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:37:08.814001 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-98b2a13a-85d2-46d8-83fa-2b1ca6a1b45d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.147062 Jul 11 11:37:08.814828 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 919/1846] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:37:08 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:37:09.427518 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-5a413afd-e7d3-4657-b14e-840868f23113 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:37:09.428428 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-5a413afd-e7d3-4657-b14e-840868f23113 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:37:09.434477 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5a413afd-e7d3-4657-b14e-840868f23113 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:09.434914 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5a413afd-e7d3-4657-b14e-840868f23113 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:09.435693 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5a413afd-e7d3-4657-b14e-840868f23113 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:09.436146 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5a413afd-e7d3-4657-b14e-840868f23113 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:09.464197 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-5a413afd-e7d3-4657-b14e-840868f23113 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040595 Jul 11 11:37:09.464728 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 928/1847] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:37:09 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:37:09.534197 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-4e7bc745-5b7d-425d-a763-67180008b368 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:37:09.535125 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-4e7bc745-5b7d-425d-a763-67180008b368 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:37:09.541880 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4e7bc745-5b7d-425d-a763-67180008b368 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:09.542330 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4e7bc745-5b7d-425d-a763-67180008b368 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:09.543090 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4e7bc745-5b7d-425d-a763-67180008b368 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:09.543548 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4e7bc745-5b7d-425d-a763-67180008b368 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:09.572606 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-4e7bc745-5b7d-425d-a763-67180008b368 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042483 Jul 11 11:37:09.573091 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 920/1848] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:37:09 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:37:09.830430 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-db466aa3-9db8-4616-8028-6c91e356df6c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:37:09.831042 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-db466aa3-9db8-4616-8028-6c91e356df6c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:37:09.838185 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-db466aa3-9db8-4616-8028-6c91e356df6c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:09.838627 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-db466aa3-9db8-4616-8028-6c91e356df6c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:09.839422 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-db466aa3-9db8-4616-8028-6c91e356df6c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:09.839854 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-db466aa3-9db8-4616-8028-6c91e356df6c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:09.977437 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-db466aa3-9db8-4616-8028-6c91e356df6c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:37:09.986275 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-db466aa3-9db8-4616-8028-6c91e356df6c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.159604 Jul 11 11:37:09.986849 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 929/1849] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:37:09 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:37:10.475631 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-7e28746f-656d-4e07-8eeb-b31cbaaf84c1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:37:10.477126 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-7e28746f-656d-4e07-8eeb-b31cbaaf84c1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:37:10.483132 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7e28746f-656d-4e07-8eeb-b31cbaaf84c1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:10.483606 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7e28746f-656d-4e07-8eeb-b31cbaaf84c1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:10.484353 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7e28746f-656d-4e07-8eeb-b31cbaaf84c1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:10.484785 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7e28746f-656d-4e07-8eeb-b31cbaaf84c1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:10.512754 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-7e28746f-656d-4e07-8eeb-b31cbaaf84c1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041080 Jul 11 11:37:10.513290 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 921/1850] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:37:10 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:37:10.583848 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-f576e273-09bc-4c85-a339-8dda2fef476e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:37:10.584782 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-f576e273-09bc-4c85-a339-8dda2fef476e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:37:10.590819 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f576e273-09bc-4c85-a339-8dda2fef476e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:10.591293 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f576e273-09bc-4c85-a339-8dda2fef476e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:10.592056 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f576e273-09bc-4c85-a339-8dda2fef476e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:10.592493 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f576e273-09bc-4c85-a339-8dda2fef476e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:10.621239 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-f576e273-09bc-4c85-a339-8dda2fef476e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041295 Jul 11 11:37:10.621785 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 930/1851] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:37:10 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:37:11.003493 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-a7d49e88-6d7f-401a-8b89-c9484d253f56 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:37:11.004103 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-a7d49e88-6d7f-401a-8b89-c9484d253f56 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:37:11.010565 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a7d49e88-6d7f-401a-8b89-c9484d253f56 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:11.011007 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a7d49e88-6d7f-401a-8b89-c9484d253f56 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:11.011799 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a7d49e88-6d7f-401a-8b89-c9484d253f56 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:11.012233 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a7d49e88-6d7f-401a-8b89-c9484d253f56 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:11.141636 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-a7d49e88-6d7f-401a-8b89-c9484d253f56 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:37:11.150197 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-a7d49e88-6d7f-401a-8b89-c9484d253f56 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.150549 Jul 11 11:37:11.151056 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 922/1852] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:37:10 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:37:11.524264 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-015e9e92-d778-4ee8-9a86-47330a4fb7da tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:37:11.525193 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-015e9e92-d778-4ee8-9a86-47330a4fb7da tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:37:11.527504 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_api:SELECT=84 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:37:11.532182 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-015e9e92-d778-4ee8-9a86-47330a4fb7da tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:11.532814 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-015e9e92-d778-4ee8-9a86-47330a4fb7da tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:11.533619 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-015e9e92-d778-4ee8-9a86-47330a4fb7da tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:11.534054 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-015e9e92-d778-4ee8-9a86-47330a4fb7da tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:11.558318 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=100 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:37:11.562626 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-015e9e92-d778-4ee8-9a86-47330a4fb7da tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042356 Jul 11 11:37:11.563168 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 931/1853] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:37:11 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:37:11.632863 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-109ca0ca-17f3-42e5-a1cc-0734c752c75b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:37:11.633792 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-109ca0ca-17f3-42e5-a1cc-0734c752c75b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:37:11.641098 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-109ca0ca-17f3-42e5-a1cc-0734c752c75b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:11.641603 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-109ca0ca-17f3-42e5-a1cc-0734c752c75b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:11.642418 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-109ca0ca-17f3-42e5-a1cc-0734c752c75b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:11.642903 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-109ca0ca-17f3-42e5-a1cc-0734c752c75b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:11.671365 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-109ca0ca-17f3-42e5-a1cc-0734c752c75b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042497 Jul 11 11:37:11.671915 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 923/1854] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:37:11 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:37:12.168077 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-b61b30df-8020-467e-86ee-a59b1112a324 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:37:12.168683 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-b61b30df-8020-467e-86ee-a59b1112a324 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:37:12.175275 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b61b30df-8020-467e-86ee-a59b1112a324 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:12.175729 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b61b30df-8020-467e-86ee-a59b1112a324 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:12.176488 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b61b30df-8020-467e-86ee-a59b1112a324 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:12.177023 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b61b30df-8020-467e-86ee-a59b1112a324 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:12.306246 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-b61b30df-8020-467e-86ee-a59b1112a324 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:37:12.314061 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-b61b30df-8020-467e-86ee-a59b1112a324 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.151002 Jul 11 11:37:12.314635 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 932/1855] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:37:12 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:37:12.574892 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-7bb880fe-5a54-43bf-9357-fdaf0afbcd58 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:37:12.575864 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-7bb880fe-5a54-43bf-9357-fdaf0afbcd58 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:37:12.582267 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7bb880fe-5a54-43bf-9357-fdaf0afbcd58 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:12.582714 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7bb880fe-5a54-43bf-9357-fdaf0afbcd58 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:12.583497 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7bb880fe-5a54-43bf-9357-fdaf0afbcd58 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:12.583932 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7bb880fe-5a54-43bf-9357-fdaf0afbcd58 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:12.612215 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-7bb880fe-5a54-43bf-9357-fdaf0afbcd58 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041372 Jul 11 11:37:12.612755 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 924/1856] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:37:12 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:37:12.681768 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-b819dc4a-8193-45b5-b004-d947ccaa6e51 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:37:12.682688 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-b819dc4a-8193-45b5-b004-d947ccaa6e51 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:37:12.689103 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b819dc4a-8193-45b5-b004-d947ccaa6e51 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:12.689550 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b819dc4a-8193-45b5-b004-d947ccaa6e51 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:12.690306 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b819dc4a-8193-45b5-b004-d947ccaa6e51 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:12.690738 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b819dc4a-8193-45b5-b004-d947ccaa6e51 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:12.719703 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-b819dc4a-8193-45b5-b004-d947ccaa6e51 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041765 Jul 11 11:37:12.720241 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 933/1857] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:37:12 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:37:13.280227 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-58958223-393c-4969-bb69-9188caf93df6 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:37:13.280730 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-58958223-393c-4969-bb69-9188caf93df6 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] [instance: b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:37:13.286834 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-58958223-393c-4969-bb69-9188caf93df6 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:13.287308 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-58958223-393c-4969-bb69-9188caf93df6 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:13.292553 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-58958223-393c-4969-bb69-9188caf93df6 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:13.292553 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-58958223-393c-4969-bb69-9188caf93df6 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:13.313782 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-58958223-393c-4969-bb69-9188caf93df6 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] [instance: b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0] Going to try to terminate instance {{(pid=118322) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 11:37:13.331194 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-318f6fcc-aba3-4fe9-afc9-f0c52e1f3300 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:37:13.331829 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-318f6fcc-aba3-4fe9-afc9-f0c52e1f3300 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:37:13.337755 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-318f6fcc-aba3-4fe9-afc9-f0c52e1f3300 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:13.338197 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-318f6fcc-aba3-4fe9-afc9-f0c52e1f3300 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:13.338954 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-318f6fcc-aba3-4fe9-afc9-f0c52e1f3300 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:13.339416 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-318f6fcc-aba3-4fe9-afc9-f0c52e1f3300 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:13.432099 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:37:13.465975 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-318f6fcc-aba3-4fe9-afc9-f0c52e1f3300 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:37:13.473854 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-318f6fcc-aba3-4fe9-afc9-f0c52e1f3300 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.146431 Jul 11 11:37:13.474456 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 934/1858] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:37:13 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:37:13.610831 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-58958223-393c-4969-bb69-9188caf93df6 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0" status: 204 len: 0 microversion: 2.1 time: 0.333886 Jul 11 11:37:13.611395 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 925/1859] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 11 11:37:13 2022] DELETE /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 11 11:37:13.620105 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-3319dea0-d280-4e45-8483-53e0bd459044 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:37:13.620716 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-3319dea0-d280-4e45-8483-53e0bd459044 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] [instance: b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:37:13.624033 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-43cfb615-72d9-4214-b2c1-7a745eaaf34a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:37:13.625058 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-43cfb615-72d9-4214-b2c1-7a745eaaf34a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:37:13.626724 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3319dea0-d280-4e45-8483-53e0bd459044 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:13.627282 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3319dea0-d280-4e45-8483-53e0bd459044 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:13.628062 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3319dea0-d280-4e45-8483-53e0bd459044 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:13.628495 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3319dea0-d280-4e45-8483-53e0bd459044 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:13.630982 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-43cfb615-72d9-4214-b2c1-7a745eaaf34a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:13.631459 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-43cfb615-72d9-4214-b2c1-7a745eaaf34a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:13.632213 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-43cfb615-72d9-4214-b2c1-7a745eaaf34a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:13.632642 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-43cfb615-72d9-4214-b2c1-7a745eaaf34a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:13.662229 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-43cfb615-72d9-4214-b2c1-7a745eaaf34a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042338 Jul 11 11:37:13.662799 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 926/1860] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:37:13 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:37:13.731733 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-68264272-d12c-4663-b1b6-e97d06e4fba5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:37:13.732683 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-68264272-d12c-4663-b1b6-e97d06e4fba5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:37:13.738910 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-68264272-d12c-4663-b1b6-e97d06e4fba5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:13.739391 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-68264272-d12c-4663-b1b6-e97d06e4fba5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:13.740152 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-68264272-d12c-4663-b1b6-e97d06e4fba5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:13.740580 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-68264272-d12c-4663-b1b6-e97d06e4fba5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:13.760722 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-3319dea0-d280-4e45-8483-53e0bd459044 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc29ac59eed483b8c6443c397505adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890e7e79ff744b6b9589f166cd7d8979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:37:13.767984 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-3319dea0-d280-4e45-8483-53e0bd459044 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] 10.222.0.26 "GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0" status: 200 len: 1505 microversion: 2.1 time: 0.152471 Jul 11 11:37:13.768546 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 935/1861] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:37:13 2022] GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0 => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:37:13.770440 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-68264272-d12c-4663-b1b6-e97d06e4fba5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042584 Jul 11 11:37:13.770990 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 927/1862] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:37:13 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:37:14.497461 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-d86e6a89-0efb-4b34-936a-1acc3848930b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:37:14.499032 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-d86e6a89-0efb-4b34-936a-1acc3848930b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:37:14.510052 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d86e6a89-0efb-4b34-936a-1acc3848930b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:14.510506 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d86e6a89-0efb-4b34-936a-1acc3848930b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:14.511298 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d86e6a89-0efb-4b34-936a-1acc3848930b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:14.511737 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d86e6a89-0efb-4b34-936a-1acc3848930b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:14.616222 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [req-8780406d-551b-468c-825f-59e449ab19b2 req-a219db30-fcc4-4067-a961-effd0af3e7c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0", "name": "network-vif-deleted", "tag": "c667a1ab-f4f0-43bf-aa75-4bd7508e68f9"}]} {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:37:14.626357 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [req-8780406d-551b-468c-825f-59e449ab19b2 req-a219db30-fcc4-4067-a961-effd0af3e7c2 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:14.626807 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [req-8780406d-551b-468c-825f-59e449ab19b2 req-a219db30-fcc4-4067-a961-effd0af3e7c2 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:14.638690 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.compute.server_external_events [req-8780406d-551b-468c-825f-59e449ab19b2 req-a219db30-fcc4-4067-a961-effd0af3e7c2 service nova] Creating event network-vif-deleted:c667a1ab-f4f0-43bf-aa75-4bd7508e68f9 for instance b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0 on hv-cinder-84842 Jul 11 11:37:14.643566 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [req-8780406d-551b-468c-825f-59e449ab19b2 req-a219db30-fcc4-4067-a961-effd0af3e7c2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031125 Jul 11 11:37:14.644317 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 928/1863] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 11:37:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:37:14.674642 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-6a5e5931-8272-4667-adcd-6914de52dfbd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:37:14.675782 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-6a5e5931-8272-4667-adcd-6914de52dfbd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:37:14.682519 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6a5e5931-8272-4667-adcd-6914de52dfbd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:14.682972 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6a5e5931-8272-4667-adcd-6914de52dfbd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:14.683760 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6a5e5931-8272-4667-adcd-6914de52dfbd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:14.684194 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6a5e5931-8272-4667-adcd-6914de52dfbd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:14.685723 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-d86e6a89-0efb-4b34-936a-1acc3848930b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:37:14.694551 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-d86e6a89-0efb-4b34-936a-1acc3848930b tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.200752 Jul 11 11:37:14.695769 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 936/1864] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:37:14 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:37:14.714264 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-6a5e5931-8272-4667-adcd-6914de52dfbd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043930 Jul 11 11:37:14.714806 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 929/1865] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:37:14 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:37:14.782649 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-7e3caaf3-f657-4001-8eb3-ae326c4ed20f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:37:14.783612 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-7e3caaf3-f657-4001-8eb3-ae326c4ed20f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:37:14.785508 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-a601d0c2-3e03-4804-b884-a0b884affd23 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:37:14.788878 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-a601d0c2-3e03-4804-b884-a0b884affd23 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] [instance: b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:37:14.791683 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7e3caaf3-f657-4001-8eb3-ae326c4ed20f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:14.792271 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7e3caaf3-f657-4001-8eb3-ae326c4ed20f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:14.793037 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7e3caaf3-f657-4001-8eb3-ae326c4ed20f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:14.793467 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7e3caaf3-f657-4001-8eb3-ae326c4ed20f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:14.793590 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a601d0c2-3e03-4804-b884-a0b884affd23 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:14.793937 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a601d0c2-3e03-4804-b884-a0b884affd23 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:14.794702 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a601d0c2-3e03-4804-b884-a0b884affd23 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:14.795141 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a601d0c2-3e03-4804-b884-a0b884affd23 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:14.859670 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-a601d0c2-3e03-4804-b884-a0b884affd23 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc29ac59eed483b8c6443c397505adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890e7e79ff744b6b9589f166cd7d8979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:37:14.867764 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-a601d0c2-3e03-4804-b884-a0b884affd23 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] 10.222.0.26 "GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0" status: 200 len: 1299 microversion: 2.1 time: 0.086074 Jul 11 11:37:14.868335 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 930/1866] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:37:14 2022] GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0 => generated 1299 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:37:14.874399 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-7e3caaf3-f657-4001-8eb3-ae326c4ed20f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "POST /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/action" status: 200 len: 76547 microversion: 2.1 time: 0.096072 Jul 11 11:37:14.875079 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 937/1867] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Jul 11 11:37:14 2022] POST /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb/action => generated 76547 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 11:37:15.712870 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-a6bbdba5-a052-4dd0-b166-c60b23ca549d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:37:15.713485 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-a6bbdba5-a052-4dd0-b166-c60b23ca549d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:37:15.715949 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:37:15.720889 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a6bbdba5-a052-4dd0-b166-c60b23ca549d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:15.721335 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a6bbdba5-a052-4dd0-b166-c60b23ca549d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:15.722140 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a6bbdba5-a052-4dd0-b166-c60b23ca549d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:15.722570 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a6bbdba5-a052-4dd0-b166-c60b23ca549d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:15.726087 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-86162378-8ef8-42a4-86e6-afe9335f5893 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:37:15.727265 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-86162378-8ef8-42a4-86e6-afe9335f5893 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:37:15.734243 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-86162378-8ef8-42a4-86e6-afe9335f5893 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:15.734698 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-86162378-8ef8-42a4-86e6-afe9335f5893 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:15.735486 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-86162378-8ef8-42a4-86e6-afe9335f5893 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:15.735921 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-86162378-8ef8-42a4-86e6-afe9335f5893 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:15.765788 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-86162378-8ef8-42a4-86e6-afe9335f5893 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043862 Jul 11 11:37:15.766843 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 938/1868] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:37:15 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:37:15.851111 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-a6bbdba5-a052-4dd0-b166-c60b23ca549d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:37:15.858938 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-a6bbdba5-a052-4dd0-b166-c60b23ca549d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6" status: 200 len: 1737 microversion: 2.1 time: 0.150582 Jul 11 11:37:15.859535 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 931/1869] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:37:15 2022] GET /compute/v2.1/servers/8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:37:15.875032 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-875d83ec-fe5f-4d80-92db-51afab3eec1e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '.version_select at 0x7fb010351550>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:37:15.884611 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-dd42568f-94a0-4012-8ce7-5b7da3629a04 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:37:15.885216 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-dd42568f-94a0-4012-8ce7-5b7da3629a04 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] [instance: b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:37:15.891069 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-dd42568f-94a0-4012-8ce7-5b7da3629a04 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:15.891555 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-dd42568f-94a0-4012-8ce7-5b7da3629a04 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:15.892321 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-dd42568f-94a0-4012-8ce7-5b7da3629a04 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:15.892757 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-dd42568f-94a0-4012-8ce7-5b7da3629a04 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:15.906169 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.wsgi [None req-dd42568f-94a0-4012-8ce7-5b7da3629a04 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] HTTP exception thrown: Instance b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0 could not be found. Jul 11 11:37:15.907834 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-dd42568f-94a0-4012-8ce7-5b7da3629a04 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Request method failure captured: Jul 11 11:37:15.907834 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: request: GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0 HTTP/1.1 Jul 11 11:37:15.907834 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Accept: application/json Jul 11 11:37:15.907834 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Accept-Encoding: identity Jul 11 11:37:15.907834 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Connection: close Jul 11 11:37:15.907834 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Content-Length: 0 Jul 11 11:37:15.907834 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Content-Type: application/json Jul 11 11:37:15.907834 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Host: 10.222.0.26 Jul 11 11:37:15.907834 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Openstack-System-Scope: None Jul 11 11:37:15.907834 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: User-Agent: python-urllib3/1.26.9 Jul 11 11:37:15.907834 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Auth-Token: gAAAAABizAkre02fn49DdNJcuS-XenEKUsDKGIqeMJJFW9tiLy-zlrGvGjoQFZ2qnlQCplE1IhxHtV96fwSt1jVaUb1aEGJUpg_x9sw6xfQvjfRbrDus0aqHfiZ3yS4QqilNHCVKK30qnl93VyKwrAxnMcN2yTJfaSLhMOJKmGwDMixVCjmgqnM Jul 11 11:37:15.907834 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Domain-Id: None Jul 11 11:37:15.907834 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Domain-Name: None Jul 11 11:37:15.907834 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Identity-Status: Confirmed Jul 11 11:37:15.907834 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Is-Admin-Project: True Jul 11 11:37:15.907834 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Domain-Id: default Jul 11 11:37:15.907834 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Domain-Name: Default Jul 11 11:37:15.907834 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Id: 890e7e79ff744b6b9589f166cd7d8979 Jul 11 11:37:15.907834 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Name: tempest-VolumesActionsTest-2072641558 Jul 11 11:37:15.907834 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Role: member,reader Jul 11 11:37:15.907834 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Roles: member,reader Jul 11 11:37:15.909553 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_890e7e79ff744b6b9589f166cd7d8979"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/890e7e79ff744b6b9589f166cd7d8979"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/890e7e79ff744b6b9589f166cd7d8979"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/890e7e79ff744b6b9589f166cd7d8979"}]}] Jul 11 11:37:15.909553 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Tenant: tempest-VolumesActionsTest-2072641558 Jul 11 11:37:15.909553 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Tenant-Id: 890e7e79ff744b6b9589f166cd7d8979 Jul 11 11:37:15.909553 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Tenant-Name: tempest-VolumesActionsTest-2072641558 Jul 11 11:37:15.909553 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User: tempest-VolumesActionsTest-2072641558-project Jul 11 11:37:15.909553 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Domain-Id: default Jul 11 11:37:15.909553 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Domain-Name: Default Jul 11 11:37:15.909553 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Id: 9dc29ac59eed483b8c6443c397505adc Jul 11 11:37:15.909553 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Name: tempest-VolumesActionsTest-2072641558-project Jul 11 11:37:15.909553 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: method: > Jul 11 11:37:15.909553 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: exception: Instance b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0 could not be found. Jul 11 11:37:15.909553 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: action_args: {'id': 'b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0'} Jul 11 11:37:15.910423 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 11:37:15.910423 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:37:15.910423 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 11:37:15.910423 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 11:37:15.910423 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 11:37:15.910423 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 11:37:15.910423 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 11:37:15.910423 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 11:37:15.910423 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 11:37:15.910423 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 11:37:15.910423 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0 could not be found. Jul 11 11:37:15.910423 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:37:15.910423 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:37:15.910423 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:37:15.910423 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:37:15.910423 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:37:15.910423 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:37:15.910423 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 11:37:15.910423 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 11:37:15.910423 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 11:37:15.911778 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 11:37:15.911778 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 11:37:15.911778 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 11:37:15.911778 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 11:37:15.911778 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 11:37:15.911778 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 11:37:15.911778 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 11:37:15.911778 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0 could not be found. Jul 11 11:37:15.911778 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:37:15.911778 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:37:15.911778 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:37:15.911778 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:37:15.911778 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:37:15.911778 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:37:15.911778 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 11:37:15.911778 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 11:37:15.911778 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0 could not be found. Jul 11 11:37:15.911778 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:37:15.912960 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-dd42568f-94a0-4012-8ce7-5b7da3629a04 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] Returning 404 to user: Instance b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0 could not be found. {{(pid=118322) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 11:37:15.912960 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-dd42568f-94a0-4012-8ce7-5b7da3629a04 tempest-VolumesActionsTest-2072641558 tempest-VolumesActionsTest-2072641558-project] 10.222.0.26 "GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0" status: 404 len: 111 microversion: 2.1 time: 0.028843 Jul 11 11:37:15.912960 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 932/1870] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:37:15 2022] GET /compute/v2.1/servers/b45d9e87-5c44-4bff-b03d-78e1c2f8f2d0 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 11 11:37:15.967456 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-875d83ec-fe5f-4d80-92db-51afab3eec1e tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2013041530" status: 202 len: 0 microversion: 2.1 time: 0.095908 Jul 11 11:37:15.968067 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 939/1871] 10.222.0.26 () {58 vars in 1220 bytes} [Mon Jul 11 11:37:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2013041530 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 11:37:16.778089 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-bba8621d-7099-48ef-9bee-39c5d26558ec tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:37:16.779104 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-bba8621d-7099-48ef-9bee-39c5d26558ec tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:37:16.785689 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-bba8621d-7099-48ef-9bee-39c5d26558ec tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:16.786133 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-bba8621d-7099-48ef-9bee-39c5d26558ec tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:16.786899 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-bba8621d-7099-48ef-9bee-39c5d26558ec tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:16.787352 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-bba8621d-7099-48ef-9bee-39c5d26558ec tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:16.819237 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-bba8621d-7099-48ef-9bee-39c5d26558ec tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044802 Jul 11 11:37:16.819972 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 933/1872] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:37:16 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:37:17.031512 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [req-200005c3-0322-4900-b931-4b5a30d8aa1c req-8c77c23d-9dca-46db-abb9-be0db5e1f6a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6", "tag": "21e04d85-904d-403f-aac1-fe7bfdc5fbb9"}]} {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:37:17.046940 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [req-200005c3-0322-4900-b931-4b5a30d8aa1c req-8c77c23d-9dca-46db-abb9-be0db5e1f6a8 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:17.047404 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [req-200005c3-0322-4900-b931-4b5a30d8aa1c req-8c77c23d-9dca-46db-abb9-be0db5e1f6a8 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:17.065900 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.compute.server_external_events [req-200005c3-0322-4900-b931-4b5a30d8aa1c req-8c77c23d-9dca-46db-abb9-be0db5e1f6a8 service nova] Creating event network-changed:21e04d85-904d-403f-aac1-fe7bfdc5fbb9 for instance 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 on hv-cinder-84842 Jul 11 11:37:17.073198 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [req-200005c3-0322-4900-b931-4b5a30d8aa1c req-8c77c23d-9dca-46db-abb9-be0db5e1f6a8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045793 Jul 11 11:37:17.076524 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 940/1873] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 11:37:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:37:17.830353 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-bd5757ed-f2a8-459a-889c-42a94bf068a6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:37:17.831365 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-bd5757ed-f2a8-459a-889c-42a94bf068a6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:37:17.838563 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-bd5757ed-f2a8-459a-889c-42a94bf068a6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:17.839018 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-bd5757ed-f2a8-459a-889c-42a94bf068a6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:17.839853 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-bd5757ed-f2a8-459a-889c-42a94bf068a6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:17.840295 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-bd5757ed-f2a8-459a-889c-42a94bf068a6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:17.876553 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-bd5757ed-f2a8-459a-889c-42a94bf068a6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050361 Jul 11 11:37:17.877434 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 934/1874] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:37:17 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:37:18.889107 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-b5ea525e-05ea-4307-95a8-f86cef4ecbcd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:37:18.890132 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-b5ea525e-05ea-4307-95a8-f86cef4ecbcd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:37:18.896383 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b5ea525e-05ea-4307-95a8-f86cef4ecbcd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:18.896895 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b5ea525e-05ea-4307-95a8-f86cef4ecbcd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:18.897722 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b5ea525e-05ea-4307-95a8-f86cef4ecbcd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:18.898750 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b5ea525e-05ea-4307-95a8-f86cef4ecbcd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:18.926950 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-b5ea525e-05ea-4307-95a8-f86cef4ecbcd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042598 Jul 11 11:37:18.927534 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 941/1875] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 11 11:37:18 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:37:19.938170 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-496608a3-6ba9-48e1-929c-f2021a9a33de tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:37:19.939032 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-496608a3-6ba9-48e1-929c-f2021a9a33de tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:37:19.945898 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-496608a3-6ba9-48e1-929c-f2021a9a33de tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:19.946348 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-496608a3-6ba9-48e1-929c-f2021a9a33de tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:19.947105 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-496608a3-6ba9-48e1-929c-f2021a9a33de tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:19.947576 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-496608a3-6ba9-48e1-929c-f2021a9a33de tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:20.016471 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-496608a3-6ba9-48e1-929c-f2021a9a33de tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "POST /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/action" status: 200 len: 41312 microversion: 2.1 time: 0.082055 Jul 11 11:37:20.017165 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 935/1876] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Jul 11 11:37:19 2022] POST /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101/action => generated 41312 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 11:37:38.371885 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 11:37:38.372525 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Mon Jul 11 11:37:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 11:37:41.907646 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 11:37:41.908906 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Mon Jul 11 11:37:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 11:37:45.242806 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-54f10932-fab3-4b70-94cf-c58231ee1eac tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Action: 'create', calling method: .version_select at 0x7fb01001b1f0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1214071285", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJTcrVCI8oCNwR0W8H9hHOsmrD2PGaVp/J9CtpSsIxSm3Jiq1/dCc0Bx1SZPNSHoYzCopmxgQpPfVwGXyH5jlYU19J+LGhMxu8Ugf23SVSQ/AFmuBOrqK5GFSeAbCTnOA=="}} {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:37:45.247558 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_api:SELECT=22,nova_api:DELETE=1 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:37:45.248198 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=48 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:37:45.258595 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.quota [None req-54f10932-fab3-4b70-94cf-c58231ee1eac tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Getting quotas for project 72a461d4496f4015969f2683af43afa7. Resources: {'key_pairs'} {{(pid=118321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 11:37:45.263298 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.quota [None req-54f10932-fab3-4b70-94cf-c58231ee1eac tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Getting quotas for user 559a564c171f4dd1abb3e4af27987bbd and project 72a461d4496f4015969f2683af43afa7. Resources: {'key_pairs'} {{(pid=118321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 11:37:45.357218 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-54f10932-fab3-4b70-94cf-c58231ee1eac tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.118222 Jul 11 11:37:45.357852 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 942/1877] 10.222.0.26 () {60 vars in 1158 bytes} [Mon Jul 11 11:37:45 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:37:45.405012 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-0e66ccf8-ed97-4918-baf7-dc5b02918186 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1053895003", "imageRef": "5295dc3e-8f3b-423f-a4eb-b1ebf9d05407", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1214071285", "networks": [{"uuid": "541febd7-3c22-4e01-b334-5819299c32d8"}]}} {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:37:45.412290 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_api:SELECT=9 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:37:45.412934 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=50 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:37:45.455892 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.network.neutron [None req-0e66ccf8-ed97-4918-baf7-dc5b02918186 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] validate_networks() for [('541febd7-3c22-4e01-b334-5819299c32d8', None, None, None, None, None)] {{(pid=118322) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 11:37:45.941080 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.virt.hardware [None req-0e66ccf8-ed97-4918-baf7-dc5b02918186 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Flavor limits 0:0:0 {{(pid=118322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 11:37:45.941505 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.virt.hardware [None req-0e66ccf8-ed97-4918-baf7-dc5b02918186 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Image limits 0:0:0 {{(pid=118322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 11:37:45.942013 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.virt.hardware [None req-0e66ccf8-ed97-4918-baf7-dc5b02918186 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Flavor pref 0:0:0 {{(pid=118322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 11:37:45.942420 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.virt.hardware [None req-0e66ccf8-ed97-4918-baf7-dc5b02918186 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Image pref 0:0:0 {{(pid=118322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 11:37:45.942830 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.virt.hardware [None req-0e66ccf8-ed97-4918-baf7-dc5b02918186 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 11:37:45.952785 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0e66ccf8-ed97-4918-baf7-dc5b02918186 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:45.953243 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0e66ccf8-ed97-4918-baf7-dc5b02918186 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:45.954040 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0e66ccf8-ed97-4918-baf7-dc5b02918186 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:45.954472 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0e66ccf8-ed97-4918-baf7-dc5b02918186 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:45.973272 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.quota [None req-0e66ccf8-ed97-4918-baf7-dc5b02918186 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Getting quotas for project 72a461d4496f4015969f2683af43afa7. Resources: {'cores', 'ram', 'instances'} {{(pid=118322) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 11:37:45.977179 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.quota [None req-0e66ccf8-ed97-4918-baf7-dc5b02918186 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Getting quotas for user 559a564c171f4dd1abb3e4af27987bbd and project 72a461d4496f4015969f2683af43afa7. Resources: {'cores', 'ram', 'instances'} {{(pid=118322) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 11:37:45.987752 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-0e66ccf8-ed97-4918-baf7-dc5b02918186 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Going to run 1 instances... {{(pid=118322) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 11:37:45.990018 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-0e66ccf8-ed97-4918-baf7-dc5b02918186 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] [instance: cedf9f3b-4453-41d4-aa67-547bff886542] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5295dc3e-8f3b-423f-a4eb-b1ebf9d05407',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118322) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 11:37:46.106726 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-0e66ccf8-ed97-4918-baf7-dc5b02918186 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.705769 Jul 11 11:37:46.107410 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 936/1878] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jul 11 11:37:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 708 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 11 11:37:46.117807 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-5005d470-e599-46e2-b5ee-1ff4f529bb90 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:37:46.119155 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-5005d470-e599-46e2-b5ee-1ff4f529bb90 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] [instance: cedf9f3b-4453-41d4-aa67-547bff886542] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:37:46.177374 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-5005d470-e599-46e2-b5ee-1ff4f529bb90 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559a564c171f4dd1abb3e4af27987bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a461d4496f4015969f2683af43afa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:37:46.184737 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-5005d470-e599-46e2-b5ee-1ff4f529bb90 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] 10.222.0.26 "GET /compute/v2.1/servers/cedf9f3b-4453-41d4-aa67-547bff886542" status: 200 len: 1259 microversion: 2.1 time: 0.071330 Jul 11 11:37:46.185331 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 943/1879] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:37:46 2022] GET /compute/v2.1/servers/cedf9f3b-4453-41d4-aa67-547bff886542 => generated 1259 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:37:47.201922 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-0639fcb1-7eb3-4028-9ce4-8f746dca51f9 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:37:47.202546 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-0639fcb1-7eb3-4028-9ce4-8f746dca51f9 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] [instance: cedf9f3b-4453-41d4-aa67-547bff886542] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:37:47.254564 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-0639fcb1-7eb3-4028-9ce4-8f746dca51f9 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559a564c171f4dd1abb3e4af27987bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a461d4496f4015969f2683af43afa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:37:47.262267 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-0639fcb1-7eb3-4028-9ce4-8f746dca51f9 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] 10.222.0.26 "GET /compute/v2.1/servers/cedf9f3b-4453-41d4-aa67-547bff886542" status: 200 len: 1259 microversion: 2.1 time: 0.064780 Jul 11 11:37:47.262819 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 937/1880] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:37:47 2022] GET /compute/v2.1/servers/cedf9f3b-4453-41d4-aa67-547bff886542 => generated 1259 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:37:48.277915 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-1c5a4b30-382d-4d45-82bc-e8b3a51718e5 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:37:48.278529 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-1c5a4b30-382d-4d45-82bc-e8b3a51718e5 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] [instance: cedf9f3b-4453-41d4-aa67-547bff886542] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:37:48.285983 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1c5a4b30-382d-4d45-82bc-e8b3a51718e5 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:48.288992 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1c5a4b30-382d-4d45-82bc-e8b3a51718e5 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:48.288992 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1c5a4b30-382d-4d45-82bc-e8b3a51718e5 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:48.288992 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1c5a4b30-382d-4d45-82bc-e8b3a51718e5 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:48.347993 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-1c5a4b30-382d-4d45-82bc-e8b3a51718e5 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559a564c171f4dd1abb3e4af27987bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a461d4496f4015969f2683af43afa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:37:48.355311 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-1c5a4b30-382d-4d45-82bc-e8b3a51718e5 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] 10.222.0.26 "GET /compute/v2.1/servers/cedf9f3b-4453-41d4-aa67-547bff886542" status: 200 len: 1311 microversion: 2.1 time: 0.081189 Jul 11 11:37:48.355875 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 944/1881] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:37:48 2022] GET /compute/v2.1/servers/cedf9f3b-4453-41d4-aa67-547bff886542 => generated 1311 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:37:49.373493 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-84756b67-66bf-47e7-9105-20d39f4d691f tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:37:49.374927 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-84756b67-66bf-47e7-9105-20d39f4d691f tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] [instance: cedf9f3b-4453-41d4-aa67-547bff886542] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:37:49.383856 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-84756b67-66bf-47e7-9105-20d39f4d691f tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:49.384307 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-84756b67-66bf-47e7-9105-20d39f4d691f tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:49.392576 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-84756b67-66bf-47e7-9105-20d39f4d691f tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:49.393270 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-84756b67-66bf-47e7-9105-20d39f4d691f tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:49.678936 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-84756b67-66bf-47e7-9105-20d39f4d691f tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559a564c171f4dd1abb3e4af27987bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a461d4496f4015969f2683af43afa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:37:49.687893 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-84756b67-66bf-47e7-9105-20d39f4d691f tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] 10.222.0.26 "GET /compute/v2.1/servers/cedf9f3b-4453-41d4-aa67-547bff886542" status: 200 len: 1359 microversion: 2.1 time: 0.319455 Jul 11 11:37:49.688703 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 938/1882] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:37:49 2022] GET /compute/v2.1/servers/cedf9f3b-4453-41d4-aa67-547bff886542 => generated 1359 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:37:50.600045 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [req-d6098375-02dc-4f4d-b7b2-78aa299fb5e9 req-9c029e02-27bb-4741-b773-8f3910e80cb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cedf9f3b-4453-41d4-aa67-547bff886542", "tag": "d54240af-33ee-4d7a-a812-19b21e1319d6"}]} {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:37:50.622783 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [req-d6098375-02dc-4f4d-b7b2-78aa299fb5e9 req-9c029e02-27bb-4741-b773-8f3910e80cb7 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:50.624441 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [req-d6098375-02dc-4f4d-b7b2-78aa299fb5e9 req-9c029e02-27bb-4741-b773-8f3910e80cb7 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:50.657976 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.compute.server_external_events [req-d6098375-02dc-4f4d-b7b2-78aa299fb5e9 req-9c029e02-27bb-4741-b773-8f3910e80cb7 service nova] Creating event network-changed:d54240af-33ee-4d7a-a812-19b21e1319d6 for instance cedf9f3b-4453-41d4-aa67-547bff886542 on hv-cinder-84842 Jul 11 11:37:50.663521 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [req-d6098375-02dc-4f4d-b7b2-78aa299fb5e9 req-9c029e02-27bb-4741-b773-8f3910e80cb7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071190 Jul 11 11:37:50.664638 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 945/1883] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 11:37:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:37:50.716640 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-b0639331-cb88-439a-be81-9d95502f283a tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:37:50.717858 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-b0639331-cb88-439a-be81-9d95502f283a tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] [instance: cedf9f3b-4453-41d4-aa67-547bff886542] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:37:50.736593 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b0639331-cb88-439a-be81-9d95502f283a tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:50.737297 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b0639331-cb88-439a-be81-9d95502f283a tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:50.738260 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b0639331-cb88-439a-be81-9d95502f283a tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:50.739474 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b0639331-cb88-439a-be81-9d95502f283a tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:50.937460 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-b0639331-cb88-439a-be81-9d95502f283a tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559a564c171f4dd1abb3e4af27987bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a461d4496f4015969f2683af43afa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:37:50.946024 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-b0639331-cb88-439a-be81-9d95502f283a tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] 10.222.0.26 "GET /compute/v2.1/servers/cedf9f3b-4453-41d4-aa67-547bff886542" status: 200 len: 1359 microversion: 2.1 time: 0.233304 Jul 11 11:37:50.947281 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 939/1884] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:37:50 2022] GET /compute/v2.1/servers/cedf9f3b-4453-41d4-aa67-547bff886542 => generated 1359 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:37:51.965362 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-b888c8ef-0a67-4fd5-9972-bbac630322a8 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:37:51.967113 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-b888c8ef-0a67-4fd5-9972-bbac630322a8 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] [instance: cedf9f3b-4453-41d4-aa67-547bff886542] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:37:51.975068 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b888c8ef-0a67-4fd5-9972-bbac630322a8 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:51.975754 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b888c8ef-0a67-4fd5-9972-bbac630322a8 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:51.976772 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b888c8ef-0a67-4fd5-9972-bbac630322a8 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:51.977281 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b888c8ef-0a67-4fd5-9972-bbac630322a8 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:52.142438 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-b888c8ef-0a67-4fd5-9972-bbac630322a8 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559a564c171f4dd1abb3e4af27987bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a461d4496f4015969f2683af43afa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:37:52.151961 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-b888c8ef-0a67-4fd5-9972-bbac630322a8 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] 10.222.0.26 "GET /compute/v2.1/servers/cedf9f3b-4453-41d4-aa67-547bff886542" status: 200 len: 1359 microversion: 2.1 time: 0.191922 Jul 11 11:37:52.162648 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 946/1885] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:37:51 2022] GET /compute/v2.1/servers/cedf9f3b-4453-41d4-aa67-547bff886542 => generated 1359 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:37:53.170280 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-0b887357-0e7d-4388-8282-a3beb99e1035 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:37:53.170911 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-0b887357-0e7d-4388-8282-a3beb99e1035 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] [instance: cedf9f3b-4453-41d4-aa67-547bff886542] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:37:53.178074 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0b887357-0e7d-4388-8282-a3beb99e1035 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:53.178454 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0b887357-0e7d-4388-8282-a3beb99e1035 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:53.179234 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0b887357-0e7d-4388-8282-a3beb99e1035 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:53.179689 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0b887357-0e7d-4388-8282-a3beb99e1035 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:53.332558 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-0b887357-0e7d-4388-8282-a3beb99e1035 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559a564c171f4dd1abb3e4af27987bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a461d4496f4015969f2683af43afa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:37:53.355118 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-0b887357-0e7d-4388-8282-a3beb99e1035 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] 10.222.0.26 "GET /compute/v2.1/servers/cedf9f3b-4453-41d4-aa67-547bff886542" status: 200 len: 1359 microversion: 2.1 time: 0.188795 Jul 11 11:37:53.365084 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 940/1886] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:37:53 2022] GET /compute/v2.1/servers/cedf9f3b-4453-41d4-aa67-547bff886542 => generated 1359 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:37:54.372821 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-1b1274fb-fe59-400f-a4bf-70f4d4306e72 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:37:54.373464 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-1b1274fb-fe59-400f-a4bf-70f4d4306e72 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] [instance: cedf9f3b-4453-41d4-aa67-547bff886542] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:37:54.380830 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1b1274fb-fe59-400f-a4bf-70f4d4306e72 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:54.381046 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1b1274fb-fe59-400f-a4bf-70f4d4306e72 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:54.382116 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1b1274fb-fe59-400f-a4bf-70f4d4306e72 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:54.382718 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1b1274fb-fe59-400f-a4bf-70f4d4306e72 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:54.517182 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-1b1274fb-fe59-400f-a4bf-70f4d4306e72 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559a564c171f4dd1abb3e4af27987bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a461d4496f4015969f2683af43afa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:37:54.526159 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-1b1274fb-fe59-400f-a4bf-70f4d4306e72 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] 10.222.0.26 "GET /compute/v2.1/servers/cedf9f3b-4453-41d4-aa67-547bff886542" status: 200 len: 1359 microversion: 2.1 time: 0.157124 Jul 11 11:37:54.526893 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 947/1887] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:37:54 2022] GET /compute/v2.1/servers/cedf9f3b-4453-41d4-aa67-547bff886542 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:37:55.545967 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-c9add551-5990-475f-a475-fbce2d1a5423 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:37:55.546684 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-c9add551-5990-475f-a475-fbce2d1a5423 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] [instance: cedf9f3b-4453-41d4-aa67-547bff886542] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:37:55.556461 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c9add551-5990-475f-a475-fbce2d1a5423 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:55.556904 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c9add551-5990-475f-a475-fbce2d1a5423 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:55.557741 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c9add551-5990-475f-a475-fbce2d1a5423 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:55.558180 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c9add551-5990-475f-a475-fbce2d1a5423 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:55.696064 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-c9add551-5990-475f-a475-fbce2d1a5423 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559a564c171f4dd1abb3e4af27987bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a461d4496f4015969f2683af43afa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:37:55.705043 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-c9add551-5990-475f-a475-fbce2d1a5423 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] 10.222.0.26 "GET /compute/v2.1/servers/cedf9f3b-4453-41d4-aa67-547bff886542" status: 200 len: 1359 microversion: 2.1 time: 0.163994 Jul 11 11:37:55.706731 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 941/1888] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:37:55 2022] GET /compute/v2.1/servers/cedf9f3b-4453-41d4-aa67-547bff886542 => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:37:56.724832 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-c48fea73-acac-4a58-8b43-5ad175710f8a tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:37:56.725562 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-c48fea73-acac-4a58-8b43-5ad175710f8a tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] [instance: cedf9f3b-4453-41d4-aa67-547bff886542] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:37:56.728851 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell0:SELECT=6 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:37:56.733638 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c48fea73-acac-4a58-8b43-5ad175710f8a tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:56.734089 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c48fea73-acac-4a58-8b43-5ad175710f8a tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:56.734862 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c48fea73-acac-4a58-8b43-5ad175710f8a tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:56.735317 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c48fea73-acac-4a58-8b43-5ad175710f8a tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:56.866230 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-c48fea73-acac-4a58-8b43-5ad175710f8a tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559a564c171f4dd1abb3e4af27987bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a461d4496f4015969f2683af43afa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:37:56.874167 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-c48fea73-acac-4a58-8b43-5ad175710f8a tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] 10.222.0.26 "GET /compute/v2.1/servers/cedf9f3b-4453-41d4-aa67-547bff886542" status: 200 len: 1359 microversion: 2.1 time: 0.153567 Jul 11 11:37:56.874733 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 948/1889] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:37:56 2022] GET /compute/v2.1/servers/cedf9f3b-4453-41d4-aa67-547bff886542 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:37:57.889985 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-7fff928c-e984-4d26-8a06-cb3afb1e331a tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:37:57.890686 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-7fff928c-e984-4d26-8a06-cb3afb1e331a tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] [instance: cedf9f3b-4453-41d4-aa67-547bff886542] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:37:57.892762 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell0:SELECT=2 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:37:57.893984 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell0:SELECT=8 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:37:57.898870 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7fff928c-e984-4d26-8a06-cb3afb1e331a tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:57.903751 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7fff928c-e984-4d26-8a06-cb3afb1e331a tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:57.903751 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7fff928c-e984-4d26-8a06-cb3afb1e331a tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:57.903751 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7fff928c-e984-4d26-8a06-cb3afb1e331a tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:58.034090 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-7fff928c-e984-4d26-8a06-cb3afb1e331a tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559a564c171f4dd1abb3e4af27987bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a461d4496f4015969f2683af43afa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:37:58.045908 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-7fff928c-e984-4d26-8a06-cb3afb1e331a tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] 10.222.0.26 "GET /compute/v2.1/servers/cedf9f3b-4453-41d4-aa67-547bff886542" status: 200 len: 1359 microversion: 2.1 time: 0.159709 Jul 11 11:37:58.046513 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 942/1890] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:37:57 2022] GET /compute/v2.1/servers/cedf9f3b-4453-41d4-aa67-547bff886542 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:37:59.061683 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-ebae0db1-02cf-4f6d-8cff-df89805e0055 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:37:59.062286 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-ebae0db1-02cf-4f6d-8cff-df89805e0055 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] [instance: cedf9f3b-4453-41d4-aa67-547bff886542] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:37:59.073857 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ebae0db1-02cf-4f6d-8cff-df89805e0055 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:59.073857 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ebae0db1-02cf-4f6d-8cff-df89805e0055 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:59.073857 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ebae0db1-02cf-4f6d-8cff-df89805e0055 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:37:59.073857 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ebae0db1-02cf-4f6d-8cff-df89805e0055 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:37:59.197361 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-ebae0db1-02cf-4f6d-8cff-df89805e0055 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559a564c171f4dd1abb3e4af27987bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a461d4496f4015969f2683af43afa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:37:59.204674 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-ebae0db1-02cf-4f6d-8cff-df89805e0055 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] 10.222.0.26 "GET /compute/v2.1/servers/cedf9f3b-4453-41d4-aa67-547bff886542" status: 200 len: 1359 microversion: 2.1 time: 0.146845 Jul 11 11:37:59.205240 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 949/1891] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:37:59 2022] GET /compute/v2.1/servers/cedf9f3b-4453-41d4-aa67-547bff886542 => generated 1359 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:38:00.220881 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-6edd5f39-1485-419a-9fe4-2d4ec82e650b tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:38:00.221497 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-6edd5f39-1485-419a-9fe4-2d4ec82e650b tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] [instance: cedf9f3b-4453-41d4-aa67-547bff886542] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:38:00.228674 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6edd5f39-1485-419a-9fe4-2d4ec82e650b tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:38:00.229128 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6edd5f39-1485-419a-9fe4-2d4ec82e650b tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:38:00.229891 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6edd5f39-1485-419a-9fe4-2d4ec82e650b tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:38:00.230334 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6edd5f39-1485-419a-9fe4-2d4ec82e650b tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:38:00.363454 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-6edd5f39-1485-419a-9fe4-2d4ec82e650b tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559a564c171f4dd1abb3e4af27987bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a461d4496f4015969f2683af43afa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:38:00.371188 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-6edd5f39-1485-419a-9fe4-2d4ec82e650b tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] 10.222.0.26 "GET /compute/v2.1/servers/cedf9f3b-4453-41d4-aa67-547bff886542" status: 200 len: 1359 microversion: 2.1 time: 0.154161 Jul 11 11:38:00.371783 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 943/1892] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:38:00 2022] GET /compute/v2.1/servers/cedf9f3b-4453-41d4-aa67-547bff886542 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:38:01.387858 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-f9773b14-032b-469d-b793-477ec2c0a4f2 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:38:01.388462 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-f9773b14-032b-469d-b793-477ec2c0a4f2 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] [instance: cedf9f3b-4453-41d4-aa67-547bff886542] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:38:01.394504 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f9773b14-032b-469d-b793-477ec2c0a4f2 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:38:01.394947 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f9773b14-032b-469d-b793-477ec2c0a4f2 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:38:01.395846 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f9773b14-032b-469d-b793-477ec2c0a4f2 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:38:01.396281 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f9773b14-032b-469d-b793-477ec2c0a4f2 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:38:01.526045 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-f9773b14-032b-469d-b793-477ec2c0a4f2 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559a564c171f4dd1abb3e4af27987bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a461d4496f4015969f2683af43afa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:38:01.533790 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-f9773b14-032b-469d-b793-477ec2c0a4f2 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] 10.222.0.26 "GET /compute/v2.1/servers/cedf9f3b-4453-41d4-aa67-547bff886542" status: 200 len: 1359 microversion: 2.1 time: 0.150122 Jul 11 11:38:01.534430 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 950/1893] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:38:01 2022] GET /compute/v2.1/servers/cedf9f3b-4453-41d4-aa67-547bff886542 => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:38:02.550919 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-ac9d7264-50f7-4267-a5cf-126a07e65c03 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:38:02.551550 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-ac9d7264-50f7-4267-a5cf-126a07e65c03 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] [instance: cedf9f3b-4453-41d4-aa67-547bff886542] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:38:02.558601 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ac9d7264-50f7-4267-a5cf-126a07e65c03 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:38:02.559048 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ac9d7264-50f7-4267-a5cf-126a07e65c03 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:38:02.559843 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ac9d7264-50f7-4267-a5cf-126a07e65c03 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:38:02.560278 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ac9d7264-50f7-4267-a5cf-126a07e65c03 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:38:02.694500 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-ac9d7264-50f7-4267-a5cf-126a07e65c03 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559a564c171f4dd1abb3e4af27987bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a461d4496f4015969f2683af43afa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:38:02.702727 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-ac9d7264-50f7-4267-a5cf-126a07e65c03 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] 10.222.0.26 "GET /compute/v2.1/servers/cedf9f3b-4453-41d4-aa67-547bff886542" status: 200 len: 1359 microversion: 2.1 time: 0.155611 Jul 11 11:38:02.703305 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 944/1894] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:38:02 2022] GET /compute/v2.1/servers/cedf9f3b-4453-41d4-aa67-547bff886542 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:38:03.719636 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-565aa17d-8fcb-48b7-8aca-67f2cf464f52 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:38:03.720258 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-565aa17d-8fcb-48b7-8aca-67f2cf464f52 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] [instance: cedf9f3b-4453-41d4-aa67-547bff886542] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:38:03.726699 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-565aa17d-8fcb-48b7-8aca-67f2cf464f52 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:38:03.727148 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-565aa17d-8fcb-48b7-8aca-67f2cf464f52 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:38:03.727971 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-565aa17d-8fcb-48b7-8aca-67f2cf464f52 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:38:03.728410 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-565aa17d-8fcb-48b7-8aca-67f2cf464f52 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:38:03.862173 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-565aa17d-8fcb-48b7-8aca-67f2cf464f52 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559a564c171f4dd1abb3e4af27987bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a461d4496f4015969f2683af43afa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:38:03.872242 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-565aa17d-8fcb-48b7-8aca-67f2cf464f52 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] 10.222.0.26 "GET /compute/v2.1/servers/cedf9f3b-4453-41d4-aa67-547bff886542" status: 200 len: 1359 microversion: 2.1 time: 0.156508 Jul 11 11:38:03.872826 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 951/1895] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:38:03 2022] GET /compute/v2.1/servers/cedf9f3b-4453-41d4-aa67-547bff886542 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:38:03.932808 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [req-07bfb9aa-1916-4844-93db-0fbf32f20a07 req-dd0b462b-7114-4f4f-9924-78b725419097 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cedf9f3b-4453-41d4-aa67-547bff886542", "name": "network-vif-plugged", "status": "completed", "tag": "d54240af-33ee-4d7a-a812-19b21e1319d6"}]} {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:38:03.942422 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [req-07bfb9aa-1916-4844-93db-0fbf32f20a07 req-dd0b462b-7114-4f4f-9924-78b725419097 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:38:03.942871 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [req-07bfb9aa-1916-4844-93db-0fbf32f20a07 req-dd0b462b-7114-4f4f-9924-78b725419097 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:38:03.955280 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.compute.server_external_events [req-07bfb9aa-1916-4844-93db-0fbf32f20a07 req-dd0b462b-7114-4f4f-9924-78b725419097 service nova] Creating event network-vif-plugged:d54240af-33ee-4d7a-a812-19b21e1319d6 for instance cedf9f3b-4453-41d4-aa67-547bff886542 on hv-cinder-84842 Jul 11 11:38:03.960442 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [req-07bfb9aa-1916-4844-93db-0fbf32f20a07 req-dd0b462b-7114-4f4f-9924-78b725419097 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032008 Jul 11 11:38:03.961018 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 945/1896] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 11:38:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:38:04.888908 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-bc3d1c3b-69c3-4fef-9d83-313e6c26d926 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:38:04.889635 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-bc3d1c3b-69c3-4fef-9d83-313e6c26d926 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] [instance: cedf9f3b-4453-41d4-aa67-547bff886542] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:38:04.896136 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bc3d1c3b-69c3-4fef-9d83-313e6c26d926 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:38:04.896580 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bc3d1c3b-69c3-4fef-9d83-313e6c26d926 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:38:04.897334 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bc3d1c3b-69c3-4fef-9d83-313e6c26d926 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:38:04.897770 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bc3d1c3b-69c3-4fef-9d83-313e6c26d926 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:38:05.028800 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-bc3d1c3b-69c3-4fef-9d83-313e6c26d926 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559a564c171f4dd1abb3e4af27987bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a461d4496f4015969f2683af43afa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:38:05.036117 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-bc3d1c3b-69c3-4fef-9d83-313e6c26d926 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] 10.222.0.26 "GET /compute/v2.1/servers/cedf9f3b-4453-41d4-aa67-547bff886542" status: 200 len: 1359 microversion: 2.1 time: 0.151028 Jul 11 11:38:05.036678 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 952/1897] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:38:04 2022] GET /compute/v2.1/servers/cedf9f3b-4453-41d4-aa67-547bff886542 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:38:06.058251 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-a7647334-6532-4ce5-9a75-c862eb3c2568 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:38:06.058251 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-a7647334-6532-4ce5-9a75-c862eb3c2568 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] [instance: cedf9f3b-4453-41d4-aa67-547bff886542] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:38:06.062165 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a7647334-6532-4ce5-9a75-c862eb3c2568 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:38:06.062618 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a7647334-6532-4ce5-9a75-c862eb3c2568 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:38:06.063421 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a7647334-6532-4ce5-9a75-c862eb3c2568 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:38:06.063867 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a7647334-6532-4ce5-9a75-c862eb3c2568 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:38:06.229869 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-a7647334-6532-4ce5-9a75-c862eb3c2568 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559a564c171f4dd1abb3e4af27987bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a461d4496f4015969f2683af43afa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:38:06.238983 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-a7647334-6532-4ce5-9a75-c862eb3c2568 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] 10.222.0.26 "GET /compute/v2.1/servers/cedf9f3b-4453-41d4-aa67-547bff886542" status: 200 len: 1359 microversion: 2.1 time: 0.189575 Jul 11 11:38:06.239596 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 946/1898] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:38:06 2022] GET /compute/v2.1/servers/cedf9f3b-4453-41d4-aa67-547bff886542 => generated 1359 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:38:07.260191 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-faad3c83-27d8-4e63-83d5-15b9b954e2dc tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:38:07.260191 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-faad3c83-27d8-4e63-83d5-15b9b954e2dc tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] [instance: cedf9f3b-4453-41d4-aa67-547bff886542] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:38:07.264251 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-faad3c83-27d8-4e63-83d5-15b9b954e2dc tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:38:07.264705 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-faad3c83-27d8-4e63-83d5-15b9b954e2dc tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:38:07.265483 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-faad3c83-27d8-4e63-83d5-15b9b954e2dc tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:38:07.265915 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-faad3c83-27d8-4e63-83d5-15b9b954e2dc tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:38:07.393214 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-faad3c83-27d8-4e63-83d5-15b9b954e2dc tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559a564c171f4dd1abb3e4af27987bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a461d4496f4015969f2683af43afa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:38:07.400855 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-faad3c83-27d8-4e63-83d5-15b9b954e2dc tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] 10.222.0.26 "GET /compute/v2.1/servers/cedf9f3b-4453-41d4-aa67-547bff886542" status: 200 len: 1548 microversion: 2.1 time: 0.147877 Jul 11 11:38:07.401420 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 953/1899] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:38:07 2022] GET /compute/v2.1/servers/cedf9f3b-4453-41d4-aa67-547bff886542 => generated 1548 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:38:07.417175 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-c249a323-41d0-4f67-bfbc-0c3eeaad428d tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:38:07.417793 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-c249a323-41d0-4f67-bfbc-0c3eeaad428d tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] [instance: cedf9f3b-4453-41d4-aa67-547bff886542] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:38:07.424253 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c249a323-41d0-4f67-bfbc-0c3eeaad428d tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:38:07.424705 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c249a323-41d0-4f67-bfbc-0c3eeaad428d tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:38:07.425465 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c249a323-41d0-4f67-bfbc-0c3eeaad428d tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:38:07.425901 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c249a323-41d0-4f67-bfbc-0c3eeaad428d tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:38:07.553247 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-c249a323-41d0-4f67-bfbc-0c3eeaad428d tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559a564c171f4dd1abb3e4af27987bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a461d4496f4015969f2683af43afa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:38:07.561372 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-c249a323-41d0-4f67-bfbc-0c3eeaad428d tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] 10.222.0.26 "GET /compute/v2.1/servers/cedf9f3b-4453-41d4-aa67-547bff886542" status: 200 len: 1548 microversion: 2.1 time: 0.148468 Jul 11 11:38:07.561942 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 947/1900] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:38:07 2022] GET /compute/v2.1/servers/cedf9f3b-4453-41d4-aa67-547bff886542 => generated 1548 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:38:07.577081 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-91f01485-f372-4494-841f-6a750cf2d10d tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:38:07.580499 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-91f01485-f372-4494-841f-6a750cf2d10d tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '559a564c171f4dd1abb3e4af27987bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a461d4496f4015969f2683af43afa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:38:07.581255 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-91f01485-f372-4494-841f-6a750cf2d10d tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Searching by: {'deleted': False, 'project_id': '72a461d4496f4015969f2683af43afa7'} {{(pid=118321) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 11 11:38:07.588335 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-91f01485-f372-4494-841f-6a750cf2d10d tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:38:07.588780 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-91f01485-f372-4494-841f-6a750cf2d10d tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:38:07.589601 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-91f01485-f372-4494-841f-6a750cf2d10d tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:38:07.590035 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-91f01485-f372-4494-841f-6a750cf2d10d tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:38:07.679095 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.multi_cell_list [None req-91f01485-f372-4494-841f-6a750cf2d10d tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118321) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 11 11:38:07.772591 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-91f01485-f372-4494-841f-6a750cf2d10d tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.199224 Jul 11 11:38:07.773087 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 954/1901] 10.222.0.26 () {58 vars in 1124 bytes} [Mon Jul 11 11:38:07 2022] GET /compute/v2.1/servers => generated 343 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:38:07.783343 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-993d9c78-eab4-4c96-b230-c1fffa07da5b tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:38:07.783949 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-993d9c78-eab4-4c96-b230-c1fffa07da5b tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] [instance: cedf9f3b-4453-41d4-aa67-547bff886542] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:38:07.789901 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-993d9c78-eab4-4c96-b230-c1fffa07da5b tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:38:07.790356 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-993d9c78-eab4-4c96-b230-c1fffa07da5b tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:38:07.791152 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-993d9c78-eab4-4c96-b230-c1fffa07da5b tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:38:07.791609 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-993d9c78-eab4-4c96-b230-c1fffa07da5b tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:38:07.918020 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-993d9c78-eab4-4c96-b230-c1fffa07da5b tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559a564c171f4dd1abb3e4af27987bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a461d4496f4015969f2683af43afa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:38:07.925568 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-993d9c78-eab4-4c96-b230-c1fffa07da5b tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] 10.222.0.26 "GET /compute/v2.1/servers/cedf9f3b-4453-41d4-aa67-547bff886542" status: 200 len: 1548 microversion: 2.1 time: 0.146186 Jul 11 11:38:07.926142 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 948/1902] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:38:07 2022] GET /compute/v2.1/servers/cedf9f3b-4453-41d4-aa67-547bff886542 => generated 1548 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:40:12.960834 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6e7662ca-0840-4af7-a170-09ca74b9449f] AMQP server on 10.222.0.26:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 11 11:40:12.961646 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:40:12.962366 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell0:SELECT=2 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:40:12.962989 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=64 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:40:12.966859 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-a4192ea6-e390-49a3-b32a-b1d4a9a993fb tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:40:12.967263 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-a4192ea6-e390-49a3-b32a-b1d4a9a993fb tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:40:12.973267 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a4192ea6-e390-49a3-b32a-b1d4a9a993fb tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:40:12.973748 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a4192ea6-e390-49a3-b32a-b1d4a9a993fb tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:40:12.977036 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a4192ea6-e390-49a3-b32a-b1d4a9a993fb tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:40:12.977036 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a4192ea6-e390-49a3-b32a-b1d4a9a993fb tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:40:13.001629 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-a4192ea6-e390-49a3-b32a-b1d4a9a993fb tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Going to try to terminate instance {{(pid=118321) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 11:40:13.424987 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-a4192ea6-e390-49a3-b32a-b1d4a9a993fb tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "DELETE /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 204 len: 0 microversion: 2.1 time: 0.465659 Jul 11 11:40:13.425585 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 955/1903] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 11 11:40:12 2022] DELETE /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 11 11:40:13.432642 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR oslo.messaging._drivers.impl_rabbit [-] [73153c7c-8222-4333-b8ec-ad525dae098f] AMQP server on 10.222.0.26:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 11 11:40:13.443068 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:40:13.443068 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=64 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:40:13.443068 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-b11265f9-b980-45dc-8f81-0b8cd710bee3 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:40:13.443068 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-b11265f9-b980-45dc-8f81-0b8cd710bee3 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:40:13.444471 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b11265f9-b980-45dc-8f81-0b8cd710bee3 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:40:13.444924 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b11265f9-b980-45dc-8f81-0b8cd710bee3 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:40:13.445698 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b11265f9-b980-45dc-8f81-0b8cd710bee3 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:40:13.446407 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b11265f9-b980-45dc-8f81-0b8cd710bee3 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:40:13.579396 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-b11265f9-b980-45dc-8f81-0b8cd710bee3 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:40:13.587246 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-b11265f9-b980-45dc-8f81-0b8cd710bee3 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.156886 Jul 11 11:40:13.587845 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 949/1904] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:40:13 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:40:14.605277 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-3b2db851-121f-49ae-8b43-e13ceb8a78da tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:40:14.605966 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-3b2db851-121f-49ae-8b43-e13ceb8a78da tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:40:14.613738 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3b2db851-121f-49ae-8b43-e13ceb8a78da tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:40:14.614176 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3b2db851-121f-49ae-8b43-e13ceb8a78da tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:40:14.615440 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3b2db851-121f-49ae-8b43-e13ceb8a78da tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:40:14.615870 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3b2db851-121f-49ae-8b43-e13ceb8a78da tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:40:14.621014 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO oslo.messaging._drivers.impl_rabbit [-] [6e7662ca-0840-4af7-a170-09ca74b9449f] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 43566. Jul 11 11:40:14.742939 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-3b2db851-121f-49ae-8b43-e13ceb8a78da tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:40:14.750802 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-3b2db851-121f-49ae-8b43-e13ceb8a78da tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.149753 Jul 11 11:40:14.751396 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 956/1905] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:40:14 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:40:15.768519 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-947516f1-f01e-4cf6-b7f7-843c065a8bd9 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:40:15.769168 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-947516f1-f01e-4cf6-b7f7-843c065a8bd9 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:40:15.778222 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-947516f1-f01e-4cf6-b7f7-843c065a8bd9 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:40:15.778676 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-947516f1-f01e-4cf6-b7f7-843c065a8bd9 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:40:15.779482 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-947516f1-f01e-4cf6-b7f7-843c065a8bd9 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:40:15.779925 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-947516f1-f01e-4cf6-b7f7-843c065a8bd9 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:40:15.795416 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO oslo.messaging._drivers.impl_rabbit [-] [73153c7c-8222-4333-b8ec-ad525dae098f] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 43580. Jul 11 11:40:15.907206 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-947516f1-f01e-4cf6-b7f7-843c065a8bd9 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:40:15.915172 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-947516f1-f01e-4cf6-b7f7-843c065a8bd9 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.151146 Jul 11 11:40:15.915762 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 950/1906] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:40:15 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:40:16.931665 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-7050eeaa-759b-4d7e-9052-be1ef688628b tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:40:16.932292 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-7050eeaa-759b-4d7e-9052-be1ef688628b tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:40:16.939063 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7050eeaa-759b-4d7e-9052-be1ef688628b tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:40:16.939542 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7050eeaa-759b-4d7e-9052-be1ef688628b tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:40:16.940302 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7050eeaa-759b-4d7e-9052-be1ef688628b tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:40:16.940740 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7050eeaa-759b-4d7e-9052-be1ef688628b tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:40:17.079690 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-7050eeaa-759b-4d7e-9052-be1ef688628b tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:40:17.085158 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-7050eeaa-759b-4d7e-9052-be1ef688628b tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.157322 Jul 11 11:40:17.085726 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 957/1907] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:40:16 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:40:18.102376 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-c4647cf9-974a-4046-b1a8-ec44e3aca4d8 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:40:18.102985 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-c4647cf9-974a-4046-b1a8-ec44e3aca4d8 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:40:18.109098 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c4647cf9-974a-4046-b1a8-ec44e3aca4d8 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:40:18.109546 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c4647cf9-974a-4046-b1a8-ec44e3aca4d8 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:40:18.110308 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c4647cf9-974a-4046-b1a8-ec44e3aca4d8 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:40:18.110748 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c4647cf9-974a-4046-b1a8-ec44e3aca4d8 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:40:18.252613 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-c4647cf9-974a-4046-b1a8-ec44e3aca4d8 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:40:18.260938 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-c4647cf9-974a-4046-b1a8-ec44e3aca4d8 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.162986 Jul 11 11:40:18.261839 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 951/1908] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:40:18 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:40:19.277915 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-1d74ca67-6c79-4f5f-8228-e60404fd43e7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:40:19.278550 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-1d74ca67-6c79-4f5f-8228-e60404fd43e7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:40:19.284912 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1d74ca67-6c79-4f5f-8228-e60404fd43e7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:40:19.285357 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1d74ca67-6c79-4f5f-8228-e60404fd43e7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:40:19.286103 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1d74ca67-6c79-4f5f-8228-e60404fd43e7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:40:19.286563 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1d74ca67-6c79-4f5f-8228-e60404fd43e7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:40:19.418412 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-1d74ca67-6c79-4f5f-8228-e60404fd43e7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:40:19.426311 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-1d74ca67-6c79-4f5f-8228-e60404fd43e7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.152161 Jul 11 11:40:19.426894 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 958/1909] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:40:19 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:40:20.443302 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-5e7d49e0-69f5-4689-ade2-a70aff1da203 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:40:20.443908 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-5e7d49e0-69f5-4689-ade2-a70aff1da203 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:40:20.450630 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5e7d49e0-69f5-4689-ade2-a70aff1da203 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:40:20.451075 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5e7d49e0-69f5-4689-ade2-a70aff1da203 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:40:20.451849 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5e7d49e0-69f5-4689-ade2-a70aff1da203 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:40:20.452280 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5e7d49e0-69f5-4689-ade2-a70aff1da203 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:40:20.579883 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-5e7d49e0-69f5-4689-ade2-a70aff1da203 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:40:20.588222 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-5e7d49e0-69f5-4689-ade2-a70aff1da203 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.148753 Jul 11 11:40:20.588779 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 952/1910] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:40:20 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:40:21.605045 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-264798af-2b65-48af-bdef-16dbb9ac34d5 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:40:21.605656 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-264798af-2b65-48af-bdef-16dbb9ac34d5 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:40:21.612058 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-264798af-2b65-48af-bdef-16dbb9ac34d5 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:40:21.612504 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-264798af-2b65-48af-bdef-16dbb9ac34d5 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:40:21.613274 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-264798af-2b65-48af-bdef-16dbb9ac34d5 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:40:21.613691 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-264798af-2b65-48af-bdef-16dbb9ac34d5 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:40:21.738931 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-264798af-2b65-48af-bdef-16dbb9ac34d5 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:40:21.747213 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-264798af-2b65-48af-bdef-16dbb9ac34d5 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.145973 Jul 11 11:40:21.747819 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 959/1911] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:40:21 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:40:22.764700 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-eba282f4-2353-454e-ae31-749ec5861aa7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:40:22.765302 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-eba282f4-2353-454e-ae31-749ec5861aa7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:40:22.771694 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-eba282f4-2353-454e-ae31-749ec5861aa7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:40:22.772137 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-eba282f4-2353-454e-ae31-749ec5861aa7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:40:22.773505 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-eba282f4-2353-454e-ae31-749ec5861aa7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:40:22.773935 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-eba282f4-2353-454e-ae31-749ec5861aa7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:40:22.901978 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-eba282f4-2353-454e-ae31-749ec5861aa7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:40:22.909799 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-eba282f4-2353-454e-ae31-749ec5861aa7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.148923 Jul 11 11:40:22.910356 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 953/1912] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:40:22 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:40:23.926867 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-437384d8-c967-4d2b-834e-2f1c89c4c723 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:40:23.927519 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-437384d8-c967-4d2b-834e-2f1c89c4c723 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:40:23.934620 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-437384d8-c967-4d2b-834e-2f1c89c4c723 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:40:23.935065 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-437384d8-c967-4d2b-834e-2f1c89c4c723 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:40:23.935852 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-437384d8-c967-4d2b-834e-2f1c89c4c723 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:40:23.936280 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-437384d8-c967-4d2b-834e-2f1c89c4c723 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:40:24.067872 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-437384d8-c967-4d2b-834e-2f1c89c4c723 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:40:24.076289 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-437384d8-c967-4d2b-834e-2f1c89c4c723 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.153196 Jul 11 11:40:24.076881 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 960/1913] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:40:23 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:40:25.093725 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-72316cd6-b68f-4eac-bc67-a9166dabb3d9 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:40:25.094345 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-72316cd6-b68f-4eac-bc67-a9166dabb3d9 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:40:25.100962 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-72316cd6-b68f-4eac-bc67-a9166dabb3d9 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:40:25.101413 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-72316cd6-b68f-4eac-bc67-a9166dabb3d9 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:40:25.102205 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-72316cd6-b68f-4eac-bc67-a9166dabb3d9 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:40:25.102641 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-72316cd6-b68f-4eac-bc67-a9166dabb3d9 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:40:25.228047 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-72316cd6-b68f-4eac-bc67-a9166dabb3d9 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:40:25.235938 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-72316cd6-b68f-4eac-bc67-a9166dabb3d9 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.146068 Jul 11 11:40:25.236507 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 954/1914] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:40:25 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:40:26.253761 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-446db6da-7b14-4c01-a8ff-0f7e7ad96fa5 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:40:26.254394 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-446db6da-7b14-4c01-a8ff-0f7e7ad96fa5 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:40:26.260831 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-446db6da-7b14-4c01-a8ff-0f7e7ad96fa5 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:40:26.261271 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-446db6da-7b14-4c01-a8ff-0f7e7ad96fa5 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:40:26.262025 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-446db6da-7b14-4c01-a8ff-0f7e7ad96fa5 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:40:26.262452 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-446db6da-7b14-4c01-a8ff-0f7e7ad96fa5 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:40:26.387699 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-446db6da-7b14-4c01-a8ff-0f7e7ad96fa5 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:40:26.395491 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-446db6da-7b14-4c01-a8ff-0f7e7ad96fa5 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.145522 Jul 11 11:40:26.396055 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 961/1915] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:40:26 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:40:27.413041 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-02b98588-9373-4b47-94f9-8e9ea0dd3132 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:40:27.413648 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-02b98588-9373-4b47-94f9-8e9ea0dd3132 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:40:27.420963 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-02b98588-9373-4b47-94f9-8e9ea0dd3132 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:40:27.421411 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-02b98588-9373-4b47-94f9-8e9ea0dd3132 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:40:27.422161 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-02b98588-9373-4b47-94f9-8e9ea0dd3132 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:40:27.422591 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-02b98588-9373-4b47-94f9-8e9ea0dd3132 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:40:27.556684 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-02b98588-9373-4b47-94f9-8e9ea0dd3132 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:40:27.564889 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-02b98588-9373-4b47-94f9-8e9ea0dd3132 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.155658 Jul 11 11:40:27.565474 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 955/1916] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:40:27 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:40:28.581908 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-3d78c31c-309c-4d85-88ac-6a0e99c4b0ac tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:40:28.582522 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-3d78c31c-309c-4d85-88ac-6a0e99c4b0ac tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:40:28.589703 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3d78c31c-309c-4d85-88ac-6a0e99c4b0ac tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:40:28.590278 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3d78c31c-309c-4d85-88ac-6a0e99c4b0ac tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:40:28.590910 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3d78c31c-309c-4d85-88ac-6a0e99c4b0ac tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:40:28.591405 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3d78c31c-309c-4d85-88ac-6a0e99c4b0ac tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:40:28.728060 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-3d78c31c-309c-4d85-88ac-6a0e99c4b0ac tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:40:28.735946 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-3d78c31c-309c-4d85-88ac-6a0e99c4b0ac tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.157997 Jul 11 11:40:28.736508 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 962/1917] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:40:28 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:40:29.752639 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-8c445a07-bd61-468f-8cae-ae64d0fa2079 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:40:29.753439 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-8c445a07-bd61-468f-8cae-ae64d0fa2079 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:40:29.761882 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8c445a07-bd61-468f-8cae-ae64d0fa2079 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:40:29.762329 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8c445a07-bd61-468f-8cae-ae64d0fa2079 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:40:29.763097 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8c445a07-bd61-468f-8cae-ae64d0fa2079 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:40:29.763557 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8c445a07-bd61-468f-8cae-ae64d0fa2079 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:40:29.897389 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-8c445a07-bd61-468f-8cae-ae64d0fa2079 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:40:29.912806 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-8c445a07-bd61-468f-8cae-ae64d0fa2079 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.163929 Jul 11 11:40:29.913385 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 956/1918] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:40:29 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:40:30.930566 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-658b84a7-4ea5-427b-b00a-f3c9a1bcadc0 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:40:30.931110 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-658b84a7-4ea5-427b-b00a-f3c9a1bcadc0 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:40:30.937575 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-658b84a7-4ea5-427b-b00a-f3c9a1bcadc0 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:40:30.938034 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-658b84a7-4ea5-427b-b00a-f3c9a1bcadc0 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:40:30.938821 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-658b84a7-4ea5-427b-b00a-f3c9a1bcadc0 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:40:30.939307 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-658b84a7-4ea5-427b-b00a-f3c9a1bcadc0 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:40:31.068587 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-658b84a7-4ea5-427b-b00a-f3c9a1bcadc0 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:40:31.076845 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-658b84a7-4ea5-427b-b00a-f3c9a1bcadc0 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.150739 Jul 11 11:40:31.077415 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 963/1919] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:40:30 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:40:32.094108 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-3dd8b57a-0f91-49be-aafe-56222167313f tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:40:32.094765 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-3dd8b57a-0f91-49be-aafe-56222167313f tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:40:32.101424 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3dd8b57a-0f91-49be-aafe-56222167313f tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:40:32.101877 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3dd8b57a-0f91-49be-aafe-56222167313f tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:40:32.102684 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3dd8b57a-0f91-49be-aafe-56222167313f tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:40:32.103125 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3dd8b57a-0f91-49be-aafe-56222167313f tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:40:32.230829 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-3dd8b57a-0f91-49be-aafe-56222167313f tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:40:32.238756 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-3dd8b57a-0f91-49be-aafe-56222167313f tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.148633 Jul 11 11:40:32.239341 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 957/1920] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:40:32 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:40:33.256159 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-7f4dbe7c-01ea-47d2-9b49-88d36a81f63c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:40:33.256765 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-7f4dbe7c-01ea-47d2-9b49-88d36a81f63c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:40:33.263616 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7f4dbe7c-01ea-47d2-9b49-88d36a81f63c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:40:33.264053 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7f4dbe7c-01ea-47d2-9b49-88d36a81f63c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:40:33.264800 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7f4dbe7c-01ea-47d2-9b49-88d36a81f63c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:40:33.265230 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7f4dbe7c-01ea-47d2-9b49-88d36a81f63c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:40:33.399702 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-7f4dbe7c-01ea-47d2-9b49-88d36a81f63c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:40:33.407813 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-7f4dbe7c-01ea-47d2-9b49-88d36a81f63c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.155495 Jul 11 11:40:33.408400 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 964/1921] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:40:33 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:40:34.424244 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-43bcda9f-1290-4883-9c5a-e6b0fcbed2d9 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:40:34.424851 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-43bcda9f-1290-4883-9c5a-e6b0fcbed2d9 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:40:34.431436 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-43bcda9f-1290-4883-9c5a-e6b0fcbed2d9 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:40:34.431808 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-43bcda9f-1290-4883-9c5a-e6b0fcbed2d9 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:40:34.432571 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-43bcda9f-1290-4883-9c5a-e6b0fcbed2d9 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:40:34.433003 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-43bcda9f-1290-4883-9c5a-e6b0fcbed2d9 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:40:34.569542 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-43bcda9f-1290-4883-9c5a-e6b0fcbed2d9 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:40:34.577821 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-43bcda9f-1290-4883-9c5a-e6b0fcbed2d9 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.157494 Jul 11 11:40:34.578385 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 958/1922] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:40:34 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:40:35.594857 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-9c673c1d-c219-4f1e-871c-73ea7af6ae2c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:40:35.595498 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-9c673c1d-c219-4f1e-871c-73ea7af6ae2c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:40:35.602008 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9c673c1d-c219-4f1e-871c-73ea7af6ae2c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:40:35.602454 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9c673c1d-c219-4f1e-871c-73ea7af6ae2c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:40:35.603213 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9c673c1d-c219-4f1e-871c-73ea7af6ae2c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:40:35.603672 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9c673c1d-c219-4f1e-871c-73ea7af6ae2c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:40:35.878474 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-9c673c1d-c219-4f1e-871c-73ea7af6ae2c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:40:35.886900 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-9c673c1d-c219-4f1e-871c-73ea7af6ae2c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.295893 Jul 11 11:40:35.887490 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 965/1923] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:40:35 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:40:36.903850 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-8501fdcc-0da4-4836-90f4-0fc53756780a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:40:36.904466 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-8501fdcc-0da4-4836-90f4-0fc53756780a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:40:36.911238 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8501fdcc-0da4-4836-90f4-0fc53756780a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:40:36.911708 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8501fdcc-0da4-4836-90f4-0fc53756780a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:40:36.912487 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8501fdcc-0da4-4836-90f4-0fc53756780a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:40:36.912915 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8501fdcc-0da4-4836-90f4-0fc53756780a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:40:37.041587 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-8501fdcc-0da4-4836-90f4-0fc53756780a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:40:37.049810 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-8501fdcc-0da4-4836-90f4-0fc53756780a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.149812 Jul 11 11:40:37.054696 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 959/1924] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:40:36 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:40:38.083944 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-0b160023-8901-47ce-9a10-556cc8cad10e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:40:38.083944 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-0b160023-8901-47ce-9a10-556cc8cad10e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:40:38.088233 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0b160023-8901-47ce-9a10-556cc8cad10e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:40:38.088710 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0b160023-8901-47ce-9a10-556cc8cad10e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:40:38.089471 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0b160023-8901-47ce-9a10-556cc8cad10e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:40:38.089899 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0b160023-8901-47ce-9a10-556cc8cad10e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:40:38.221836 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-0b160023-8901-47ce-9a10-556cc8cad10e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:40:38.230274 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-0b160023-8901-47ce-9a10-556cc8cad10e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.156654 Jul 11 11:40:38.230829 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 966/1925] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:40:38 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:40:39.247068 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-0180994a-55ae-4343-ab2f-b9868b378a75 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:40:39.247698 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-0180994a-55ae-4343-ab2f-b9868b378a75 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:40:39.254067 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0180994a-55ae-4343-ab2f-b9868b378a75 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:40:39.254514 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0180994a-55ae-4343-ab2f-b9868b378a75 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:40:39.255277 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0180994a-55ae-4343-ab2f-b9868b378a75 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:40:39.255725 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0180994a-55ae-4343-ab2f-b9868b378a75 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:40:39.387564 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-0180994a-55ae-4343-ab2f-b9868b378a75 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:40:39.395418 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-0180994a-55ae-4343-ab2f-b9868b378a75 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.152205 Jul 11 11:40:39.395979 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 960/1926] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:40:39 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:40:40.412789 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-98372cb0-9e53-43d4-b889-fa4b87f9e9f8 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:40:40.413398 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-98372cb0-9e53-43d4-b889-fa4b87f9e9f8 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:40:40.419829 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-98372cb0-9e53-43d4-b889-fa4b87f9e9f8 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:40:40.420270 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-98372cb0-9e53-43d4-b889-fa4b87f9e9f8 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:40:40.421022 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-98372cb0-9e53-43d4-b889-fa4b87f9e9f8 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:40:40.421451 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-98372cb0-9e53-43d4-b889-fa4b87f9e9f8 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:40:40.552070 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-98372cb0-9e53-43d4-b889-fa4b87f9e9f8 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:40:40.560613 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-98372cb0-9e53-43d4-b889-fa4b87f9e9f8 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.151633 Jul 11 11:40:40.561177 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 967/1927] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:40:40 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:40:41.578056 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-6b5e001f-12bf-49c2-8108-2d5bb2c34ffb tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:40:41.578660 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-6b5e001f-12bf-49c2-8108-2d5bb2c34ffb tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:40:41.585260 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6b5e001f-12bf-49c2-8108-2d5bb2c34ffb tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:40:41.585648 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6b5e001f-12bf-49c2-8108-2d5bb2c34ffb tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:40:41.586398 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6b5e001f-12bf-49c2-8108-2d5bb2c34ffb tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:40:41.586856 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6b5e001f-12bf-49c2-8108-2d5bb2c34ffb tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:40:41.712621 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-6b5e001f-12bf-49c2-8108-2d5bb2c34ffb tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:40:41.720437 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-6b5e001f-12bf-49c2-8108-2d5bb2c34ffb tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.146250 Jul 11 11:40:41.721007 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 961/1928] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:40:41 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:40:42.736776 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-f0c620ca-6ed4-43a4-b68e-e72f1d201ac1 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:40:42.737381 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-f0c620ca-6ed4-43a4-b68e-e72f1d201ac1 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:40:42.743846 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f0c620ca-6ed4-43a4-b68e-e72f1d201ac1 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:40:42.744292 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f0c620ca-6ed4-43a4-b68e-e72f1d201ac1 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:40:42.745146 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f0c620ca-6ed4-43a4-b68e-e72f1d201ac1 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:40:42.745580 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f0c620ca-6ed4-43a4-b68e-e72f1d201ac1 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:40:42.869338 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-f0c620ca-6ed4-43a4-b68e-e72f1d201ac1 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:40:42.877076 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-f0c620ca-6ed4-43a4-b68e-e72f1d201ac1 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.144213 Jul 11 11:40:42.877635 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 968/1929] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:40:42 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:40:43.894380 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-d3efe485-6312-4f98-866e-26fdb50b87a1 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:40:43.894903 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-d3efe485-6312-4f98-866e-26fdb50b87a1 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:40:43.901830 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d3efe485-6312-4f98-866e-26fdb50b87a1 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:40:43.902271 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d3efe485-6312-4f98-866e-26fdb50b87a1 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:40:43.903016 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d3efe485-6312-4f98-866e-26fdb50b87a1 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:40:43.903469 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d3efe485-6312-4f98-866e-26fdb50b87a1 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:40:44.029318 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-d3efe485-6312-4f98-866e-26fdb50b87a1 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:40:44.037387 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-d3efe485-6312-4f98-866e-26fdb50b87a1 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.146921 Jul 11 11:40:44.037988 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 962/1930] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:40:43 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:40:45.054433 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-e1324e2b-de42-4770-8930-cfcdb3c583c1 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:40:45.055006 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-e1324e2b-de42-4770-8930-cfcdb3c583c1 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:40:45.056896 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:40:45.062325 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e1324e2b-de42-4770-8930-cfcdb3c583c1 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:40:45.062771 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e1324e2b-de42-4770-8930-cfcdb3c583c1 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:40:45.063644 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e1324e2b-de42-4770-8930-cfcdb3c583c1 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:40:45.064078 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e1324e2b-de42-4770-8930-cfcdb3c583c1 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:40:45.066673 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:40:45.194907 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-e1324e2b-de42-4770-8930-cfcdb3c583c1 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:40:45.202879 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-e1324e2b-de42-4770-8930-cfcdb3c583c1 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.152655 Jul 11 11:40:45.203484 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 969/1931] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:40:45 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:40:46.220197 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-dd873a22-36fe-423c-b25f-98891947cf05 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:40:46.220833 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-dd873a22-36fe-423c-b25f-98891947cf05 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:40:46.222858 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_api:SELECT=29 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:40:46.227571 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-dd873a22-36fe-423c-b25f-98891947cf05 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:40:46.228023 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-dd873a22-36fe-423c-b25f-98891947cf05 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:40:46.237669 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-dd873a22-36fe-423c-b25f-98891947cf05 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:40:46.237669 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-dd873a22-36fe-423c-b25f-98891947cf05 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:40:46.237669 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=85 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:40:46.360908 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-dd873a22-36fe-423c-b25f-98891947cf05 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:40:46.368756 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-dd873a22-36fe-423c-b25f-98891947cf05 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.152424 Jul 11 11:40:46.369330 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 963/1932] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:40:46 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:40:47.386538 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-31268b6b-d6fc-4a45-91bb-894efefc1c80 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:40:47.387097 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-31268b6b-d6fc-4a45-91bb-894efefc1c80 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:40:47.393635 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-31268b6b-d6fc-4a45-91bb-894efefc1c80 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:40:47.394076 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-31268b6b-d6fc-4a45-91bb-894efefc1c80 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:40:47.394827 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-31268b6b-d6fc-4a45-91bb-894efefc1c80 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:40:47.395276 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-31268b6b-d6fc-4a45-91bb-894efefc1c80 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:40:47.521669 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-31268b6b-d6fc-4a45-91bb-894efefc1c80 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:40:47.529460 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-31268b6b-d6fc-4a45-91bb-894efefc1c80 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.147439 Jul 11 11:40:47.530029 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 970/1933] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:40:47 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:40:48.546590 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-29d1c3fc-fc13-42ea-93bc-31bcca23df47 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:40:48.547234 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-29d1c3fc-fc13-42ea-93bc-31bcca23df47 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:40:48.554021 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-29d1c3fc-fc13-42ea-93bc-31bcca23df47 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:40:48.554480 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-29d1c3fc-fc13-42ea-93bc-31bcca23df47 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:40:48.555272 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-29d1c3fc-fc13-42ea-93bc-31bcca23df47 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:40:48.555718 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-29d1c3fc-fc13-42ea-93bc-31bcca23df47 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:40:48.688604 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-29d1c3fc-fc13-42ea-93bc-31bcca23df47 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:40:48.697489 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-29d1c3fc-fc13-42ea-93bc-31bcca23df47 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.154754 Jul 11 11:40:48.698051 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 964/1934] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:40:48 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:40:49.714940 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-e831d7f2-a239-45c9-8c28-48f300707922 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:40:49.716228 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-e831d7f2-a239-45c9-8c28-48f300707922 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:40:49.722646 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e831d7f2-a239-45c9-8c28-48f300707922 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:40:49.723123 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e831d7f2-a239-45c9-8c28-48f300707922 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:40:49.723944 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e831d7f2-a239-45c9-8c28-48f300707922 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:40:49.724382 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e831d7f2-a239-45c9-8c28-48f300707922 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:40:49.857512 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-e831d7f2-a239-45c9-8c28-48f300707922 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:40:49.865919 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-e831d7f2-a239-45c9-8c28-48f300707922 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.154445 Jul 11 11:40:49.866162 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 971/1935] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:40:49 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:40:50.882723 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-c08f7505-7681-48f1-9ce0-9305c2605252 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:40:50.883367 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-c08f7505-7681-48f1-9ce0-9305c2605252 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:40:50.889892 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c08f7505-7681-48f1-9ce0-9305c2605252 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:40:50.890345 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c08f7505-7681-48f1-9ce0-9305c2605252 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:40:50.891107 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c08f7505-7681-48f1-9ce0-9305c2605252 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:40:50.891572 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c08f7505-7681-48f1-9ce0-9305c2605252 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:40:51.022815 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-c08f7505-7681-48f1-9ce0-9305c2605252 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:40:51.031511 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-c08f7505-7681-48f1-9ce0-9305c2605252 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.152560 Jul 11 11:40:51.032150 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 965/1936] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:40:50 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:40:52.049883 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-463f543c-685b-4dea-a679-9fae1560220e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:40:52.051174 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-463f543c-685b-4dea-a679-9fae1560220e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:40:52.057856 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-463f543c-685b-4dea-a679-9fae1560220e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:40:52.058292 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-463f543c-685b-4dea-a679-9fae1560220e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:40:52.059718 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-463f543c-685b-4dea-a679-9fae1560220e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:40:52.060153 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-463f543c-685b-4dea-a679-9fae1560220e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:40:52.189775 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-463f543c-685b-4dea-a679-9fae1560220e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:40:52.197798 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-463f543c-685b-4dea-a679-9fae1560220e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.151793 Jul 11 11:40:52.198367 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 972/1937] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:40:52 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:40:53.214812 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-e0c8d831-1dc6-4d79-813c-8e16c4f6d2f2 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:40:53.215448 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-e0c8d831-1dc6-4d79-813c-8e16c4f6d2f2 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:40:53.221866 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e0c8d831-1dc6-4d79-813c-8e16c4f6d2f2 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:40:53.222312 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e0c8d831-1dc6-4d79-813c-8e16c4f6d2f2 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:40:53.223071 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e0c8d831-1dc6-4d79-813c-8e16c4f6d2f2 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:40:53.223540 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e0c8d831-1dc6-4d79-813c-8e16c4f6d2f2 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:40:53.347670 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-e0c8d831-1dc6-4d79-813c-8e16c4f6d2f2 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:40:53.356075 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-e0c8d831-1dc6-4d79-813c-8e16c4f6d2f2 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.144531 Jul 11 11:40:53.356648 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 966/1938] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:40:53 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:40:54.372754 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-05efd309-a2aa-4d17-90ba-1387bd9738f3 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:40:54.373356 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-05efd309-a2aa-4d17-90ba-1387bd9738f3 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:40:54.379939 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-05efd309-a2aa-4d17-90ba-1387bd9738f3 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:40:54.380332 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-05efd309-a2aa-4d17-90ba-1387bd9738f3 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:40:54.381088 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-05efd309-a2aa-4d17-90ba-1387bd9738f3 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:40:54.381515 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-05efd309-a2aa-4d17-90ba-1387bd9738f3 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:40:54.505783 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-05efd309-a2aa-4d17-90ba-1387bd9738f3 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:40:54.513666 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-05efd309-a2aa-4d17-90ba-1387bd9738f3 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.145222 Jul 11 11:40:54.514227 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 973/1939] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:40:54 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:40:55.530702 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-8067994e-65b3-47fd-bf51-adc376f05ade tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:40:55.531405 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-8067994e-65b3-47fd-bf51-adc376f05ade tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:40:55.537919 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8067994e-65b3-47fd-bf51-adc376f05ade tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:40:55.538365 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8067994e-65b3-47fd-bf51-adc376f05ade tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:40:55.539120 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8067994e-65b3-47fd-bf51-adc376f05ade tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:40:55.539583 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8067994e-65b3-47fd-bf51-adc376f05ade tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:40:55.669073 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-8067994e-65b3-47fd-bf51-adc376f05ade tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:40:55.677093 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-8067994e-65b3-47fd-bf51-adc376f05ade tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.150339 Jul 11 11:40:55.677653 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 967/1940] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:40:55 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:40:56.694691 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-a36f3b3f-8da3-4d3b-a6a4-dbc04c842630 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:40:56.695310 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-a36f3b3f-8da3-4d3b-a6a4-dbc04c842630 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:40:56.702623 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a36f3b3f-8da3-4d3b-a6a4-dbc04c842630 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:40:56.703061 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a36f3b3f-8da3-4d3b-a6a4-dbc04c842630 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:40:56.703836 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a36f3b3f-8da3-4d3b-a6a4-dbc04c842630 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:40:56.704266 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a36f3b3f-8da3-4d3b-a6a4-dbc04c842630 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:40:56.832962 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-a36f3b3f-8da3-4d3b-a6a4-dbc04c842630 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:40:56.840697 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-a36f3b3f-8da3-4d3b-a6a4-dbc04c842630 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.149959 Jul 11 11:40:56.841257 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 974/1941] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:40:56 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:40:57.857697 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-f8fe702c-edf5-4962-ab28-a744bfb2b3ce tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:40:57.858303 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-f8fe702c-edf5-4962-ab28-a744bfb2b3ce tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:40:57.864809 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f8fe702c-edf5-4962-ab28-a744bfb2b3ce tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:40:57.865254 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f8fe702c-edf5-4962-ab28-a744bfb2b3ce tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:40:57.866004 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f8fe702c-edf5-4962-ab28-a744bfb2b3ce tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:40:57.866437 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f8fe702c-edf5-4962-ab28-a744bfb2b3ce tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:40:57.999468 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-f8fe702c-edf5-4962-ab28-a744bfb2b3ce tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:40:58.007382 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-f8fe702c-edf5-4962-ab28-a744bfb2b3ce tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.153572 Jul 11 11:40:58.007935 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 968/1942] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:40:57 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:40:58.380088 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 11:40:58.380611 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Mon Jul 11 11:40:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 11:40:58.994552 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 11:40:58.995126 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Mon Jul 11 11:40:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 11:40:59.024219 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-9b44a131-337e-44be-ab7d-0cace8c67485 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:40:59.024828 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-9b44a131-337e-44be-ab7d-0cace8c67485 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:40:59.031422 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9b44a131-337e-44be-ab7d-0cace8c67485 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:40:59.031870 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9b44a131-337e-44be-ab7d-0cace8c67485 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:40:59.032623 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9b44a131-337e-44be-ab7d-0cace8c67485 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:40:59.033057 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9b44a131-337e-44be-ab7d-0cace8c67485 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:40:59.160499 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-9b44a131-337e-44be-ab7d-0cace8c67485 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:40:59.168369 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-9b44a131-337e-44be-ab7d-0cace8c67485 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.147920 Jul 11 11:40:59.168938 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 975/1943] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:40:59 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:41:00.184745 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-cfa0a9e1-458f-43b9-8a64-1691bf751616 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:41:00.197452 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-cfa0a9e1-458f-43b9-8a64-1691bf751616 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:41:00.197452 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cfa0a9e1-458f-43b9-8a64-1691bf751616 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:00.197452 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cfa0a9e1-458f-43b9-8a64-1691bf751616 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:00.197452 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cfa0a9e1-458f-43b9-8a64-1691bf751616 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:00.198342 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cfa0a9e1-458f-43b9-8a64-1691bf751616 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:00.327814 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-cfa0a9e1-458f-43b9-8a64-1691bf751616 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:41:00.335746 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-cfa0a9e1-458f-43b9-8a64-1691bf751616 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.154778 Jul 11 11:41:00.336309 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 969/1944] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:41:00 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:41:01.352681 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-77476375-e0bd-4cbb-9328-6d2232d30589 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:41:01.353480 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-77476375-e0bd-4cbb-9328-6d2232d30589 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:41:01.362928 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-77476375-e0bd-4cbb-9328-6d2232d30589 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:01.363420 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-77476375-e0bd-4cbb-9328-6d2232d30589 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:01.364174 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-77476375-e0bd-4cbb-9328-6d2232d30589 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:01.364604 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-77476375-e0bd-4cbb-9328-6d2232d30589 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:01.493844 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-77476375-e0bd-4cbb-9328-6d2232d30589 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:41:01.501837 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-77476375-e0bd-4cbb-9328-6d2232d30589 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.152991 Jul 11 11:41:01.502406 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 976/1945] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:41:01 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:41:01.921678 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 11:41:01.922243 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Mon Jul 11 11:41:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 11:41:02.520051 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-c7bccc35-65ee-47f5-b03a-2074492442ed tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:41:02.520585 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-c7bccc35-65ee-47f5-b03a-2074492442ed tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:41:02.526985 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c7bccc35-65ee-47f5-b03a-2074492442ed tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:02.527478 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c7bccc35-65ee-47f5-b03a-2074492442ed tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:02.528229 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c7bccc35-65ee-47f5-b03a-2074492442ed tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:02.528658 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c7bccc35-65ee-47f5-b03a-2074492442ed tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:02.661030 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-c7bccc35-65ee-47f5-b03a-2074492442ed tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:41:02.668901 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-c7bccc35-65ee-47f5-b03a-2074492442ed tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.152816 Jul 11 11:41:02.669484 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 970/1946] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:41:02 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:41:03.686965 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-bc5a476b-09ed-49f5-8a74-095998da54be tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:41:03.687600 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-bc5a476b-09ed-49f5-8a74-095998da54be tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:41:03.695040 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bc5a476b-09ed-49f5-8a74-095998da54be tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:03.695530 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bc5a476b-09ed-49f5-8a74-095998da54be tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:03.696563 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bc5a476b-09ed-49f5-8a74-095998da54be tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:03.696996 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bc5a476b-09ed-49f5-8a74-095998da54be tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:03.823612 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-bc5a476b-09ed-49f5-8a74-095998da54be tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:41:03.831466 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-bc5a476b-09ed-49f5-8a74-095998da54be tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.148939 Jul 11 11:41:03.832055 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 977/1947] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:41:03 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:41:04.848299 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-43bc70ae-0913-4761-aeec-9ce2c9e11d1d tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:41:04.848913 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-43bc70ae-0913-4761-aeec-9ce2c9e11d1d tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:41:04.855425 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-43bc70ae-0913-4761-aeec-9ce2c9e11d1d tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:04.855873 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-43bc70ae-0913-4761-aeec-9ce2c9e11d1d tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:04.856629 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-43bc70ae-0913-4761-aeec-9ce2c9e11d1d tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:04.857064 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-43bc70ae-0913-4761-aeec-9ce2c9e11d1d tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:04.981567 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-43bc70ae-0913-4761-aeec-9ce2c9e11d1d tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:41:04.989444 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-43bc70ae-0913-4761-aeec-9ce2c9e11d1d tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.144959 Jul 11 11:41:04.989999 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 971/1948] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:41:04 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:41:06.008921 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-b28b14a9-8031-4718-843c-64bcc7672b10 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:41:06.009524 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-b28b14a9-8031-4718-843c-64bcc7672b10 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:41:06.016616 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b28b14a9-8031-4718-843c-64bcc7672b10 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:06.017055 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b28b14a9-8031-4718-843c-64bcc7672b10 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:06.017806 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b28b14a9-8031-4718-843c-64bcc7672b10 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:06.018232 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b28b14a9-8031-4718-843c-64bcc7672b10 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:06.149264 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-b28b14a9-8031-4718-843c-64bcc7672b10 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:41:06.157721 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-b28b14a9-8031-4718-843c-64bcc7672b10 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.152612 Jul 11 11:41:06.158275 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 978/1949] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:41:06 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:41:07.175318 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-28253b76-fece-435d-abb2-ae6efb69f2a7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:41:07.175931 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-28253b76-fece-435d-abb2-ae6efb69f2a7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:41:07.182442 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-28253b76-fece-435d-abb2-ae6efb69f2a7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:07.182890 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-28253b76-fece-435d-abb2-ae6efb69f2a7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:07.183683 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-28253b76-fece-435d-abb2-ae6efb69f2a7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:07.184116 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-28253b76-fece-435d-abb2-ae6efb69f2a7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:07.311940 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-28253b76-fece-435d-abb2-ae6efb69f2a7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:41:07.319763 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-28253b76-fece-435d-abb2-ae6efb69f2a7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.148380 Jul 11 11:41:07.320327 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 972/1950] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:41:07 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:41:08.338536 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-c49e5a5f-d9dd-490a-addf-d98a2e83d3b7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:41:08.339148 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-c49e5a5f-d9dd-490a-addf-d98a2e83d3b7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:41:08.346650 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c49e5a5f-d9dd-490a-addf-d98a2e83d3b7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:08.347099 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c49e5a5f-d9dd-490a-addf-d98a2e83d3b7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:08.347896 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c49e5a5f-d9dd-490a-addf-d98a2e83d3b7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:08.348330 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c49e5a5f-d9dd-490a-addf-d98a2e83d3b7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:08.478898 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-c49e5a5f-d9dd-490a-addf-d98a2e83d3b7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:41:08.487349 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-c49e5a5f-d9dd-490a-addf-d98a2e83d3b7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.153810 Jul 11 11:41:08.487920 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 979/1951] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:41:08 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:41:09.504793 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-3979656e-6ecb-4d91-8c3f-9608674dc1ca tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:41:09.505404 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-3979656e-6ecb-4d91-8c3f-9608674dc1ca tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:41:09.511859 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3979656e-6ecb-4d91-8c3f-9608674dc1ca tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:09.512307 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3979656e-6ecb-4d91-8c3f-9608674dc1ca tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:09.513067 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3979656e-6ecb-4d91-8c3f-9608674dc1ca tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:09.513500 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3979656e-6ecb-4d91-8c3f-9608674dc1ca tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:09.642315 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-3979656e-6ecb-4d91-8c3f-9608674dc1ca tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:41:09.649560 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-3979656e-6ecb-4d91-8c3f-9608674dc1ca tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.148730 Jul 11 11:41:09.650159 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 973/1952] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:41:09 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:41:10.666392 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-673eb2be-d99d-48b1-bf36-b9c3d1450db3 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:41:10.666996 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-673eb2be-d99d-48b1-bf36-b9c3d1450db3 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:41:10.674107 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-673eb2be-d99d-48b1-bf36-b9c3d1450db3 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:10.674544 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-673eb2be-d99d-48b1-bf36-b9c3d1450db3 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:10.675346 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-673eb2be-d99d-48b1-bf36-b9c3d1450db3 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:10.675778 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-673eb2be-d99d-48b1-bf36-b9c3d1450db3 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:10.807750 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-673eb2be-d99d-48b1-bf36-b9c3d1450db3 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:41:10.816134 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-673eb2be-d99d-48b1-bf36-b9c3d1450db3 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.153535 Jul 11 11:41:10.816707 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 980/1953] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:41:10 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:41:11.833097 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-a35b99bd-a98d-4288-824a-ba22ed15d985 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:41:11.833720 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-a35b99bd-a98d-4288-824a-ba22ed15d985 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:41:11.840243 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a35b99bd-a98d-4288-824a-ba22ed15d985 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:11.840693 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a35b99bd-a98d-4288-824a-ba22ed15d985 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:11.841462 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a35b99bd-a98d-4288-824a-ba22ed15d985 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:11.841902 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a35b99bd-a98d-4288-824a-ba22ed15d985 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:11.975624 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-a35b99bd-a98d-4288-824a-ba22ed15d985 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:41:11.983564 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-a35b99bd-a98d-4288-824a-ba22ed15d985 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.154160 Jul 11 11:41:11.984078 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 974/1954] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:41:11 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:41:13.001688 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-1b2496e9-fde5-4eb4-9416-2bdc91bbe77a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:41:13.002419 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-1b2496e9-fde5-4eb4-9416-2bdc91bbe77a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:41:13.008939 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1b2496e9-fde5-4eb4-9416-2bdc91bbe77a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:13.009383 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1b2496e9-fde5-4eb4-9416-2bdc91bbe77a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:13.010137 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1b2496e9-fde5-4eb4-9416-2bdc91bbe77a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:13.010566 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1b2496e9-fde5-4eb4-9416-2bdc91bbe77a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:13.146950 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-1b2496e9-fde5-4eb4-9416-2bdc91bbe77a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:41:13.154735 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-1b2496e9-fde5-4eb4-9416-2bdc91bbe77a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.157580 Jul 11 11:41:13.155307 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 981/1955] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:41:12 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:41:14.171152 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-df098488-fe42-4aa9-94a1-b70b04be95d4 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:41:14.171858 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-df098488-fe42-4aa9-94a1-b70b04be95d4 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:41:14.179518 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-df098488-fe42-4aa9-94a1-b70b04be95d4 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:14.179969 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-df098488-fe42-4aa9-94a1-b70b04be95d4 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:14.180744 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-df098488-fe42-4aa9-94a1-b70b04be95d4 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:14.181179 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-df098488-fe42-4aa9-94a1-b70b04be95d4 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:14.430886 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-df098488-fe42-4aa9-94a1-b70b04be95d4 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:41:14.439153 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-df098488-fe42-4aa9-94a1-b70b04be95d4 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.271844 Jul 11 11:41:14.439741 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 975/1956] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:41:14 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:41:15.019066 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 11:41:15.019318 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Mon Jul 11 11:41:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 11:41:15.457070 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-6512fde3-28ee-47fa-8309-94c8b37bc188 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:41:15.457683 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-6512fde3-28ee-47fa-8309-94c8b37bc188 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:41:15.459562 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_api:SELECT=26 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:41:15.464299 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6512fde3-28ee-47fa-8309-94c8b37bc188 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:15.464745 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6512fde3-28ee-47fa-8309-94c8b37bc188 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:15.465507 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6512fde3-28ee-47fa-8309-94c8b37bc188 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:15.465951 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6512fde3-28ee-47fa-8309-94c8b37bc188 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:15.470409 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=78 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:41:15.640539 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-6512fde3-28ee-47fa-8309-94c8b37bc188 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:41:15.649058 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-6512fde3-28ee-47fa-8309-94c8b37bc188 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.196627 Jul 11 11:41:15.649621 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 982/1957] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:41:15 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:41:16.665933 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-615371ac-7553-49d7-bb0d-35323858f960 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:41:16.666541 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-615371ac-7553-49d7-bb0d-35323858f960 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:41:16.668588 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_api:SELECT=26 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:41:16.673946 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-615371ac-7553-49d7-bb0d-35323858f960 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:16.674399 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-615371ac-7553-49d7-bb0d-35323858f960 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:16.675160 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-615371ac-7553-49d7-bb0d-35323858f960 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:16.675624 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-615371ac-7553-49d7-bb0d-35323858f960 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:16.678123 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=78 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:41:16.816122 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-615371ac-7553-49d7-bb0d-35323858f960 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:41:16.824139 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-615371ac-7553-49d7-bb0d-35323858f960 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.162139 Jul 11 11:41:16.824699 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 976/1958] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:41:16 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:41:17.841739 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-197c6c87-4ae7-4ee3-8341-2bfaa5414143 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:41:17.842355 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-197c6c87-4ae7-4ee3-8341-2bfaa5414143 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:41:17.849502 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-197c6c87-4ae7-4ee3-8341-2bfaa5414143 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:17.849953 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-197c6c87-4ae7-4ee3-8341-2bfaa5414143 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:17.850716 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-197c6c87-4ae7-4ee3-8341-2bfaa5414143 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:17.851159 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-197c6c87-4ae7-4ee3-8341-2bfaa5414143 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:17.981520 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-197c6c87-4ae7-4ee3-8341-2bfaa5414143 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:41:17.990123 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-197c6c87-4ae7-4ee3-8341-2bfaa5414143 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.152346 Jul 11 11:41:17.990699 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 983/1959] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:41:17 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:41:19.007509 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-211b17de-7f11-426f-8be2-7f28e2d82daf tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:41:19.008118 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-211b17de-7f11-426f-8be2-7f28e2d82daf tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:41:19.014837 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-211b17de-7f11-426f-8be2-7f28e2d82daf tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:19.015310 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-211b17de-7f11-426f-8be2-7f28e2d82daf tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:19.016111 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-211b17de-7f11-426f-8be2-7f28e2d82daf tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:19.016544 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-211b17de-7f11-426f-8be2-7f28e2d82daf tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:19.146791 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-211b17de-7f11-426f-8be2-7f28e2d82daf tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:41:19.154626 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-211b17de-7f11-426f-8be2-7f28e2d82daf tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.150946 Jul 11 11:41:19.155187 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 977/1960] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:41:19 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:41:20.170862 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-055f852b-7f7f-4329-9dee-a9be74183aba tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:41:20.171510 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-055f852b-7f7f-4329-9dee-a9be74183aba tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:41:20.178052 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-055f852b-7f7f-4329-9dee-a9be74183aba tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:20.178501 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-055f852b-7f7f-4329-9dee-a9be74183aba tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:20.179277 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-055f852b-7f7f-4329-9dee-a9be74183aba tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:20.179722 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-055f852b-7f7f-4329-9dee-a9be74183aba tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:20.307460 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-055f852b-7f7f-4329-9dee-a9be74183aba tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:41:20.315928 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-055f852b-7f7f-4329-9dee-a9be74183aba tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.148795 Jul 11 11:41:20.316477 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 984/1961] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:41:20 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:41:21.334338 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-550650e4-34c2-4e56-9561-ffceecea264c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:41:21.334884 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-550650e4-34c2-4e56-9561-ffceecea264c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:41:21.341388 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-550650e4-34c2-4e56-9561-ffceecea264c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:21.341831 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-550650e4-34c2-4e56-9561-ffceecea264c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:21.342582 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-550650e4-34c2-4e56-9561-ffceecea264c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:21.343011 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-550650e4-34c2-4e56-9561-ffceecea264c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:21.502802 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-550650e4-34c2-4e56-9561-ffceecea264c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:41:21.502802 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-550650e4-34c2-4e56-9561-ffceecea264c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.156081 Jul 11 11:41:21.502802 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 978/1962] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:41:21 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:41:22.504218 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-2415948c-a9a9-428d-be08-9c1b0881607c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:41:22.504824 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-2415948c-a9a9-428d-be08-9c1b0881607c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:41:22.511367 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2415948c-a9a9-428d-be08-9c1b0881607c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:22.511811 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2415948c-a9a9-428d-be08-9c1b0881607c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:22.512565 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2415948c-a9a9-428d-be08-9c1b0881607c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:22.513000 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2415948c-a9a9-428d-be08-9c1b0881607c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:22.640020 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-2415948c-a9a9-428d-be08-9c1b0881607c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:41:22.647947 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-2415948c-a9a9-428d-be08-9c1b0881607c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.148025 Jul 11 11:41:22.648508 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 985/1963] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:41:22 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:41:23.665454 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-8734b47c-d18c-4136-9d8e-3933f7f9b84b tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:41:23.666061 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-8734b47c-d18c-4136-9d8e-3933f7f9b84b tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:41:23.673170 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8734b47c-d18c-4136-9d8e-3933f7f9b84b tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:23.673614 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8734b47c-d18c-4136-9d8e-3933f7f9b84b tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:23.674359 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8734b47c-d18c-4136-9d8e-3933f7f9b84b tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:23.674786 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8734b47c-d18c-4136-9d8e-3933f7f9b84b tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:23.802934 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-8734b47c-d18c-4136-9d8e-3933f7f9b84b tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:41:23.810960 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-8734b47c-d18c-4136-9d8e-3933f7f9b84b tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.149390 Jul 11 11:41:23.811540 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 979/1964] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:41:23 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:41:24.829318 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-b96eae6f-796d-47f9-acdd-448058f3480a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:41:24.829939 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-b96eae6f-796d-47f9-acdd-448058f3480a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:41:24.836371 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b96eae6f-796d-47f9-acdd-448058f3480a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:24.836818 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b96eae6f-796d-47f9-acdd-448058f3480a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:24.837573 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b96eae6f-796d-47f9-acdd-448058f3480a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:24.838007 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b96eae6f-796d-47f9-acdd-448058f3480a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:24.967960 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-b96eae6f-796d-47f9-acdd-448058f3480a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:41:24.975809 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-b96eae6f-796d-47f9-acdd-448058f3480a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.151106 Jul 11 11:41:24.976378 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 986/1965] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:41:24 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:41:25.992949 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-1edf4905-2154-4fcc-adc6-a1a7dd799008 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:41:25.993554 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-1edf4905-2154-4fcc-adc6-a1a7dd799008 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:41:26.000032 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1edf4905-2154-4fcc-adc6-a1a7dd799008 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:26.000482 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1edf4905-2154-4fcc-adc6-a1a7dd799008 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:26.001237 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1edf4905-2154-4fcc-adc6-a1a7dd799008 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:26.001674 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1edf4905-2154-4fcc-adc6-a1a7dd799008 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:26.131885 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-1edf4905-2154-4fcc-adc6-a1a7dd799008 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:41:26.139695 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-1edf4905-2154-4fcc-adc6-a1a7dd799008 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.150510 Jul 11 11:41:26.141578 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 980/1966] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:41:25 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:41:27.157903 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-22c73615-8af7-4ef8-8f55-d8b1d61b4d85 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:41:27.158440 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-22c73615-8af7-4ef8-8f55-d8b1d61b4d85 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:41:27.164920 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-22c73615-8af7-4ef8-8f55-d8b1d61b4d85 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:27.165368 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-22c73615-8af7-4ef8-8f55-d8b1d61b4d85 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:27.166115 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-22c73615-8af7-4ef8-8f55-d8b1d61b4d85 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:27.166540 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-22c73615-8af7-4ef8-8f55-d8b1d61b4d85 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:27.290590 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-22c73615-8af7-4ef8-8f55-d8b1d61b4d85 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:41:27.298340 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-22c73615-8af7-4ef8-8f55-d8b1d61b4d85 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.144966 Jul 11 11:41:27.298899 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 987/1967] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:41:27 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:41:28.315507 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-2d0ca6f2-c50c-40d0-8a3e-606bd8ff7a6e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:41:28.316028 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-2d0ca6f2-c50c-40d0-8a3e-606bd8ff7a6e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:41:28.322734 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2d0ca6f2-c50c-40d0-8a3e-606bd8ff7a6e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:28.323176 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2d0ca6f2-c50c-40d0-8a3e-606bd8ff7a6e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:28.323951 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2d0ca6f2-c50c-40d0-8a3e-606bd8ff7a6e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:28.324381 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2d0ca6f2-c50c-40d0-8a3e-606bd8ff7a6e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:28.449439 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-2d0ca6f2-c50c-40d0-8a3e-606bd8ff7a6e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:41:28.457272 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-2d0ca6f2-c50c-40d0-8a3e-606bd8ff7a6e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.146390 Jul 11 11:41:28.457832 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 981/1968] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:41:28 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:41:29.474454 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-3f52c2b6-bd4e-4686-8828-fcd2d8d74a90 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:41:29.475063 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-3f52c2b6-bd4e-4686-8828-fcd2d8d74a90 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:41:29.481549 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3f52c2b6-bd4e-4686-8828-fcd2d8d74a90 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:29.481993 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3f52c2b6-bd4e-4686-8828-fcd2d8d74a90 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:29.482756 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3f52c2b6-bd4e-4686-8828-fcd2d8d74a90 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:29.483187 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3f52c2b6-bd4e-4686-8828-fcd2d8d74a90 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:29.611373 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-3f52c2b6-bd4e-4686-8828-fcd2d8d74a90 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:41:29.619145 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-3f52c2b6-bd4e-4686-8828-fcd2d8d74a90 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.148606 Jul 11 11:41:29.619737 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 988/1969] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:41:29 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:41:30.637036 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-e33028f6-092d-46f2-a718-ce7e3fbd151b tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:41:30.637647 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-e33028f6-092d-46f2-a718-ce7e3fbd151b tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:41:30.644711 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e33028f6-092d-46f2-a718-ce7e3fbd151b tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:30.645158 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e33028f6-092d-46f2-a718-ce7e3fbd151b tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:30.645938 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e33028f6-092d-46f2-a718-ce7e3fbd151b tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:30.646371 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e33028f6-092d-46f2-a718-ce7e3fbd151b tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:30.777339 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-e33028f6-092d-46f2-a718-ce7e3fbd151b tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:41:30.785156 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-e33028f6-092d-46f2-a718-ce7e3fbd151b tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.152015 Jul 11 11:41:30.785721 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 982/1970] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:41:30 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:41:31.802338 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-d04bf643-19d6-407b-ace8-94114c858347 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:41:31.802899 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-d04bf643-19d6-407b-ace8-94114c858347 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:41:31.809243 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d04bf643-19d6-407b-ace8-94114c858347 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:31.809680 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d04bf643-19d6-407b-ace8-94114c858347 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:31.810427 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d04bf643-19d6-407b-ace8-94114c858347 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:31.810855 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d04bf643-19d6-407b-ace8-94114c858347 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:31.937364 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-d04bf643-19d6-407b-ace8-94114c858347 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:41:31.945374 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-d04bf643-19d6-407b-ace8-94114c858347 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.147083 Jul 11 11:41:31.945935 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 989/1971] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:41:31 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:41:32.963038 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-8c902f60-952e-4ec8-b18e-2d16856e67f3 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:41:32.963671 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-8c902f60-952e-4ec8-b18e-2d16856e67f3 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:41:32.970571 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8c902f60-952e-4ec8-b18e-2d16856e67f3 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:32.971010 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8c902f60-952e-4ec8-b18e-2d16856e67f3 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:32.971797 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8c902f60-952e-4ec8-b18e-2d16856e67f3 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:32.972231 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8c902f60-952e-4ec8-b18e-2d16856e67f3 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:33.104902 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-8c902f60-952e-4ec8-b18e-2d16856e67f3 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:41:33.113367 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-8c902f60-952e-4ec8-b18e-2d16856e67f3 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.154217 Jul 11 11:41:33.113927 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 983/1972] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:41:32 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:41:34.130386 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-0231d36b-a197-4615-9f29-48ac7160e9cc tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:41:34.131035 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-0231d36b-a197-4615-9f29-48ac7160e9cc tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:41:34.137942 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0231d36b-a197-4615-9f29-48ac7160e9cc tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:34.138396 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0231d36b-a197-4615-9f29-48ac7160e9cc tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:34.139360 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0231d36b-a197-4615-9f29-48ac7160e9cc tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:34.140023 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0231d36b-a197-4615-9f29-48ac7160e9cc tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:34.278229 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-0231d36b-a197-4615-9f29-48ac7160e9cc tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:41:34.286917 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-0231d36b-a197-4615-9f29-48ac7160e9cc tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.160319 Jul 11 11:41:34.287510 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 990/1973] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:41:34 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:41:35.306951 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-c810b75d-a885-4f31-8032-bfbb01bb6bf5 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:41:35.307593 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-c810b75d-a885-4f31-8032-bfbb01bb6bf5 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:41:35.314138 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c810b75d-a885-4f31-8032-bfbb01bb6bf5 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:35.314587 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c810b75d-a885-4f31-8032-bfbb01bb6bf5 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:35.315372 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c810b75d-a885-4f31-8032-bfbb01bb6bf5 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:35.315808 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c810b75d-a885-4f31-8032-bfbb01bb6bf5 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:35.447389 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-c810b75d-a885-4f31-8032-bfbb01bb6bf5 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:41:35.456967 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-c810b75d-a885-4f31-8032-bfbb01bb6bf5 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.153721 Jul 11 11:41:35.459234 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 984/1974] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:41:35 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:41:36.476401 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-22df905b-4034-47fb-9196-f3b3896a3571 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:41:36.477010 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-22df905b-4034-47fb-9196-f3b3896a3571 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:41:36.483574 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-22df905b-4034-47fb-9196-f3b3896a3571 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:36.484024 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-22df905b-4034-47fb-9196-f3b3896a3571 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:36.485295 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-22df905b-4034-47fb-9196-f3b3896a3571 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:36.485728 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-22df905b-4034-47fb-9196-f3b3896a3571 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:36.612316 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-22df905b-4034-47fb-9196-f3b3896a3571 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:41:36.620074 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-22df905b-4034-47fb-9196-f3b3896a3571 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.147658 Jul 11 11:41:36.620640 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 991/1975] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:41:36 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:41:37.636893 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-3bef41f6-578f-404e-a31d-fccc87b240e5 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:41:37.637482 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-3bef41f6-578f-404e-a31d-fccc87b240e5 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:41:37.644621 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3bef41f6-578f-404e-a31d-fccc87b240e5 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:37.645074 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3bef41f6-578f-404e-a31d-fccc87b240e5 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:37.645832 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3bef41f6-578f-404e-a31d-fccc87b240e5 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:37.646270 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3bef41f6-578f-404e-a31d-fccc87b240e5 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:37.777303 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-3bef41f6-578f-404e-a31d-fccc87b240e5 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:41:37.785187 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-3bef41f6-578f-404e-a31d-fccc87b240e5 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.152275 Jul 11 11:41:37.785748 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 985/1976] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:41:37 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:41:38.801802 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-a27a4d9f-745d-4877-8aaa-95c7eb9b41c4 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:41:38.802535 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-a27a4d9f-745d-4877-8aaa-95c7eb9b41c4 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:41:38.809010 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a27a4d9f-745d-4877-8aaa-95c7eb9b41c4 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:38.809455 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a27a4d9f-745d-4877-8aaa-95c7eb9b41c4 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:38.810213 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a27a4d9f-745d-4877-8aaa-95c7eb9b41c4 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:38.810645 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a27a4d9f-745d-4877-8aaa-95c7eb9b41c4 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:38.946110 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-a27a4d9f-745d-4877-8aaa-95c7eb9b41c4 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:41:38.954878 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-a27a4d9f-745d-4877-8aaa-95c7eb9b41c4 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.156263 Jul 11 11:41:38.955473 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 992/1977] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:41:38 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:41:39.973129 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-4864d6a5-dbdf-49d3-a2ec-3cdf05ba8f12 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:41:39.973738 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-4864d6a5-dbdf-49d3-a2ec-3cdf05ba8f12 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:41:39.980142 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4864d6a5-dbdf-49d3-a2ec-3cdf05ba8f12 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:39.980579 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4864d6a5-dbdf-49d3-a2ec-3cdf05ba8f12 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:39.981325 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4864d6a5-dbdf-49d3-a2ec-3cdf05ba8f12 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:39.981755 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4864d6a5-dbdf-49d3-a2ec-3cdf05ba8f12 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:40.107441 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-4864d6a5-dbdf-49d3-a2ec-3cdf05ba8f12 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:41:40.115302 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-4864d6a5-dbdf-49d3-a2ec-3cdf05ba8f12 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.147285 Jul 11 11:41:40.115866 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 986/1978] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:41:39 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:41:41.132169 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-6905a932-a508-46fb-a279-403c6ddf17ef tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:41:41.132778 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-6905a932-a508-46fb-a279-403c6ddf17ef tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:41:41.139203 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6905a932-a508-46fb-a279-403c6ddf17ef tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:41.139673 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6905a932-a508-46fb-a279-403c6ddf17ef tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:41.140427 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6905a932-a508-46fb-a279-403c6ddf17ef tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:41.140858 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6905a932-a508-46fb-a279-403c6ddf17ef tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:41.268298 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-6905a932-a508-46fb-a279-403c6ddf17ef tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:41:41.276074 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-6905a932-a508-46fb-a279-403c6ddf17ef tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.147743 Jul 11 11:41:41.276643 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 993/1979] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:41:41 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:41:42.292923 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-a1efc9cc-5eb2-4d63-8b49-02129c22a8c4 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:41:42.293589 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-a1efc9cc-5eb2-4d63-8b49-02129c22a8c4 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:41:42.300522 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a1efc9cc-5eb2-4d63-8b49-02129c22a8c4 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:42.300965 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a1efc9cc-5eb2-4d63-8b49-02129c22a8c4 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:42.301718 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a1efc9cc-5eb2-4d63-8b49-02129c22a8c4 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:42.302147 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a1efc9cc-5eb2-4d63-8b49-02129c22a8c4 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:42.430827 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-a1efc9cc-5eb2-4d63-8b49-02129c22a8c4 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:41:42.439331 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-a1efc9cc-5eb2-4d63-8b49-02129c22a8c4 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.149604 Jul 11 11:41:42.439904 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 987/1980] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:41:42 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:41:43.457038 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-a6df83cf-b391-4d8f-a108-95450f807c85 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:41:43.457692 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-a6df83cf-b391-4d8f-a108-95450f807c85 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:41:43.464121 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a6df83cf-b391-4d8f-a108-95450f807c85 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:43.476814 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a6df83cf-b391-4d8f-a108-95450f807c85 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:43.476814 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a6df83cf-b391-4d8f-a108-95450f807c85 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:43.476814 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a6df83cf-b391-4d8f-a108-95450f807c85 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:43.594974 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-a6df83cf-b391-4d8f-a108-95450f807c85 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:41:43.603881 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-a6df83cf-b391-4d8f-a108-95450f807c85 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.151216 Jul 11 11:41:43.604673 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 994/1981] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:41:43 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:41:44.621504 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-1c3f7010-861a-413b-a1f6-0d9fed33da14 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:41:44.622164 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-1c3f7010-861a-413b-a1f6-0d9fed33da14 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:41:44.628871 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1c3f7010-861a-413b-a1f6-0d9fed33da14 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:44.629316 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1c3f7010-861a-413b-a1f6-0d9fed33da14 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:44.630074 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1c3f7010-861a-413b-a1f6-0d9fed33da14 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:44.630508 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1c3f7010-861a-413b-a1f6-0d9fed33da14 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:44.757878 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-1c3f7010-861a-413b-a1f6-0d9fed33da14 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:41:44.765827 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-1c3f7010-861a-413b-a1f6-0d9fed33da14 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.148123 Jul 11 11:41:44.766394 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 988/1982] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:41:44 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:41:45.782533 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-dc06d6a8-2296-4bd4-8797-a92151a6f714 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:41:45.783148 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-dc06d6a8-2296-4bd4-8797-a92151a6f714 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:41:45.785334 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_api:SELECT=26 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:41:45.790037 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-dc06d6a8-2296-4bd4-8797-a92151a6f714 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:45.790488 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-dc06d6a8-2296-4bd4-8797-a92151a6f714 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:45.791342 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-dc06d6a8-2296-4bd4-8797-a92151a6f714 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:45.791783 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-dc06d6a8-2296-4bd4-8797-a92151a6f714 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:45.797318 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=78 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:41:45.927518 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-dc06d6a8-2296-4bd4-8797-a92151a6f714 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:41:45.936279 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-dc06d6a8-2296-4bd4-8797-a92151a6f714 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.157549 Jul 11 11:41:45.936868 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 995/1983] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:41:45 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:41:46.954692 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-81983a51-24bc-47eb-9e09-cc8156415b17 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:41:46.955317 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-81983a51-24bc-47eb-9e09-cc8156415b17 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:41:46.957252 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_api:SELECT=26 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:41:46.961940 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-81983a51-24bc-47eb-9e09-cc8156415b17 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:46.962535 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-81983a51-24bc-47eb-9e09-cc8156415b17 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:46.963146 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-81983a51-24bc-47eb-9e09-cc8156415b17 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:46.963605 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-81983a51-24bc-47eb-9e09-cc8156415b17 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:46.967539 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=78 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:41:47.096266 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-81983a51-24bc-47eb-9e09-cc8156415b17 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:41:47.104079 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-81983a51-24bc-47eb-9e09-cc8156415b17 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.154085 Jul 11 11:41:47.104647 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 989/1984] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:41:46 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:41:48.120364 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-1586c669-915c-4aca-b4a2-6ade72a0fa25 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:41:48.120991 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-1586c669-915c-4aca-b4a2-6ade72a0fa25 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:41:48.127815 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1586c669-915c-4aca-b4a2-6ade72a0fa25 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:48.128266 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1586c669-915c-4aca-b4a2-6ade72a0fa25 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:48.129039 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1586c669-915c-4aca-b4a2-6ade72a0fa25 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:48.129476 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1586c669-915c-4aca-b4a2-6ade72a0fa25 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:48.259985 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-1586c669-915c-4aca-b4a2-6ade72a0fa25 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:41:48.267770 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-1586c669-915c-4aca-b4a2-6ade72a0fa25 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.151348 Jul 11 11:41:48.268338 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 996/1985] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:41:48 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:41:49.285414 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-18adf1eb-b305-4d4e-8fe1-cbc24ab5b750 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:41:49.286050 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-18adf1eb-b305-4d4e-8fe1-cbc24ab5b750 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:41:49.292424 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-18adf1eb-b305-4d4e-8fe1-cbc24ab5b750 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:49.292866 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-18adf1eb-b305-4d4e-8fe1-cbc24ab5b750 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:49.293622 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-18adf1eb-b305-4d4e-8fe1-cbc24ab5b750 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:49.294055 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-18adf1eb-b305-4d4e-8fe1-cbc24ab5b750 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:49.419651 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-18adf1eb-b305-4d4e-8fe1-cbc24ab5b750 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:41:49.430993 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-18adf1eb-b305-4d4e-8fe1-cbc24ab5b750 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.150077 Jul 11 11:41:49.431595 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 990/1986] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:41:49 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:41:50.450407 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-c3f961f0-b90f-4afc-ae20-98d9cac06891 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:41:50.451047 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-c3f961f0-b90f-4afc-ae20-98d9cac06891 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:41:50.458099 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c3f961f0-b90f-4afc-ae20-98d9cac06891 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:50.458553 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c3f961f0-b90f-4afc-ae20-98d9cac06891 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:50.459352 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c3f961f0-b90f-4afc-ae20-98d9cac06891 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:50.459783 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c3f961f0-b90f-4afc-ae20-98d9cac06891 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:50.601641 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-c3f961f0-b90f-4afc-ae20-98d9cac06891 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:41:50.609417 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-c3f961f0-b90f-4afc-ae20-98d9cac06891 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.163129 Jul 11 11:41:50.609990 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 997/1987] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:41:50 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:41:51.626346 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-230e4359-db99-4e9b-8ea1-5ce743b84662 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:41:51.626906 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-230e4359-db99-4e9b-8ea1-5ce743b84662 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:41:51.633535 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-230e4359-db99-4e9b-8ea1-5ce743b84662 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:51.634028 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-230e4359-db99-4e9b-8ea1-5ce743b84662 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:51.634812 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-230e4359-db99-4e9b-8ea1-5ce743b84662 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:51.635241 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-230e4359-db99-4e9b-8ea1-5ce743b84662 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:51.761443 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-230e4359-db99-4e9b-8ea1-5ce743b84662 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:41:51.769254 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-230e4359-db99-4e9b-8ea1-5ce743b84662 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.146832 Jul 11 11:41:51.769781 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 991/1988] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:41:51 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:41:52.786035 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-e588a9f3-60d0-407f-84ad-d4d913524faa tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:41:52.786658 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-e588a9f3-60d0-407f-84ad-d4d913524faa tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:41:52.793202 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e588a9f3-60d0-407f-84ad-d4d913524faa tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:52.793652 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e588a9f3-60d0-407f-84ad-d4d913524faa tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:52.794415 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e588a9f3-60d0-407f-84ad-d4d913524faa tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:52.794854 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e588a9f3-60d0-407f-84ad-d4d913524faa tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:52.925715 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-e588a9f3-60d0-407f-84ad-d4d913524faa tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:41:52.934637 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-e588a9f3-60d0-407f-84ad-d4d913524faa tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.152490 Jul 11 11:41:52.935201 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 998/1989] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:41:52 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:41:53.953409 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-a697adbd-ea39-4b66-9d43-baf761996f64 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:41:53.954604 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-a697adbd-ea39-4b66-9d43-baf761996f64 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:41:53.961165 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a697adbd-ea39-4b66-9d43-baf761996f64 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:53.961617 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a697adbd-ea39-4b66-9d43-baf761996f64 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:53.962645 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a697adbd-ea39-4b66-9d43-baf761996f64 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:53.963087 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a697adbd-ea39-4b66-9d43-baf761996f64 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:54.095480 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-a697adbd-ea39-4b66-9d43-baf761996f64 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:41:54.104794 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-a697adbd-ea39-4b66-9d43-baf761996f64 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.155257 Jul 11 11:41:54.105362 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 992/1990] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:41:53 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:41:55.121862 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-a792ef73-007a-4373-aae7-74619a99d0c5 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:41:55.122507 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-a792ef73-007a-4373-aae7-74619a99d0c5 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:41:55.128976 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a792ef73-007a-4373-aae7-74619a99d0c5 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:55.129425 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a792ef73-007a-4373-aae7-74619a99d0c5 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:55.130192 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a792ef73-007a-4373-aae7-74619a99d0c5 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:55.130629 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a792ef73-007a-4373-aae7-74619a99d0c5 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:55.258645 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-a792ef73-007a-4373-aae7-74619a99d0c5 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:41:55.267062 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-a792ef73-007a-4373-aae7-74619a99d0c5 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.148524 Jul 11 11:41:55.267641 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 999/1991] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:41:55 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:41:56.283966 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-e4c71171-48c1-429e-9de7-1b57b7334301 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:41:56.284578 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-e4c71171-48c1-429e-9de7-1b57b7334301 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:41:56.290996 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e4c71171-48c1-429e-9de7-1b57b7334301 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:56.291515 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e4c71171-48c1-429e-9de7-1b57b7334301 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:56.292279 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e4c71171-48c1-429e-9de7-1b57b7334301 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:56.292714 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e4c71171-48c1-429e-9de7-1b57b7334301 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:56.417495 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-e4c71171-48c1-429e-9de7-1b57b7334301 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:41:56.426106 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-e4c71171-48c1-429e-9de7-1b57b7334301 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.146491 Jul 11 11:41:56.426673 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 993/1992] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:41:56 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:41:57.443548 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-a85e1716-93be-40fe-8a63-049a3659b4e0 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:41:57.444465 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-a85e1716-93be-40fe-8a63-049a3659b4e0 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:41:57.451508 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a85e1716-93be-40fe-8a63-049a3659b4e0 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:57.451956 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a85e1716-93be-40fe-8a63-049a3659b4e0 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:57.452726 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a85e1716-93be-40fe-8a63-049a3659b4e0 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:57.453162 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a85e1716-93be-40fe-8a63-049a3659b4e0 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:57.622630 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-a85e1716-93be-40fe-8a63-049a3659b4e0 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:41:57.631206 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-a85e1716-93be-40fe-8a63-049a3659b4e0 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.192167 Jul 11 11:41:57.631809 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1000/1993] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:41:57 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:41:58.649204 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-d62990b6-b165-4a69-8323-315a6d341f3a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:41:58.649754 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-d62990b6-b165-4a69-8323-315a6d341f3a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:41:58.656279 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d62990b6-b165-4a69-8323-315a6d341f3a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:58.656729 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d62990b6-b165-4a69-8323-315a6d341f3a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:58.657476 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d62990b6-b165-4a69-8323-315a6d341f3a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:58.657906 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d62990b6-b165-4a69-8323-315a6d341f3a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:58.787197 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-d62990b6-b165-4a69-8323-315a6d341f3a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:41:58.795078 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-d62990b6-b165-4a69-8323-315a6d341f3a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.149758 Jul 11 11:41:58.795791 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 994/1994] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:41:58 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:41:59.811906 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-377a2aea-2f42-4a09-9500-fa02f7916677 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:41:59.812516 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-377a2aea-2f42-4a09-9500-fa02f7916677 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:41:59.818973 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-377a2aea-2f42-4a09-9500-fa02f7916677 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:59.819458 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-377a2aea-2f42-4a09-9500-fa02f7916677 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:59.820221 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-377a2aea-2f42-4a09-9500-fa02f7916677 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:41:59.820659 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-377a2aea-2f42-4a09-9500-fa02f7916677 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:41:59.952611 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-377a2aea-2f42-4a09-9500-fa02f7916677 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:41:59.960916 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-377a2aea-2f42-4a09-9500-fa02f7916677 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.152888 Jul 11 11:41:59.961482 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1001/1995] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:41:59 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:42:01.106543 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-36c31633-cc7f-49f2-bf88-ad44a496092b tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:42:01.107156 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-36c31633-cc7f-49f2-bf88-ad44a496092b tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:42:01.113724 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-36c31633-cc7f-49f2-bf88-ad44a496092b tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:01.114173 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-36c31633-cc7f-49f2-bf88-ad44a496092b tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:01.114932 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-36c31633-cc7f-49f2-bf88-ad44a496092b tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:01.115386 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-36c31633-cc7f-49f2-bf88-ad44a496092b tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:01.249445 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-36c31633-cc7f-49f2-bf88-ad44a496092b tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:42:01.257305 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-36c31633-cc7f-49f2-bf88-ad44a496092b tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.283384 Jul 11 11:42:01.257875 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 995/1996] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:42:00 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:42:02.274273 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-c11aa6d5-54c3-4e21-ac11-8e2a6b84ed11 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:42:02.274889 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-c11aa6d5-54c3-4e21-ac11-8e2a6b84ed11 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:42:02.281335 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c11aa6d5-54c3-4e21-ac11-8e2a6b84ed11 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:02.281783 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c11aa6d5-54c3-4e21-ac11-8e2a6b84ed11 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:02.282541 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c11aa6d5-54c3-4e21-ac11-8e2a6b84ed11 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:02.282975 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c11aa6d5-54c3-4e21-ac11-8e2a6b84ed11 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:02.416339 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-c11aa6d5-54c3-4e21-ac11-8e2a6b84ed11 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:42:02.424092 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-c11aa6d5-54c3-4e21-ac11-8e2a6b84ed11 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.153749 Jul 11 11:42:02.424656 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1002/1997] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:42:02 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:42:03.442228 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-6623eeaa-2983-4163-95e5-c4dc10647b3f tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:42:03.442632 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-6623eeaa-2983-4163-95e5-c4dc10647b3f tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:42:03.449880 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6623eeaa-2983-4163-95e5-c4dc10647b3f tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:03.460378 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6623eeaa-2983-4163-95e5-c4dc10647b3f tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:03.460378 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6623eeaa-2983-4163-95e5-c4dc10647b3f tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:03.460378 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6623eeaa-2983-4163-95e5-c4dc10647b3f tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:03.597545 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-6623eeaa-2983-4163-95e5-c4dc10647b3f tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:42:03.605377 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-6623eeaa-2983-4163-95e5-c4dc10647b3f tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.167816 Jul 11 11:42:03.606110 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 996/1998] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:42:03 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:42:04.622910 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-65c1d2b5-20a3-44de-ba0a-642828a02191 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:42:04.623653 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-65c1d2b5-20a3-44de-ba0a-642828a02191 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:42:04.630682 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-65c1d2b5-20a3-44de-ba0a-642828a02191 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:04.631128 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-65c1d2b5-20a3-44de-ba0a-642828a02191 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:04.631922 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-65c1d2b5-20a3-44de-ba0a-642828a02191 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:04.632363 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-65c1d2b5-20a3-44de-ba0a-642828a02191 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:04.766408 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-65c1d2b5-20a3-44de-ba0a-642828a02191 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:42:04.775763 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-65c1d2b5-20a3-44de-ba0a-642828a02191 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.156682 Jul 11 11:42:04.776330 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1003/1999] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:42:04 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:42:05.793240 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-ec503464-25e3-473d-9ab4-8b5326bec022 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:42:05.793839 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-ec503464-25e3-473d-9ab4-8b5326bec022 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:42:05.800814 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ec503464-25e3-473d-9ab4-8b5326bec022 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:05.801257 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ec503464-25e3-473d-9ab4-8b5326bec022 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:05.802013 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ec503464-25e3-473d-9ab4-8b5326bec022 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:05.802441 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ec503464-25e3-473d-9ab4-8b5326bec022 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:05.930153 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-ec503464-25e3-473d-9ab4-8b5326bec022 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:42:05.938534 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-ec503464-25e3-473d-9ab4-8b5326bec022 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.149179 Jul 11 11:42:05.939093 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 997/2000] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:42:05 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:42:06.956073 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-eee73a15-bbf4-4144-aaaa-b917ce3c44bf tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:42:06.957332 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-eee73a15-bbf4-4144-aaaa-b917ce3c44bf tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:42:06.963921 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-eee73a15-bbf4-4144-aaaa-b917ce3c44bf tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:06.964373 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-eee73a15-bbf4-4144-aaaa-b917ce3c44bf tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:06.965143 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-eee73a15-bbf4-4144-aaaa-b917ce3c44bf tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:06.965576 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-eee73a15-bbf4-4144-aaaa-b917ce3c44bf tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:07.094753 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-eee73a15-bbf4-4144-aaaa-b917ce3c44bf tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:42:07.102738 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-eee73a15-bbf4-4144-aaaa-b917ce3c44bf tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.150470 Jul 11 11:42:07.103329 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1004/2001] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:42:06 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:42:08.119985 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-1d0c0c1c-2d25-4275-ac24-5d70f1b3240a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:42:08.120617 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-1d0c0c1c-2d25-4275-ac24-5d70f1b3240a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:42:08.132168 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1d0c0c1c-2d25-4275-ac24-5d70f1b3240a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:08.132615 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1d0c0c1c-2d25-4275-ac24-5d70f1b3240a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:08.133389 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1d0c0c1c-2d25-4275-ac24-5d70f1b3240a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:08.133820 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1d0c0c1c-2d25-4275-ac24-5d70f1b3240a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:08.263140 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-1d0c0c1c-2d25-4275-ac24-5d70f1b3240a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:42:08.274129 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-1d0c0c1c-2d25-4275-ac24-5d70f1b3240a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.158074 Jul 11 11:42:08.274709 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 998/2002] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:42:08 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:42:09.291154 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-06175c43-0d42-40d9-bcf2-d1851396b96a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:42:09.291860 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-06175c43-0d42-40d9-bcf2-d1851396b96a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:42:09.298616 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-06175c43-0d42-40d9-bcf2-d1851396b96a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:09.299084 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-06175c43-0d42-40d9-bcf2-d1851396b96a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:09.299871 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-06175c43-0d42-40d9-bcf2-d1851396b96a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:09.300310 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-06175c43-0d42-40d9-bcf2-d1851396b96a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:09.425556 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-06175c43-0d42-40d9-bcf2-d1851396b96a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:42:09.433379 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-06175c43-0d42-40d9-bcf2-d1851396b96a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.146162 Jul 11 11:42:09.433954 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1005/2003] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:42:09 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:42:10.450928 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-6296d767-ad7f-4711-ba05-5d4c9102d310 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:42:10.451559 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-6296d767-ad7f-4711-ba05-5d4c9102d310 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:42:10.458611 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6296d767-ad7f-4711-ba05-5d4c9102d310 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:10.459052 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6296d767-ad7f-4711-ba05-5d4c9102d310 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:10.459829 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6296d767-ad7f-4711-ba05-5d4c9102d310 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:10.460261 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6296d767-ad7f-4711-ba05-5d4c9102d310 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:10.588046 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-6296d767-ad7f-4711-ba05-5d4c9102d310 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:42:10.595768 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-6296d767-ad7f-4711-ba05-5d4c9102d310 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.148932 Jul 11 11:42:10.596335 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 999/2004] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:42:10 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:42:11.613773 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-9c240776-5bea-474a-9baa-47348780c9c4 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:42:11.614385 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-9c240776-5bea-474a-9baa-47348780c9c4 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:42:11.620779 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9c240776-5bea-474a-9baa-47348780c9c4 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:11.621224 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9c240776-5bea-474a-9baa-47348780c9c4 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:11.621972 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9c240776-5bea-474a-9baa-47348780c9c4 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:11.622415 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9c240776-5bea-474a-9baa-47348780c9c4 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:11.746429 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-9c240776-5bea-474a-9baa-47348780c9c4 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:42:11.754272 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-9c240776-5bea-474a-9baa-47348780c9c4 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.144941 Jul 11 11:42:11.754837 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1006/2005] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:42:11 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:42:12.771099 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-ad4ae572-ec12-4fa8-a7b5-8a6289f49c6a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:42:12.771733 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-ad4ae572-ec12-4fa8-a7b5-8a6289f49c6a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:42:12.778232 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ad4ae572-ec12-4fa8-a7b5-8a6289f49c6a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:12.778691 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ad4ae572-ec12-4fa8-a7b5-8a6289f49c6a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:12.779475 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ad4ae572-ec12-4fa8-a7b5-8a6289f49c6a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:12.779905 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ad4ae572-ec12-4fa8-a7b5-8a6289f49c6a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:12.910715 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-ad4ae572-ec12-4fa8-a7b5-8a6289f49c6a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:42:12.918477 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-ad4ae572-ec12-4fa8-a7b5-8a6289f49c6a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.151249 Jul 11 11:42:12.919037 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1000/2006] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:42:12 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:42:13.936169 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-eb8c96f5-7d8e-4f58-8ece-9cabdf0e625a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:42:13.936779 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-eb8c96f5-7d8e-4f58-8ece-9cabdf0e625a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:42:13.943725 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-eb8c96f5-7d8e-4f58-8ece-9cabdf0e625a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:13.944172 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-eb8c96f5-7d8e-4f58-8ece-9cabdf0e625a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:13.944925 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-eb8c96f5-7d8e-4f58-8ece-9cabdf0e625a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:13.945359 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-eb8c96f5-7d8e-4f58-8ece-9cabdf0e625a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:14.078521 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-eb8c96f5-7d8e-4f58-8ece-9cabdf0e625a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:42:14.086519 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-eb8c96f5-7d8e-4f58-8ece-9cabdf0e625a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.154210 Jul 11 11:42:14.087098 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1007/2007] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:42:13 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:42:15.104022 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-74381297-161d-4c53-a12c-d8e6cc9a1a8c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:42:15.104669 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-74381297-161d-4c53-a12c-d8e6cc9a1a8c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:42:15.111036 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-74381297-161d-4c53-a12c-d8e6cc9a1a8c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:15.111520 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-74381297-161d-4c53-a12c-d8e6cc9a1a8c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:15.112281 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-74381297-161d-4c53-a12c-d8e6cc9a1a8c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:15.112714 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-74381297-161d-4c53-a12c-d8e6cc9a1a8c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:15.250667 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-74381297-161d-4c53-a12c-d8e6cc9a1a8c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:42:15.259101 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-74381297-161d-4c53-a12c-d8e6cc9a1a8c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.158924 Jul 11 11:42:15.259728 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1001/2008] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:42:15 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:42:16.271659 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-461f1d81-95c8-4066-bd5a-91a3d7922a83 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:42:16.272846 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-461f1d81-95c8-4066-bd5a-91a3d7922a83 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: f4031167-4227-4699-bbcf-d0bec5e3ca8b] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:42:16.275058 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_api:SELECT=26 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:42:16.276171 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-babb975c-6feb-4d95-bffa-18cfb4992769 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:42:16.276892 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-babb975c-6feb-4d95-bffa-18cfb4992769 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:42:16.279939 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-461f1d81-95c8-4066-bd5a-91a3d7922a83 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:16.280389 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-461f1d81-95c8-4066-bd5a-91a3d7922a83 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:16.281155 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-461f1d81-95c8-4066-bd5a-91a3d7922a83 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:16.281594 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-461f1d81-95c8-4066-bd5a-91a3d7922a83 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:16.282856 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-babb975c-6feb-4d95-bffa-18cfb4992769 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:16.283383 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-babb975c-6feb-4d95-bffa-18cfb4992769 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:16.284775 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-babb975c-6feb-4d95-bffa-18cfb4992769 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:16.287101 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-babb975c-6feb-4d95-bffa-18cfb4992769 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:16.287218 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=78 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:42:16.307853 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-461f1d81-95c8-4066-bd5a-91a3d7922a83 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: f4031167-4227-4699-bbcf-d0bec5e3ca8b] Going to try to terminate instance {{(pid=118321) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 11:42:16.416188 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-babb975c-6feb-4d95-bffa-18cfb4992769 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:42:16.424129 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-babb975c-6feb-4d95-bffa-18cfb4992769 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.151882 Jul 11 11:42:16.424721 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1002/2009] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:42:16 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:42:16.554855 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-461f1d81-95c8-4066-bd5a-91a3d7922a83 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f4031167-4227-4699-bbcf-d0bec5e3ca8b" status: 204 len: 0 microversion: 2.20 time: 0.287364 Jul 11 11:42:16.555760 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1008/2010] 10.222.0.26 () {60 vars in 1279 bytes} [Mon Jul 11 11:42:16 2022] DELETE /compute/v2.1/servers/f4031167-4227-4699-bbcf-d0bec5e3ca8b => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 11 11:42:16.563980 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-dd207406-9d4f-4ba4-85f9-70c7d872a3f9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:42:16.565541 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-dd207406-9d4f-4ba4-85f9-70c7d872a3f9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: f4031167-4227-4699-bbcf-d0bec5e3ca8b] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:42:16.572142 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-dd207406-9d4f-4ba4-85f9-70c7d872a3f9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:16.572583 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-dd207406-9d4f-4ba4-85f9-70c7d872a3f9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:16.573341 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-dd207406-9d4f-4ba4-85f9-70c7d872a3f9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:16.573797 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-dd207406-9d4f-4ba4-85f9-70c7d872a3f9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:16.700025 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-dd207406-9d4f-4ba4-85f9-70c7d872a3f9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:42:16.708502 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-dd207406-9d4f-4ba4-85f9-70c7d872a3f9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:42:16.709993 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-dd207406-9d4f-4ba4-85f9-70c7d872a3f9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:42:16.711133 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-dd207406-9d4f-4ba4-85f9-70c7d872a3f9 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/f4031167-4227-4699-bbcf-d0bec5e3ca8b" status: 200 len: 1725 microversion: 2.20 time: 0.151173 Jul 11 11:42:16.711733 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1003/2011] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:42:16 2022] GET /compute/v2.1/servers/f4031167-4227-4699-bbcf-d0bec5e3ca8b => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:42:17.442271 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-7dfd2019-f6cb-4d4e-88da-b6cf71384f0b tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:42:17.443101 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-7dfd2019-f6cb-4d4e-88da-b6cf71384f0b tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:42:17.449922 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7dfd2019-f6cb-4d4e-88da-b6cf71384f0b tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:17.450363 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7dfd2019-f6cb-4d4e-88da-b6cf71384f0b tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:17.451115 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7dfd2019-f6cb-4d4e-88da-b6cf71384f0b tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:17.451574 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7dfd2019-f6cb-4d4e-88da-b6cf71384f0b tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:17.671383 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-7dfd2019-f6cb-4d4e-88da-b6cf71384f0b tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:42:17.680238 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-7dfd2019-f6cb-4d4e-88da-b6cf71384f0b tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.242293 Jul 11 11:42:17.680816 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1009/2012] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:42:17 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:42:17.730110 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-125eec02-1852-4df0-846b-40c2ee998faf tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:42:17.730814 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-125eec02-1852-4df0-846b-40c2ee998faf tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: f4031167-4227-4699-bbcf-d0bec5e3ca8b] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:42:17.733203 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_api:SELECT=30 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:42:17.738527 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-125eec02-1852-4df0-846b-40c2ee998faf tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:17.738975 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-125eec02-1852-4df0-846b-40c2ee998faf tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:17.739764 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-125eec02-1852-4df0-846b-40c2ee998faf tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:17.740203 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-125eec02-1852-4df0-846b-40c2ee998faf tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:17.747084 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=90 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:42:17.807025 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-125eec02-1852-4df0-846b-40c2ee998faf tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:42:17.815366 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-125eec02-1852-4df0-846b-40c2ee998faf tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:42:17.816957 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-125eec02-1852-4df0-846b-40c2ee998faf tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:42:17.818113 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-125eec02-1852-4df0-846b-40c2ee998faf tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/f4031167-4227-4699-bbcf-d0bec5e3ca8b" status: 200 len: 1657 microversion: 2.20 time: 0.092696 Jul 11 11:42:17.818685 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1004/2013] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:42:17 2022] GET /compute/v2.1/servers/f4031167-4227-4699-bbcf-d0bec5e3ca8b => generated 1657 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:42:18.222016 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [req-a5d545a8-06db-4844-aa10-a99f3caf2e70 req-bcc3ae62-1d7d-49a1-a5a0-ed973c811948 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4031167-4227-4699-bbcf-d0bec5e3ca8b", "name": "network-vif-deleted", "tag": "0bd9eb21-bcac-4a52-8d10-e7d23735f707"}]} {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:42:18.230210 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [req-a5d545a8-06db-4844-aa10-a99f3caf2e70 req-bcc3ae62-1d7d-49a1-a5a0-ed973c811948 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:18.231234 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [req-a5d545a8-06db-4844-aa10-a99f3caf2e70 req-bcc3ae62-1d7d-49a1-a5a0-ed973c811948 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:18.243277 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.compute.server_external_events [req-a5d545a8-06db-4844-aa10-a99f3caf2e70 req-bcc3ae62-1d7d-49a1-a5a0-ed973c811948 service nova] Creating event network-vif-deleted:0bd9eb21-bcac-4a52-8d10-e7d23735f707 for instance f4031167-4227-4699-bbcf-d0bec5e3ca8b on hv-cinder-84842 Jul 11 11:42:18.251980 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [req-a5d545a8-06db-4844-aa10-a99f3caf2e70 req-bcc3ae62-1d7d-49a1-a5a0-ed973c811948 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094231 Jul 11 11:42:18.253454 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1010/2014] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 11:42:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:42:18.698430 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-7636ed7b-ce24-4275-94ed-4ea2018eccb1 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:42:18.699065 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-7636ed7b-ce24-4275-94ed-4ea2018eccb1 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:42:18.705499 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7636ed7b-ce24-4275-94ed-4ea2018eccb1 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:18.706484 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7636ed7b-ce24-4275-94ed-4ea2018eccb1 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:18.707274 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7636ed7b-ce24-4275-94ed-4ea2018eccb1 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:18.708069 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7636ed7b-ce24-4275-94ed-4ea2018eccb1 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:18.842385 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-31cd7c94-db86-4375-863e-c27684bf86e5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:42:18.843758 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-31cd7c94-db86-4375-863e-c27684bf86e5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: f4031167-4227-4699-bbcf-d0bec5e3ca8b] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:42:18.852309 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-31cd7c94-db86-4375-863e-c27684bf86e5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:18.853139 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-31cd7c94-db86-4375-863e-c27684bf86e5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:18.854915 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-31cd7c94-db86-4375-863e-c27684bf86e5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:18.855708 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-31cd7c94-db86-4375-863e-c27684bf86e5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:18.859985 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-7636ed7b-ce24-4275-94ed-4ea2018eccb1 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:42:18.868948 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-7636ed7b-ce24-4275-94ed-4ea2018eccb1 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.175556 Jul 11 11:42:18.872623 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1005/2015] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:42:18 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:42:18.894340 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-31cd7c94-db86-4375-863e-c27684bf86e5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:18.894833 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-31cd7c94-db86-4375-863e-c27684bf86e5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:18.895304 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.objects.instance [None req-31cd7c94-db86-4375-863e-c27684bf86e5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lazy-loading 'fault' on Instance uuid f4031167-4227-4699-bbcf-d0bec5e3ca8b {{(pid=118321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 11:42:18.937499 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-31cd7c94-db86-4375-863e-c27684bf86e5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:42:18.946511 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-31cd7c94-db86-4375-863e-c27684bf86e5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:42:18.948344 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-31cd7c94-db86-4375-863e-c27684bf86e5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '993a59e8746948ab8a0f11d877314e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876864a8f283481a81ee65a1c97d0f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:42:18.949848 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-31cd7c94-db86-4375-863e-c27684bf86e5 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/f4031167-4227-4699-bbcf-d0bec5e3ca8b" status: 200 len: 1371 microversion: 2.20 time: 0.115612 Jul 11 11:42:18.950406 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1011/2016] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:42:18 2022] GET /compute/v2.1/servers/f4031167-4227-4699-bbcf-d0bec5e3ca8b => generated 1371 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 11:42:19.887453 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-35a2dc4c-71d1-40ea-8b48-4b6d7bb88ff7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:42:19.888010 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-35a2dc4c-71d1-40ea-8b48-4b6d7bb88ff7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:42:19.894304 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-35a2dc4c-71d1-40ea-8b48-4b6d7bb88ff7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:19.894749 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-35a2dc4c-71d1-40ea-8b48-4b6d7bb88ff7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:19.895533 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-35a2dc4c-71d1-40ea-8b48-4b6d7bb88ff7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:19.895967 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-35a2dc4c-71d1-40ea-8b48-4b6d7bb88ff7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:19.969690 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-1027a675-5d5e-4eaf-9288-bbd7ba1d59de tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:42:19.970422 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-1027a675-5d5e-4eaf-9288-bbd7ba1d59de tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: f4031167-4227-4699-bbcf-d0bec5e3ca8b] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:42:19.977672 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1027a675-5d5e-4eaf-9288-bbd7ba1d59de tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:19.978119 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1027a675-5d5e-4eaf-9288-bbd7ba1d59de tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:19.978877 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1027a675-5d5e-4eaf-9288-bbd7ba1d59de tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:19.979357 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1027a675-5d5e-4eaf-9288-bbd7ba1d59de tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:19.993310 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.wsgi [None req-1027a675-5d5e-4eaf-9288-bbd7ba1d59de tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] HTTP exception thrown: Instance f4031167-4227-4699-bbcf-d0bec5e3ca8b could not be found. Jul 11 11:42:19.995003 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-1027a675-5d5e-4eaf-9288-bbd7ba1d59de tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Request method failure captured: Jul 11 11:42:19.995003 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: request: GET /compute/v2.1/servers/f4031167-4227-4699-bbcf-d0bec5e3ca8b HTTP/1.1 Jul 11 11:42:19.995003 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Accept: application/json Jul 11 11:42:19.995003 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Accept-Encoding: identity Jul 11 11:42:19.995003 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Connection: close Jul 11 11:42:19.995003 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Content-Length: 0 Jul 11 11:42:19.995003 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Content-Type: application/json Jul 11 11:42:19.995003 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Host: 10.222.0.26 Jul 11 11:42:19.995003 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Openstack-System-Scope: None Jul 11 11:42:19.995003 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: User-Agent: python-urllib3/1.26.9 Jul 11 11:42:19.995003 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Auth-Token: gAAAAABizAjGbyj9-EYsdAofFu2CzO2d59ZW9ABUBAbQnLYnllzeEOzy491jQ4HEpM89bbrLUMplN6mcP6HQ3B1WwP6JVkBcg1zkYwnoXWYRasZ-vSNiHWKxPN1ixhfjDreb4HCRJcBhMJ-WtmjdLoAnivFahEDeMkVzqUGoMBW-7rS50fYCH-4 Jul 11 11:42:19.995003 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Domain-Id: None Jul 11 11:42:19.995003 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Domain-Name: None Jul 11 11:42:19.995003 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Identity-Status: Confirmed Jul 11 11:42:19.995003 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Is-Admin-Project: True Jul 11 11:42:19.995003 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Openstack-Nova-Api-Version: 2.20 Jul 11 11:42:19.995003 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Domain-Id: default Jul 11 11:42:19.995003 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Domain-Name: Default Jul 11 11:42:19.995003 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Id: 876864a8f283481a81ee65a1c97d0f4f Jul 11 11:42:19.995003 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-30953492 Jul 11 11:42:19.995003 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Role: member,reader Jul 11 11:42:19.995003 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Roles: member,reader Jul 11 11:42:19.996782 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_876864a8f283481a81ee65a1c97d0f4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/876864a8f283481a81ee65a1c97d0f4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/876864a8f283481a81ee65a1c97d0f4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/876864a8f283481a81ee65a1c97d0f4f"}]}] Jul 11 11:42:19.996782 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Tenant: tempest-AttachVolumeShelveTestJSON-30953492 Jul 11 11:42:19.996782 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Tenant-Id: 876864a8f283481a81ee65a1c97d0f4f Jul 11 11:42:19.996782 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-30953492 Jul 11 11:42:19.996782 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User: tempest-AttachVolumeShelveTestJSON-30953492-project Jul 11 11:42:19.996782 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Domain-Id: default Jul 11 11:42:19.996782 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Domain-Name: Default Jul 11 11:42:19.996782 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Id: 993a59e8746948ab8a0f11d877314e02 Jul 11 11:42:19.996782 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Name: tempest-AttachVolumeShelveTestJSON-30953492-project Jul 11 11:42:19.996782 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: method: > Jul 11 11:42:19.996782 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: exception: Instance f4031167-4227-4699-bbcf-d0bec5e3ca8b could not be found. Jul 11 11:42:19.996782 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: action_args: {'id': 'f4031167-4227-4699-bbcf-d0bec5e3ca8b'} Jul 11 11:42:20.003130 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 11:42:20.003130 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:42:20.003130 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 11:42:20.003130 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 11:42:20.003130 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 11:42:20.003130 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 11:42:20.003130 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 11:42:20.003130 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 11:42:20.003130 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 11:42:20.003130 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 11:42:20.003130 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4031167-4227-4699-bbcf-d0bec5e3ca8b could not be found. Jul 11 11:42:20.003130 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:42:20.003130 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:42:20.003130 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:42:20.003130 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:42:20.003130 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:42:20.003130 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:42:20.003130 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 11:42:20.003130 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 11:42:20.003130 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 11:42:20.004700 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 11:42:20.004700 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 11:42:20.004700 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 11:42:20.004700 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 11:42:20.004700 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 11:42:20.004700 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 11:42:20.004700 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 11:42:20.004700 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4031167-4227-4699-bbcf-d0bec5e3ca8b could not be found. Jul 11 11:42:20.004700 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:42:20.004700 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:42:20.004700 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:42:20.004700 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:42:20.004700 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:42:20.004700 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:42:20.004700 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 11:42:20.004700 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 11:42:20.004700 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4031167-4227-4699-bbcf-d0bec5e3ca8b could not be found. Jul 11 11:42:20.004700 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:42:20.006198 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-1027a675-5d5e-4eaf-9288-bbd7ba1d59de tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Returning 404 to user: Instance f4031167-4227-4699-bbcf-d0bec5e3ca8b could not be found. {{(pid=118321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 11:42:20.006198 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-1027a675-5d5e-4eaf-9288-bbd7ba1d59de tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/f4031167-4227-4699-bbcf-d0bec5e3ca8b" status: 404 len: 111 microversion: 2.20 time: 0.030657 Jul 11 11:42:20.006198 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1012/2017] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:42:19 2022] GET /compute/v2.1/servers/f4031167-4227-4699-bbcf-d0bec5e3ca8b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 11 11:42:20.006198 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-55c1ef4b-1fa0-471f-8495-77afdf149e19 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '.version_select at 0x7fb01001bf70>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:42:20.008052 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR oslo.messaging._drivers.impl_rabbit [None req-55c1ef4b-1fa0-471f-8495-77afdf149e19 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [7db4667c-0f44-4e99-8064-10feb45379e7] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 11 11:42:20.028019 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-35a2dc4c-71d1-40ea-8b48-4b6d7bb88ff7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:42:20.036587 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-35a2dc4c-71d1-40ea-8b48-4b6d7bb88ff7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.153148 Jul 11 11:42:20.037161 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1006/2018] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:42:19 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:42:21.015311 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO oslo.messaging._drivers.impl_rabbit [None req-55c1ef4b-1fa0-471f-8495-77afdf149e19 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [7db4667c-0f44-4e99-8064-10feb45379e7] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 45036. Jul 11 11:42:21.055212 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-156f0abf-699c-46fa-876d-5ecf628f3f3a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:42:21.057226 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-156f0abf-699c-46fa-876d-5ecf628f3f3a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:42:21.068350 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-156f0abf-699c-46fa-876d-5ecf628f3f3a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:21.068799 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-156f0abf-699c-46fa-876d-5ecf628f3f3a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:21.069567 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-156f0abf-699c-46fa-876d-5ecf628f3f3a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:21.069996 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-156f0abf-699c-46fa-876d-5ecf628f3f3a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:21.093027 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-55c1ef4b-1fa0-471f-8495-77afdf149e19 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-534619890" status: 204 len: 0 microversion: 2.20 time: 1.091623 Jul 11 11:42:21.093618 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1013/2019] 10.222.0.26 () {60 vars in 1258 bytes} [Mon Jul 11 11:42:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-534619890 => generated 0 bytes in 1093 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 11 11:42:21.271202 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-156f0abf-699c-46fa-876d-5ecf628f3f3a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:42:21.279082 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-156f0abf-699c-46fa-876d-5ecf628f3f3a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.229394 Jul 11 11:42:21.279687 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1007/2020] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:42:21 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:42:22.297091 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-b8dbfb83-57b1-40aa-aee9-073e9e4bffd6 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:42:22.297705 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-b8dbfb83-57b1-40aa-aee9-073e9e4bffd6 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:42:22.305107 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b8dbfb83-57b1-40aa-aee9-073e9e4bffd6 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:22.305560 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b8dbfb83-57b1-40aa-aee9-073e9e4bffd6 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:22.306319 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b8dbfb83-57b1-40aa-aee9-073e9e4bffd6 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:22.306756 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b8dbfb83-57b1-40aa-aee9-073e9e4bffd6 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:22.435078 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-b8dbfb83-57b1-40aa-aee9-073e9e4bffd6 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:42:22.443729 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-b8dbfb83-57b1-40aa-aee9-073e9e4bffd6 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.150988 Jul 11 11:42:22.444297 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1014/2021] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:42:22 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:42:23.461656 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-31176667-82f5-405e-92ac-3abc9aa4156a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:42:23.471385 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-31176667-82f5-405e-92ac-3abc9aa4156a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:42:23.471385 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-31176667-82f5-405e-92ac-3abc9aa4156a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:23.471385 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-31176667-82f5-405e-92ac-3abc9aa4156a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:23.474541 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-31176667-82f5-405e-92ac-3abc9aa4156a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:23.475024 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-31176667-82f5-405e-92ac-3abc9aa4156a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:23.615174 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-31176667-82f5-405e-92ac-3abc9aa4156a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:42:23.622984 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-31176667-82f5-405e-92ac-3abc9aa4156a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.165281 Jul 11 11:42:23.623578 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1008/2022] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:42:23 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:42:24.640235 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-41c3e132-3ddb-4b4e-ad51-3e6e040c6aa0 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:42:24.640854 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-41c3e132-3ddb-4b4e-ad51-3e6e040c6aa0 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:42:24.647867 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-41c3e132-3ddb-4b4e-ad51-3e6e040c6aa0 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:24.648317 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-41c3e132-3ddb-4b4e-ad51-3e6e040c6aa0 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:24.649082 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-41c3e132-3ddb-4b4e-ad51-3e6e040c6aa0 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:24.649521 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-41c3e132-3ddb-4b4e-ad51-3e6e040c6aa0 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:24.775650 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-41c3e132-3ddb-4b4e-ad51-3e6e040c6aa0 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:42:24.783572 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-41c3e132-3ddb-4b4e-ad51-3e6e040c6aa0 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.147057 Jul 11 11:42:24.784828 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1015/2023] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:42:24 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:42:25.801538 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-5c6cb18e-018e-453d-8837-439a89cfeccc tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:42:25.802150 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-5c6cb18e-018e-453d-8837-439a89cfeccc tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:42:25.808584 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5c6cb18e-018e-453d-8837-439a89cfeccc tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:25.809031 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5c6cb18e-018e-453d-8837-439a89cfeccc tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:25.809786 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5c6cb18e-018e-453d-8837-439a89cfeccc tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:25.810233 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5c6cb18e-018e-453d-8837-439a89cfeccc tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:25.938561 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-5c6cb18e-018e-453d-8837-439a89cfeccc tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:42:25.946941 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-5c6cb18e-018e-453d-8837-439a89cfeccc tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.149581 Jul 11 11:42:25.947530 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1009/2024] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:42:25 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:42:26.963524 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-49065d2b-c36d-4767-a562-60b53c7d36be tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:42:26.964137 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-49065d2b-c36d-4767-a562-60b53c7d36be tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:42:26.970484 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-49065d2b-c36d-4767-a562-60b53c7d36be tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:26.970929 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-49065d2b-c36d-4767-a562-60b53c7d36be tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:26.971723 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-49065d2b-c36d-4767-a562-60b53c7d36be tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:26.972173 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-49065d2b-c36d-4767-a562-60b53c7d36be tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:27.111882 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-49065d2b-c36d-4767-a562-60b53c7d36be tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:42:27.120306 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-49065d2b-c36d-4767-a562-60b53c7d36be tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.160668 Jul 11 11:42:27.120871 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1016/2025] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:42:26 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:42:28.137888 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-55d3d8a2-070d-4705-9c1c-41739903ef41 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:42:28.138494 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-55d3d8a2-070d-4705-9c1c-41739903ef41 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:42:28.145612 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-55d3d8a2-070d-4705-9c1c-41739903ef41 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:28.146060 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-55d3d8a2-070d-4705-9c1c-41739903ef41 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:28.146874 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-55d3d8a2-070d-4705-9c1c-41739903ef41 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:28.147335 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-55d3d8a2-070d-4705-9c1c-41739903ef41 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:28.280517 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-55d3d8a2-070d-4705-9c1c-41739903ef41 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:42:28.292065 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-55d3d8a2-070d-4705-9c1c-41739903ef41 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.157987 Jul 11 11:42:28.292978 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1010/2026] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:42:28 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:42:29.309962 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-66191507-f901-424f-813a-c36342568f42 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:42:29.310505 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-66191507-f901-424f-813a-c36342568f42 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:42:29.317652 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-66191507-f901-424f-813a-c36342568f42 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:29.318095 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-66191507-f901-424f-813a-c36342568f42 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:29.318855 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-66191507-f901-424f-813a-c36342568f42 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:29.319315 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-66191507-f901-424f-813a-c36342568f42 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:29.448699 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-66191507-f901-424f-813a-c36342568f42 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:42:29.456689 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-66191507-f901-424f-813a-c36342568f42 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.150695 Jul 11 11:42:29.457263 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1017/2027] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:42:29 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:42:30.473621 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-f78fd79a-e71c-42f5-adbf-b3435541b3d1 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:42:30.474231 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-f78fd79a-e71c-42f5-adbf-b3435541b3d1 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:42:30.480682 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f78fd79a-e71c-42f5-adbf-b3435541b3d1 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:30.481129 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f78fd79a-e71c-42f5-adbf-b3435541b3d1 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:30.481888 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f78fd79a-e71c-42f5-adbf-b3435541b3d1 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:30.482325 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f78fd79a-e71c-42f5-adbf-b3435541b3d1 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:30.609928 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-f78fd79a-e71c-42f5-adbf-b3435541b3d1 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:42:30.618235 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-f78fd79a-e71c-42f5-adbf-b3435541b3d1 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.148445 Jul 11 11:42:30.618801 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1011/2028] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:42:30 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:42:31.635874 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-a318a12b-b9a1-42e2-8096-849075d8e1cf tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:42:31.636461 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-a318a12b-b9a1-42e2-8096-849075d8e1cf tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:42:31.643017 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a318a12b-b9a1-42e2-8096-849075d8e1cf tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:31.643488 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a318a12b-b9a1-42e2-8096-849075d8e1cf tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:31.644242 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a318a12b-b9a1-42e2-8096-849075d8e1cf tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:31.644674 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a318a12b-b9a1-42e2-8096-849075d8e1cf tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:31.769156 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-a318a12b-b9a1-42e2-8096-849075d8e1cf tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:42:31.777518 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-a318a12b-b9a1-42e2-8096-849075d8e1cf tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.145475 Jul 11 11:42:31.778086 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1018/2029] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:42:31 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:42:32.793837 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-0c3ab047-242a-43f3-ada7-f1704ef8f996 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:42:32.794359 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-0c3ab047-242a-43f3-ada7-f1704ef8f996 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:42:32.801000 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0c3ab047-242a-43f3-ada7-f1704ef8f996 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:32.801455 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0c3ab047-242a-43f3-ada7-f1704ef8f996 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:32.802219 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0c3ab047-242a-43f3-ada7-f1704ef8f996 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:32.802662 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0c3ab047-242a-43f3-ada7-f1704ef8f996 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:32.929392 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-0c3ab047-242a-43f3-ada7-f1704ef8f996 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:42:32.937265 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-0c3ab047-242a-43f3-ada7-f1704ef8f996 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.147331 Jul 11 11:42:32.937837 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1012/2030] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:42:32 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:42:33.953932 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-b6b188db-e17b-4140-8075-62360ce096fc tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:42:33.954535 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-b6b188db-e17b-4140-8075-62360ce096fc tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:42:33.961050 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b6b188db-e17b-4140-8075-62360ce096fc tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:33.961491 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b6b188db-e17b-4140-8075-62360ce096fc tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:33.962237 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b6b188db-e17b-4140-8075-62360ce096fc tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:33.962669 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b6b188db-e17b-4140-8075-62360ce096fc tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:34.111121 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-b6b188db-e17b-4140-8075-62360ce096fc tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:42:34.119859 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-b6b188db-e17b-4140-8075-62360ce096fc tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.169748 Jul 11 11:42:34.121765 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1019/2031] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:42:33 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:42:35.136684 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-b162ac9e-abc4-4d83-96ac-89dffcada475 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:42:35.137392 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-b162ac9e-abc4-4d83-96ac-89dffcada475 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:42:35.143831 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b162ac9e-abc4-4d83-96ac-89dffcada475 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:35.144275 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b162ac9e-abc4-4d83-96ac-89dffcada475 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:35.145030 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b162ac9e-abc4-4d83-96ac-89dffcada475 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:35.145522 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b162ac9e-abc4-4d83-96ac-89dffcada475 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:35.272734 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-b162ac9e-abc4-4d83-96ac-89dffcada475 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:42:35.280648 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-b162ac9e-abc4-4d83-96ac-89dffcada475 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.147746 Jul 11 11:42:35.281214 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1013/2032] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:42:35 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:42:36.297959 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-a4b8f922-37c3-406a-a825-b411f2eea2d8 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:42:36.298594 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-a4b8f922-37c3-406a-a825-b411f2eea2d8 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:42:36.305052 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a4b8f922-37c3-406a-a825-b411f2eea2d8 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:36.305510 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a4b8f922-37c3-406a-a825-b411f2eea2d8 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:36.306254 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a4b8f922-37c3-406a-a825-b411f2eea2d8 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:36.306681 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a4b8f922-37c3-406a-a825-b411f2eea2d8 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:36.437610 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-a4b8f922-37c3-406a-a825-b411f2eea2d8 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:42:36.446598 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-a4b8f922-37c3-406a-a825-b411f2eea2d8 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.152555 Jul 11 11:42:36.447469 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1020/2033] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:42:36 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:42:37.464529 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-e19e9fd6-d749-45d3-8be9-10b8d15ec898 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:42:37.465145 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-e19e9fd6-d749-45d3-8be9-10b8d15ec898 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:42:37.471580 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e19e9fd6-d749-45d3-8be9-10b8d15ec898 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:37.472053 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e19e9fd6-d749-45d3-8be9-10b8d15ec898 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:37.472802 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e19e9fd6-d749-45d3-8be9-10b8d15ec898 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:37.473317 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e19e9fd6-d749-45d3-8be9-10b8d15ec898 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:37.602584 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-e19e9fd6-d749-45d3-8be9-10b8d15ec898 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:42:37.610715 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-e19e9fd6-d749-45d3-8be9-10b8d15ec898 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.149999 Jul 11 11:42:37.611305 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1014/2034] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:42:37 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:42:38.627515 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-b2a5038d-de2f-463f-9205-394682a8eb05 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:42:38.628130 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-b2a5038d-de2f-463f-9205-394682a8eb05 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:42:38.634523 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b2a5038d-de2f-463f-9205-394682a8eb05 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:38.634966 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b2a5038d-de2f-463f-9205-394682a8eb05 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:38.635744 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b2a5038d-de2f-463f-9205-394682a8eb05 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:38.636175 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b2a5038d-de2f-463f-9205-394682a8eb05 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:38.765671 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-b2a5038d-de2f-463f-9205-394682a8eb05 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:42:38.774241 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-b2a5038d-de2f-463f-9205-394682a8eb05 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.150605 Jul 11 11:42:38.774818 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1021/2035] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:42:38 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:42:39.791358 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-4fdae3d3-09dc-490c-8e04-05004b4b3910 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:42:39.791972 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-4fdae3d3-09dc-490c-8e04-05004b4b3910 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:42:39.798410 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4fdae3d3-09dc-490c-8e04-05004b4b3910 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:39.798859 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4fdae3d3-09dc-490c-8e04-05004b4b3910 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:39.799650 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4fdae3d3-09dc-490c-8e04-05004b4b3910 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:39.800089 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4fdae3d3-09dc-490c-8e04-05004b4b3910 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:39.935824 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-4fdae3d3-09dc-490c-8e04-05004b4b3910 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:42:39.944070 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-4fdae3d3-09dc-490c-8e04-05004b4b3910 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.156606 Jul 11 11:42:39.944644 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1015/2036] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:42:39 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:42:40.961549 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-f6c8ba02-99e6-4c95-903f-b4a5a7ce268e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:42:40.962162 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-f6c8ba02-99e6-4c95-903f-b4a5a7ce268e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:42:40.968335 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f6c8ba02-99e6-4c95-903f-b4a5a7ce268e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:40.968777 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f6c8ba02-99e6-4c95-903f-b4a5a7ce268e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:40.969532 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f6c8ba02-99e6-4c95-903f-b4a5a7ce268e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:40.969964 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f6c8ba02-99e6-4c95-903f-b4a5a7ce268e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:41.095482 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-f6c8ba02-99e6-4c95-903f-b4a5a7ce268e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:42:41.103306 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-f6c8ba02-99e6-4c95-903f-b4a5a7ce268e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.145975 Jul 11 11:42:41.103879 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1022/2037] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:42:40 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:42:42.120031 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-e638c150-fbf1-4e31-99fd-5dfe570b0163 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:42:42.120637 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-e638c150-fbf1-4e31-99fd-5dfe570b0163 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:42:42.127202 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e638c150-fbf1-4e31-99fd-5dfe570b0163 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:42.127668 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e638c150-fbf1-4e31-99fd-5dfe570b0163 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:42.128448 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e638c150-fbf1-4e31-99fd-5dfe570b0163 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:42.128880 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e638c150-fbf1-4e31-99fd-5dfe570b0163 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:42.255122 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-e638c150-fbf1-4e31-99fd-5dfe570b0163 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:42:42.262834 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-e638c150-fbf1-4e31-99fd-5dfe570b0163 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.146614 Jul 11 11:42:42.263417 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1016/2038] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:42:42 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:42:43.280418 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-33bfcf29-9e70-48ab-ac3c-bafc97b7c6cf tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:42:43.280961 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-33bfcf29-9e70-48ab-ac3c-bafc97b7c6cf tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:42:43.288145 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-33bfcf29-9e70-48ab-ac3c-bafc97b7c6cf tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:43.288597 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-33bfcf29-9e70-48ab-ac3c-bafc97b7c6cf tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:43.289355 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-33bfcf29-9e70-48ab-ac3c-bafc97b7c6cf tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:43.289786 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-33bfcf29-9e70-48ab-ac3c-bafc97b7c6cf tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:43.417691 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-33bfcf29-9e70-48ab-ac3c-bafc97b7c6cf tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:42:43.425596 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-33bfcf29-9e70-48ab-ac3c-bafc97b7c6cf tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.149166 Jul 11 11:42:43.426177 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1023/2039] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:42:43 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:42:44.442080 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-b3ba621a-bb79-4ea3-ad22-59c1aa536b1e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:42:44.442690 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-b3ba621a-bb79-4ea3-ad22-59c1aa536b1e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:42:44.449568 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b3ba621a-bb79-4ea3-ad22-59c1aa536b1e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:44.450015 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b3ba621a-bb79-4ea3-ad22-59c1aa536b1e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:44.450783 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b3ba621a-bb79-4ea3-ad22-59c1aa536b1e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:44.451222 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b3ba621a-bb79-4ea3-ad22-59c1aa536b1e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:44.799892 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-b3ba621a-bb79-4ea3-ad22-59c1aa536b1e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:42:44.807680 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-b3ba621a-bb79-4ea3-ad22-59c1aa536b1e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.369469 Jul 11 11:42:44.808253 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1017/2040] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:42:44 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:42:45.824771 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-4ad79aff-5871-451b-b9e0-580c081c4e6b tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:42:45.825524 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-4ad79aff-5871-451b-b9e0-580c081c4e6b tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:42:45.831448 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4ad79aff-5871-451b-b9e0-580c081c4e6b tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:45.831890 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4ad79aff-5871-451b-b9e0-580c081c4e6b tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:45.832651 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4ad79aff-5871-451b-b9e0-580c081c4e6b tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:45.833075 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4ad79aff-5871-451b-b9e0-580c081c4e6b tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:45.961730 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-4ad79aff-5871-451b-b9e0-580c081c4e6b tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:42:45.969642 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-4ad79aff-5871-451b-b9e0-580c081c4e6b tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.149088 Jul 11 11:42:45.970208 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1024/2041] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:42:45 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:42:46.987000 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-253c0111-eba1-4781-b979-132bd5aaeddc tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:42:46.987682 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-253c0111-eba1-4781-b979-132bd5aaeddc tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:42:46.994206 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-253c0111-eba1-4781-b979-132bd5aaeddc tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:46.994654 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-253c0111-eba1-4781-b979-132bd5aaeddc tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:46.995440 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-253c0111-eba1-4781-b979-132bd5aaeddc tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:46.995879 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-253c0111-eba1-4781-b979-132bd5aaeddc tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:47.120790 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-253c0111-eba1-4781-b979-132bd5aaeddc tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:42:47.128529 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-253c0111-eba1-4781-b979-132bd5aaeddc tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.145415 Jul 11 11:42:47.129098 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1018/2042] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:42:46 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:42:48.145840 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-a7ede86e-c113-47be-b9ec-94608c2c746e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:42:48.146447 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-a7ede86e-c113-47be-b9ec-94608c2c746e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:42:48.149475 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:42:48.154234 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a7ede86e-c113-47be-b9ec-94608c2c746e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:48.156587 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a7ede86e-c113-47be-b9ec-94608c2c746e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:48.156587 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a7ede86e-c113-47be-b9ec-94608c2c746e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:48.156587 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a7ede86e-c113-47be-b9ec-94608c2c746e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:48.158342 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:42:48.288365 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-a7ede86e-c113-47be-b9ec-94608c2c746e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:42:48.296017 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-a7ede86e-c113-47be-b9ec-94608c2c746e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.154018 Jul 11 11:42:48.296583 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1025/2043] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:42:48 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:42:49.312998 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-870e9792-d0be-468d-af14-d01f47d768fd tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:42:49.313550 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-870e9792-d0be-468d-af14-d01f47d768fd tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:42:49.315830 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_api:SELECT=30 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:42:49.320483 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-870e9792-d0be-468d-af14-d01f47d768fd tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:49.320933 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-870e9792-d0be-468d-af14-d01f47d768fd tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:49.321682 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-870e9792-d0be-468d-af14-d01f47d768fd tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:49.322384 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-870e9792-d0be-468d-af14-d01f47d768fd tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:49.324892 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=90 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:42:49.456411 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-870e9792-d0be-468d-af14-d01f47d768fd tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:42:49.464890 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-870e9792-d0be-468d-af14-d01f47d768fd tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.155722 Jul 11 11:42:49.465456 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1019/2044] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:42:49 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:42:50.482202 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-3e5c6db7-5a18-4dd6-90c5-460d3f613ad7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:42:50.482816 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-3e5c6db7-5a18-4dd6-90c5-460d3f613ad7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:42:50.489841 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3e5c6db7-5a18-4dd6-90c5-460d3f613ad7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:50.490290 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3e5c6db7-5a18-4dd6-90c5-460d3f613ad7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:50.491737 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3e5c6db7-5a18-4dd6-90c5-460d3f613ad7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:50.492174 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3e5c6db7-5a18-4dd6-90c5-460d3f613ad7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:50.620806 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-3e5c6db7-5a18-4dd6-90c5-460d3f613ad7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:42:50.628638 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-3e5c6db7-5a18-4dd6-90c5-460d3f613ad7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.150605 Jul 11 11:42:50.629221 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1026/2045] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:42:50 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:42:51.645918 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-e1cff482-e6cf-490a-bcf9-f396f6395526 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:42:51.646528 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-e1cff482-e6cf-490a-bcf9-f396f6395526 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:42:51.653643 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e1cff482-e6cf-490a-bcf9-f396f6395526 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:51.654094 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e1cff482-e6cf-490a-bcf9-f396f6395526 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:51.654853 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e1cff482-e6cf-490a-bcf9-f396f6395526 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:51.655308 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e1cff482-e6cf-490a-bcf9-f396f6395526 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:51.780548 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-e1cff482-e6cf-490a-bcf9-f396f6395526 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:42:51.788968 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-e1cff482-e6cf-490a-bcf9-f396f6395526 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.146892 Jul 11 11:42:51.789523 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1020/2046] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:42:51 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:42:52.805916 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-ae2f1f4a-556f-4699-a1e6-9a1f5dcdf1c7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:42:52.806548 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-ae2f1f4a-556f-4699-a1e6-9a1f5dcdf1c7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:42:52.813559 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ae2f1f4a-556f-4699-a1e6-9a1f5dcdf1c7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:52.814001 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ae2f1f4a-556f-4699-a1e6-9a1f5dcdf1c7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:52.814752 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ae2f1f4a-556f-4699-a1e6-9a1f5dcdf1c7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:52.815175 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ae2f1f4a-556f-4699-a1e6-9a1f5dcdf1c7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:52.945447 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-ae2f1f4a-556f-4699-a1e6-9a1f5dcdf1c7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:42:52.948629 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-ae2f1f4a-556f-4699-a1e6-9a1f5dcdf1c7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.146606 Jul 11 11:42:52.949183 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1027/2047] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:42:52 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:42:53.966043 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-e993e8bd-6e2c-4383-9d27-24fd1ea36abc tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:42:53.966660 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-e993e8bd-6e2c-4383-9d27-24fd1ea36abc tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:42:53.973195 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e993e8bd-6e2c-4383-9d27-24fd1ea36abc tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:53.973648 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e993e8bd-6e2c-4383-9d27-24fd1ea36abc tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:53.974422 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e993e8bd-6e2c-4383-9d27-24fd1ea36abc tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:53.975478 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e993e8bd-6e2c-4383-9d27-24fd1ea36abc tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:54.109139 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-e993e8bd-6e2c-4383-9d27-24fd1ea36abc tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:42:54.117158 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-e993e8bd-6e2c-4383-9d27-24fd1ea36abc tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.154956 Jul 11 11:42:54.117728 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1021/2048] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:42:53 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:42:55.134699 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-c71adbdf-9247-42b4-b8ea-137a3baca22e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:42:55.135352 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-c71adbdf-9247-42b4-b8ea-137a3baca22e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:42:55.141970 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c71adbdf-9247-42b4-b8ea-137a3baca22e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:55.142418 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c71adbdf-9247-42b4-b8ea-137a3baca22e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:55.143182 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c71adbdf-9247-42b4-b8ea-137a3baca22e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:55.143658 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c71adbdf-9247-42b4-b8ea-137a3baca22e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:55.283085 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-c71adbdf-9247-42b4-b8ea-137a3baca22e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:42:55.290944 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-c71adbdf-9247-42b4-b8ea-137a3baca22e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.160996 Jul 11 11:42:55.291557 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1028/2049] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:42:55 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:42:56.307466 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-197e3245-eb41-41e0-8115-209b5c758f56 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:42:56.308078 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-197e3245-eb41-41e0-8115-209b5c758f56 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:42:56.314545 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-197e3245-eb41-41e0-8115-209b5c758f56 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:56.314998 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-197e3245-eb41-41e0-8115-209b5c758f56 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:56.315793 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-197e3245-eb41-41e0-8115-209b5c758f56 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:56.316232 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-197e3245-eb41-41e0-8115-209b5c758f56 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:56.444732 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-197e3245-eb41-41e0-8115-209b5c758f56 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:42:56.452812 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-197e3245-eb41-41e0-8115-209b5c758f56 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.149189 Jul 11 11:42:56.453682 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1022/2050] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:42:56 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:42:57.469962 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-b431bf0c-d6dc-43b4-9519-ec1c72191f32 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:42:57.470579 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-b431bf0c-d6dc-43b4-9519-ec1c72191f32 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:42:57.478051 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b431bf0c-d6dc-43b4-9519-ec1c72191f32 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:57.478501 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b431bf0c-d6dc-43b4-9519-ec1c72191f32 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:57.479294 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b431bf0c-d6dc-43b4-9519-ec1c72191f32 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:57.479736 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b431bf0c-d6dc-43b4-9519-ec1c72191f32 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:57.607261 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-b431bf0c-d6dc-43b4-9519-ec1c72191f32 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:42:57.615203 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-b431bf0c-d6dc-43b4-9519-ec1c72191f32 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.149023 Jul 11 11:42:57.615860 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1029/2051] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:42:57 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:42:58.633715 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-9627866c-fd7f-4b01-8e88-850a0b87f93a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:42:58.634319 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-9627866c-fd7f-4b01-8e88-850a0b87f93a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:42:58.643658 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9627866c-fd7f-4b01-8e88-850a0b87f93a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:58.644397 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9627866c-fd7f-4b01-8e88-850a0b87f93a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:58.645658 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9627866c-fd7f-4b01-8e88-850a0b87f93a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:58.646419 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9627866c-fd7f-4b01-8e88-850a0b87f93a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:58.776527 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-9627866c-fd7f-4b01-8e88-850a0b87f93a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:42:58.784312 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-9627866c-fd7f-4b01-8e88-850a0b87f93a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.156161 Jul 11 11:42:58.784880 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1023/2052] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:42:58 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:42:59.801583 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-03e55a59-eb95-4c0f-9b73-4158b73d437e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:42:59.802190 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-03e55a59-eb95-4c0f-9b73-4158b73d437e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:42:59.809144 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-03e55a59-eb95-4c0f-9b73-4158b73d437e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:59.809586 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-03e55a59-eb95-4c0f-9b73-4158b73d437e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:59.810331 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-03e55a59-eb95-4c0f-9b73-4158b73d437e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:42:59.810758 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-03e55a59-eb95-4c0f-9b73-4158b73d437e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:42:59.940770 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-03e55a59-eb95-4c0f-9b73-4158b73d437e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:42:59.949577 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-03e55a59-eb95-4c0f-9b73-4158b73d437e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.151802 Jul 11 11:42:59.950140 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1030/2053] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:42:59 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:00.966303 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-54b4e550-eefb-4cf3-8353-4f7506ad53c1 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:00.966956 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-54b4e550-eefb-4cf3-8353-4f7506ad53c1 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:00.973413 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-54b4e550-eefb-4cf3-8353-4f7506ad53c1 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:00.973859 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-54b4e550-eefb-4cf3-8353-4f7506ad53c1 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:00.974614 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-54b4e550-eefb-4cf3-8353-4f7506ad53c1 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:00.975050 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-54b4e550-eefb-4cf3-8353-4f7506ad53c1 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:01.108561 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-54b4e550-eefb-4cf3-8353-4f7506ad53c1 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:01.116390 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-54b4e550-eefb-4cf3-8353-4f7506ad53c1 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.153941 Jul 11 11:43:01.119477 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1024/2054] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:00 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:02.135840 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-087c5120-9608-4aa0-8465-8b7f20fffe8d tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:02.136444 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-087c5120-9608-4aa0-8465-8b7f20fffe8d tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:02.142860 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-087c5120-9608-4aa0-8465-8b7f20fffe8d tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:02.143331 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-087c5120-9608-4aa0-8465-8b7f20fffe8d tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:02.144084 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-087c5120-9608-4aa0-8465-8b7f20fffe8d tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:02.144514 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-087c5120-9608-4aa0-8465-8b7f20fffe8d tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:02.270940 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-087c5120-9608-4aa0-8465-8b7f20fffe8d tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:02.279285 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-087c5120-9608-4aa0-8465-8b7f20fffe8d tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.147293 Jul 11 11:43:02.279847 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1031/2055] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:02 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:03.296876 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-eb74e76d-a80c-4683-ad76-d1a5bedb7182 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:03.297486 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-eb74e76d-a80c-4683-ad76-d1a5bedb7182 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:03.304495 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-eb74e76d-a80c-4683-ad76-d1a5bedb7182 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:03.304938 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-eb74e76d-a80c-4683-ad76-d1a5bedb7182 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:03.305737 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-eb74e76d-a80c-4683-ad76-d1a5bedb7182 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:03.306167 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-eb74e76d-a80c-4683-ad76-d1a5bedb7182 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:03.433690 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-eb74e76d-a80c-4683-ad76-d1a5bedb7182 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:03.441658 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-eb74e76d-a80c-4683-ad76-d1a5bedb7182 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.148723 Jul 11 11:43:03.442231 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1025/2056] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:03 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:04.458982 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-4c14f7ba-b202-43a8-992c-17aa623d1757 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:04.459550 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-4c14f7ba-b202-43a8-992c-17aa623d1757 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:04.465974 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4c14f7ba-b202-43a8-992c-17aa623d1757 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:04.466430 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4c14f7ba-b202-43a8-992c-17aa623d1757 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:04.467192 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4c14f7ba-b202-43a8-992c-17aa623d1757 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:04.467657 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4c14f7ba-b202-43a8-992c-17aa623d1757 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:04.597828 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-4c14f7ba-b202-43a8-992c-17aa623d1757 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:04.606675 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-4c14f7ba-b202-43a8-992c-17aa623d1757 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.151695 Jul 11 11:43:04.614410 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1032/2057] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:04 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:05.624676 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-8b84473e-0fbd-4eb7-9348-4d96a1bd1b43 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:05.625287 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-8b84473e-0fbd-4eb7-9348-4d96a1bd1b43 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:05.632222 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8b84473e-0fbd-4eb7-9348-4d96a1bd1b43 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:05.632672 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8b84473e-0fbd-4eb7-9348-4d96a1bd1b43 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:05.633425 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8b84473e-0fbd-4eb7-9348-4d96a1bd1b43 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:05.633884 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8b84473e-0fbd-4eb7-9348-4d96a1bd1b43 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:05.767641 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-8b84473e-0fbd-4eb7-9348-4d96a1bd1b43 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:05.775545 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-8b84473e-0fbd-4eb7-9348-4d96a1bd1b43 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.154636 Jul 11 11:43:05.776115 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1026/2058] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:05 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:06.792616 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-75c313fe-c76c-41c1-a631-75acef295598 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:06.793230 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-75c313fe-c76c-41c1-a631-75acef295598 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:06.799756 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-75c313fe-c76c-41c1-a631-75acef295598 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:06.800207 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-75c313fe-c76c-41c1-a631-75acef295598 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:06.800968 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-75c313fe-c76c-41c1-a631-75acef295598 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:06.801403 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-75c313fe-c76c-41c1-a631-75acef295598 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:06.930793 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-75c313fe-c76c-41c1-a631-75acef295598 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:06.938765 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-75c313fe-c76c-41c1-a631-75acef295598 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.149890 Jul 11 11:43:06.939364 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1033/2059] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:06 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:07.956746 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-3a2b1f7c-c507-455a-8dfb-65e83cf5815e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:07.957382 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-3a2b1f7c-c507-455a-8dfb-65e83cf5815e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:07.963960 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3a2b1f7c-c507-455a-8dfb-65e83cf5815e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:07.964406 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3a2b1f7c-c507-455a-8dfb-65e83cf5815e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:07.965156 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3a2b1f7c-c507-455a-8dfb-65e83cf5815e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:07.965587 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3a2b1f7c-c507-455a-8dfb-65e83cf5815e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:08.114095 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-3a2b1f7c-c507-455a-8dfb-65e83cf5815e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:08.122608 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-3a2b1f7c-c507-455a-8dfb-65e83cf5815e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.169656 Jul 11 11:43:08.123180 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1027/2060] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:07 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:09.140157 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-f29f660a-e8ba-4702-8b26-b5bba3f72078 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:09.140767 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-f29f660a-e8ba-4702-8b26-b5bba3f72078 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:09.147825 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f29f660a-e8ba-4702-8b26-b5bba3f72078 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:09.148298 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f29f660a-e8ba-4702-8b26-b5bba3f72078 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:09.149034 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f29f660a-e8ba-4702-8b26-b5bba3f72078 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:09.149468 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f29f660a-e8ba-4702-8b26-b5bba3f72078 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:09.281170 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-f29f660a-e8ba-4702-8b26-b5bba3f72078 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:09.289092 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-f29f660a-e8ba-4702-8b26-b5bba3f72078 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.152693 Jul 11 11:43:09.289590 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1034/2061] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:09 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:10.305932 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-da2c9243-b85f-489c-9caf-54c7ff4186e8 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:10.306653 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-da2c9243-b85f-489c-9caf-54c7ff4186e8 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:10.313309 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-da2c9243-b85f-489c-9caf-54c7ff4186e8 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:10.313751 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-da2c9243-b85f-489c-9caf-54c7ff4186e8 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:10.314495 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-da2c9243-b85f-489c-9caf-54c7ff4186e8 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:10.314922 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-da2c9243-b85f-489c-9caf-54c7ff4186e8 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:10.444146 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-da2c9243-b85f-489c-9caf-54c7ff4186e8 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:10.452357 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-da2c9243-b85f-489c-9caf-54c7ff4186e8 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.150303 Jul 11 11:43:10.452868 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1028/2062] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:10 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:11.469859 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-bac27bc8-702a-4e6f-b928-b1ab3ddcf9f7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:11.470476 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-bac27bc8-702a-4e6f-b928-b1ab3ddcf9f7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:11.477465 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bac27bc8-702a-4e6f-b928-b1ab3ddcf9f7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:11.477903 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bac27bc8-702a-4e6f-b928-b1ab3ddcf9f7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:11.478663 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bac27bc8-702a-4e6f-b928-b1ab3ddcf9f7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:11.479105 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bac27bc8-702a-4e6f-b928-b1ab3ddcf9f7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:11.607563 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-bac27bc8-702a-4e6f-b928-b1ab3ddcf9f7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:11.615354 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-bac27bc8-702a-4e6f-b928-b1ab3ddcf9f7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.149325 Jul 11 11:43:11.616544 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1035/2063] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:11 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:12.633551 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-5e1d549b-faa8-40b8-8bb5-80128bd3f767 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:12.634090 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-5e1d549b-faa8-40b8-8bb5-80128bd3f767 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:12.640645 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5e1d549b-faa8-40b8-8bb5-80128bd3f767 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:12.641101 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5e1d549b-faa8-40b8-8bb5-80128bd3f767 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:12.641852 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5e1d549b-faa8-40b8-8bb5-80128bd3f767 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:12.642273 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5e1d549b-faa8-40b8-8bb5-80128bd3f767 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:12.774361 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-5e1d549b-faa8-40b8-8bb5-80128bd3f767 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:12.782187 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-5e1d549b-faa8-40b8-8bb5-80128bd3f767 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.153106 Jul 11 11:43:12.782741 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1029/2064] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:12 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:13.800354 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-272b5f32-a6ab-4a39-92fe-a4bb566663ba tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:13.800966 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-272b5f32-a6ab-4a39-92fe-a4bb566663ba tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:13.807294 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-272b5f32-a6ab-4a39-92fe-a4bb566663ba tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:13.810683 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-272b5f32-a6ab-4a39-92fe-a4bb566663ba tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:13.810683 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-272b5f32-a6ab-4a39-92fe-a4bb566663ba tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:13.810683 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-272b5f32-a6ab-4a39-92fe-a4bb566663ba tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:13.937158 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-272b5f32-a6ab-4a39-92fe-a4bb566663ba tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:13.945667 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-272b5f32-a6ab-4a39-92fe-a4bb566663ba tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.149293 Jul 11 11:43:13.946222 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1036/2065] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:13 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:14.091640 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-d0059b6c-5b3d-45f9-a8f0-ea3b213f10b9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:14.092151 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-d0059b6c-5b3d-45f9-a8f0-ea3b213f10b9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:14.098479 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d0059b6c-5b3d-45f9-a8f0-ea3b213f10b9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:14.098931 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d0059b6c-5b3d-45f9-a8f0-ea3b213f10b9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:14.099731 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d0059b6c-5b3d-45f9-a8f0-ea3b213f10b9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:14.100359 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d0059b6c-5b3d-45f9-a8f0-ea3b213f10b9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:14.125007 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-d0059b6c-5b3d-45f9-a8f0-ea3b213f10b9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Going to try to terminate instance {{(pid=118322) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 11:43:14.336015 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-d0059b6c-5b3d-45f9-a8f0-ea3b213f10b9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "DELETE /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 204 len: 0 microversion: 2.1 time: 0.247834 Jul 11 11:43:14.336611 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1030/2066] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 11 11:43:14 2022] DELETE /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 11 11:43:14.344804 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-be5ce0b3-2a61-40df-8adf-249bba9fd21c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:14.345507 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-be5ce0b3-2a61-40df-8adf-249bba9fd21c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:14.351869 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-be5ce0b3-2a61-40df-8adf-249bba9fd21c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:14.352309 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-be5ce0b3-2a61-40df-8adf-249bba9fd21c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:14.353058 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-be5ce0b3-2a61-40df-8adf-249bba9fd21c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:14.353486 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-be5ce0b3-2a61-40df-8adf-249bba9fd21c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:14.485541 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-be5ce0b3-2a61-40df-8adf-249bba9fd21c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:14.493832 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-be5ce0b3-2a61-40df-8adf-249bba9fd21c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1719 microversion: 2.1 time: 0.152912 Jul 11 11:43:14.494395 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1037/2067] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:14 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1719 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:43:14.963832 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-8e204765-f05d-454d-9d19-8ad6094994d5 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:14.964530 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-8e204765-f05d-454d-9d19-8ad6094994d5 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:14.970577 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8e204765-f05d-454d-9d19-8ad6094994d5 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:14.971024 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8e204765-f05d-454d-9d19-8ad6094994d5 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:14.971812 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8e204765-f05d-454d-9d19-8ad6094994d5 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:14.972252 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8e204765-f05d-454d-9d19-8ad6094994d5 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:15.105144 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-8e204765-f05d-454d-9d19-8ad6094994d5 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:15.113315 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-8e204765-f05d-454d-9d19-8ad6094994d5 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.154152 Jul 11 11:43:15.113889 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1031/2068] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:14 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:15.511504 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-b1f45d49-bc32-4595-89fd-8882c97a9884 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:15.512116 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-b1f45d49-bc32-4595-89fd-8882c97a9884 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:15.518149 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b1f45d49-bc32-4595-89fd-8882c97a9884 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:15.518604 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b1f45d49-bc32-4595-89fd-8882c97a9884 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:15.519408 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b1f45d49-bc32-4595-89fd-8882c97a9884 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:15.519848 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b1f45d49-bc32-4595-89fd-8882c97a9884 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:15.602962 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-b1f45d49-bc32-4595-89fd-8882c97a9884 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:15.610038 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-b1f45d49-bc32-4595-89fd-8882c97a9884 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1652 microversion: 2.1 time: 0.102557 Jul 11 11:43:15.610619 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1038/2069] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:15 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1652 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:15.856041 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [req-f23e8564-bf15-4652-a69c-c43f0e683975 req-2ca9ecf8-b1f7-4e4a-b5c3-3749620797f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a79e2f0-60e3-40b6-aac8-665c0d755ecb", "name": "network-vif-deleted", "tag": "b79b3356-e75e-4e92-8475-6ae3bacc0147"}]} {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:43:15.864482 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [req-f23e8564-bf15-4652-a69c-c43f0e683975 req-2ca9ecf8-b1f7-4e4a-b5c3-3749620797f5 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:15.864999 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [req-f23e8564-bf15-4652-a69c-c43f0e683975 req-2ca9ecf8-b1f7-4e4a-b5c3-3749620797f5 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:15.876548 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.compute.server_external_events [req-f23e8564-bf15-4652-a69c-c43f0e683975 req-2ca9ecf8-b1f7-4e4a-b5c3-3749620797f5 service nova] Creating event network-vif-deleted:b79b3356-e75e-4e92-8475-6ae3bacc0147 for instance 2a79e2f0-60e3-40b6-aac8-665c0d755ecb on hv-cinder-84842 Jul 11 11:43:15.881500 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [req-f23e8564-bf15-4652-a69c-c43f0e683975 req-2ca9ecf8-b1f7-4e4a-b5c3-3749620797f5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029802 Jul 11 11:43:15.882096 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1032/2070] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 11:43:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:43:16.129831 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-2e2417c1-1110-4a37-89fe-ea09eff36bcc tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:16.130441 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-2e2417c1-1110-4a37-89fe-ea09eff36bcc tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:16.137243 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2e2417c1-1110-4a37-89fe-ea09eff36bcc tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:16.137689 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2e2417c1-1110-4a37-89fe-ea09eff36bcc tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:16.138447 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2e2417c1-1110-4a37-89fe-ea09eff36bcc tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:16.138881 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2e2417c1-1110-4a37-89fe-ea09eff36bcc tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:16.270311 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-2e2417c1-1110-4a37-89fe-ea09eff36bcc tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:16.278229 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-2e2417c1-1110-4a37-89fe-ea09eff36bcc tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.152290 Jul 11 11:43:16.278800 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1039/2071] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:16 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:16.628146 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-8a3f7437-97e0-4d93-8699-d492e2b6704d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:16.628934 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-8a3f7437-97e0-4d93-8699-d492e2b6704d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:16.635274 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8a3f7437-97e0-4d93-8699-d492e2b6704d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:16.635794 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8a3f7437-97e0-4d93-8699-d492e2b6704d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:16.636626 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8a3f7437-97e0-4d93-8699-d492e2b6704d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:16.637135 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8a3f7437-97e0-4d93-8699-d492e2b6704d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:16.700759 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-8a3f7437-97e0-4d93-8699-d492e2b6704d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:16.708655 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-8a3f7437-97e0-4d93-8699-d492e2b6704d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.084686 Jul 11 11:43:16.709225 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1033/2072] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:16 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:17.294752 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-84cd5955-5d7d-4129-ad2b-c8bbcd87bb1f tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:17.295386 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-84cd5955-5d7d-4129-ad2b-c8bbcd87bb1f tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:17.302053 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-84cd5955-5d7d-4129-ad2b-c8bbcd87bb1f tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:17.302526 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-84cd5955-5d7d-4129-ad2b-c8bbcd87bb1f tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:17.303273 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-84cd5955-5d7d-4129-ad2b-c8bbcd87bb1f tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:17.303741 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-84cd5955-5d7d-4129-ad2b-c8bbcd87bb1f tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:17.430923 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-84cd5955-5d7d-4129-ad2b-c8bbcd87bb1f tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:17.438694 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-84cd5955-5d7d-4129-ad2b-c8bbcd87bb1f tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.147806 Jul 11 11:43:17.439285 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1040/2073] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:17 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:17.726398 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-073e97fa-3260-49a0-8350-c94d22710f6a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:17.727062 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-073e97fa-3260-49a0-8350-c94d22710f6a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:17.733596 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-073e97fa-3260-49a0-8350-c94d22710f6a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:17.734057 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-073e97fa-3260-49a0-8350-c94d22710f6a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:17.734820 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-073e97fa-3260-49a0-8350-c94d22710f6a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:17.735271 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-073e97fa-3260-49a0-8350-c94d22710f6a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:17.800598 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-073e97fa-3260-49a0-8350-c94d22710f6a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:17.802885 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:43:17.809144 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-073e97fa-3260-49a0-8350-c94d22710f6a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.087266 Jul 11 11:43:17.809711 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1034/2074] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:17 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:18.455632 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-3230c036-5f8c-4364-affa-1813b7f34d1b tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:18.456237 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-3230c036-5f8c-4364-affa-1813b7f34d1b tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:18.463140 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3230c036-5f8c-4364-affa-1813b7f34d1b tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:18.463606 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3230c036-5f8c-4364-affa-1813b7f34d1b tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:18.464351 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3230c036-5f8c-4364-affa-1813b7f34d1b tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:18.464775 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3230c036-5f8c-4364-affa-1813b7f34d1b tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:18.593597 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-3230c036-5f8c-4364-affa-1813b7f34d1b tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:18.595744 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=100 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:43:18.602678 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-3230c036-5f8c-4364-affa-1813b7f34d1b tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.150909 Jul 11 11:43:18.610102 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1041/2075] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:18 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:18.825570 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-24941497-f1fc-4a2e-ae68-5a2579c66d7e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:18.826085 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-24941497-f1fc-4a2e-ae68-5a2579c66d7e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:18.833346 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-24941497-f1fc-4a2e-ae68-5a2579c66d7e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:18.833794 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-24941497-f1fc-4a2e-ae68-5a2579c66d7e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:18.834547 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-24941497-f1fc-4a2e-ae68-5a2579c66d7e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:18.834976 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-24941497-f1fc-4a2e-ae68-5a2579c66d7e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:18.895892 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-24941497-f1fc-4a2e-ae68-5a2579c66d7e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:18.903807 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-24941497-f1fc-4a2e-ae68-5a2579c66d7e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.082392 Jul 11 11:43:18.904359 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1035/2076] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:18 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:19.619907 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-bc9b6ab7-0cc2-4f1a-9461-8f04354f5536 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:19.620518 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-bc9b6ab7-0cc2-4f1a-9461-8f04354f5536 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:19.627979 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bc9b6ab7-0cc2-4f1a-9461-8f04354f5536 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:19.628426 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bc9b6ab7-0cc2-4f1a-9461-8f04354f5536 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:19.629171 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bc9b6ab7-0cc2-4f1a-9461-8f04354f5536 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:19.629599 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bc9b6ab7-0cc2-4f1a-9461-8f04354f5536 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:19.763522 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-bc9b6ab7-0cc2-4f1a-9461-8f04354f5536 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:19.771286 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-bc9b6ab7-0cc2-4f1a-9461-8f04354f5536 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.155265 Jul 11 11:43:19.771858 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1042/2077] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:19 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:19.920539 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-fbbcbb8d-fccc-4bbe-bb76-3a39c4e6a753 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:19.921196 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-fbbcbb8d-fccc-4bbe-bb76-3a39c4e6a753 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:19.923428 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:43:19.928161 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fbbcbb8d-fccc-4bbe-bb76-3a39c4e6a753 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:19.928613 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fbbcbb8d-fccc-4bbe-bb76-3a39c4e6a753 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:19.929383 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fbbcbb8d-fccc-4bbe-bb76-3a39c4e6a753 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:19.929842 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fbbcbb8d-fccc-4bbe-bb76-3a39c4e6a753 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:19.992811 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-fbbcbb8d-fccc-4bbe-bb76-3a39c4e6a753 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:20.000655 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-fbbcbb8d-fccc-4bbe-bb76-3a39c4e6a753 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.083976 Jul 11 11:43:20.001225 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1036/2078] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:19 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:20.789029 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-fadbc7e1-57f6-461e-8eff-9249c3465940 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:20.789684 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-fadbc7e1-57f6-461e-8eff-9249c3465940 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:20.791941 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_api:SELECT=36 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:43:20.796665 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fadbc7e1-57f6-461e-8eff-9249c3465940 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:20.797114 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fadbc7e1-57f6-461e-8eff-9249c3465940 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:20.802685 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fadbc7e1-57f6-461e-8eff-9249c3465940 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:20.802685 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fadbc7e1-57f6-461e-8eff-9249c3465940 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:20.923342 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-fadbc7e1-57f6-461e-8eff-9249c3465940 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:20.931618 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-fadbc7e1-57f6-461e-8eff-9249c3465940 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.147014 Jul 11 11:43:20.932195 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1043/2079] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:20 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:21.017765 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-485bbe9d-d494-4759-8340-8308305be117 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:21.018373 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-485bbe9d-d494-4759-8340-8308305be117 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:21.025439 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-485bbe9d-d494-4759-8340-8308305be117 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:21.025882 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-485bbe9d-d494-4759-8340-8308305be117 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:21.026668 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-485bbe9d-d494-4759-8340-8308305be117 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:21.027099 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-485bbe9d-d494-4759-8340-8308305be117 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:21.087905 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-485bbe9d-d494-4759-8340-8308305be117 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:21.095898 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-485bbe9d-d494-4759-8340-8308305be117 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.082314 Jul 11 11:43:21.096466 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1037/2080] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:21 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:21.656992 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-bca30a21-e07b-4ff1-8057-3e717db3e614 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:21.660540 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-bca30a21-e07b-4ff1-8057-3e717db3e614 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:21.663843 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bca30a21-e07b-4ff1-8057-3e717db3e614 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:21.664409 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bca30a21-e07b-4ff1-8057-3e717db3e614 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:21.665329 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bca30a21-e07b-4ff1-8057-3e717db3e614 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:21.665938 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bca30a21-e07b-4ff1-8057-3e717db3e614 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:21.691086 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-bca30a21-e07b-4ff1-8057-3e717db3e614 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Going to try to terminate instance {{(pid=118321) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 11:43:21.949125 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-1d61a480-79d5-4c5a-a5de-2ba1d81ab2a1 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:21.949753 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-1d61a480-79d5-4c5a-a5de-2ba1d81ab2a1 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:21.955944 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1d61a480-79d5-4c5a-a5de-2ba1d81ab2a1 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:21.956421 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1d61a480-79d5-4c5a-a5de-2ba1d81ab2a1 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:21.957266 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1d61a480-79d5-4c5a-a5de-2ba1d81ab2a1 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:21.957701 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1d61a480-79d5-4c5a-a5de-2ba1d81ab2a1 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:21.965504 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-bca30a21-e07b-4ff1-8057-3e717db3e614 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 204 len: 0 microversion: 2.1 time: 0.312114 Jul 11 11:43:21.966381 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1044/2081] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 11 11:43:21 2022] DELETE /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 11 11:43:21.974717 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-be4ac209-8fce-45c3-93e1-0f394f7251df tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:21.975979 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-be4ac209-8fce-45c3-93e1-0f394f7251df tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:21.981892 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-be4ac209-8fce-45c3-93e1-0f394f7251df tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:21.982338 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-be4ac209-8fce-45c3-93e1-0f394f7251df tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:21.983146 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-be4ac209-8fce-45c3-93e1-0f394f7251df tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:21.983613 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-be4ac209-8fce-45c3-93e1-0f394f7251df tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:22.114975 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-1d61a480-79d5-4c5a-a5de-2ba1d81ab2a1 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:22.124860 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-1d61a480-79d5-4c5a-a5de-2ba1d81ab2a1 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.179850 Jul 11 11:43:22.125439 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1038/2082] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:21 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:43:22.129906 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-707a54c1-ff9d-4258-b31c-e6243bbb7584 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:22.130612 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-707a54c1-ff9d-4258-b31c-e6243bbb7584 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:22.137808 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-707a54c1-ff9d-4258-b31c-e6243bbb7584 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:22.138534 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-707a54c1-ff9d-4258-b31c-e6243bbb7584 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:22.139980 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-707a54c1-ff9d-4258-b31c-e6243bbb7584 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:22.140721 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-707a54c1-ff9d-4258-b31c-e6243bbb7584 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:22.151342 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-be4ac209-8fce-45c3-93e1-0f394f7251df tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:22.159670 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-be4ac209-8fce-45c3-93e1-0f394f7251df tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.188968 Jul 11 11:43:22.164825 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1045/2083] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:21 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:43:22.207275 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-707a54c1-ff9d-4258-b31c-e6243bbb7584 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:22.217388 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-707a54c1-ff9d-4258-b31c-e6243bbb7584 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.090921 Jul 11 11:43:22.217972 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1039/2084] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:22 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:23.055430 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [req-b9e3d381-331c-4f3d-8bae-b62fcf96dfce req-a0132b3e-1085-4618-b812-55ae103779cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6", "name": "network-vif-deleted", "tag": "21e04d85-904d-403f-aac1-fe7bfdc5fbb9"}]} {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:43:23.064013 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [req-b9e3d381-331c-4f3d-8bae-b62fcf96dfce req-a0132b3e-1085-4618-b812-55ae103779cb service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:23.070024 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [req-b9e3d381-331c-4f3d-8bae-b62fcf96dfce req-a0132b3e-1085-4618-b812-55ae103779cb service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:23.076051 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.compute.server_external_events [req-b9e3d381-331c-4f3d-8bae-b62fcf96dfce req-a0132b3e-1085-4618-b812-55ae103779cb service nova] Creating event network-vif-deleted:21e04d85-904d-403f-aac1-fe7bfdc5fbb9 for instance 8ec9e9a0-a76f-4c6d-87c4-8bee9d5f73c6 on hv-cinder-84842 Jul 11 11:43:23.080768 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [req-b9e3d381-331c-4f3d-8bae-b62fcf96dfce req-a0132b3e-1085-4618-b812-55ae103779cb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029700 Jul 11 11:43:23.081369 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1046/2085] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 11:43:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:43:23.147182 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-a0d14610-ecfc-4b87-a1bf-8e8d68d4b1c0 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:23.147803 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-a0d14610-ecfc-4b87-a1bf-8e8d68d4b1c0 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:23.154292 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a0d14610-ecfc-4b87-a1bf-8e8d68d4b1c0 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:23.161065 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a0d14610-ecfc-4b87-a1bf-8e8d68d4b1c0 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:23.161065 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a0d14610-ecfc-4b87-a1bf-8e8d68d4b1c0 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:23.161065 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a0d14610-ecfc-4b87-a1bf-8e8d68d4b1c0 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:23.182910 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-efd839e1-8ba9-4055-9a66-94eba93c3519 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:23.184066 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-efd839e1-8ba9-4055-9a66-94eba93c3519 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:23.190617 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-efd839e1-8ba9-4055-9a66-94eba93c3519 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:23.191069 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-efd839e1-8ba9-4055-9a66-94eba93c3519 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:23.191956 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-efd839e1-8ba9-4055-9a66-94eba93c3519 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:23.192392 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-efd839e1-8ba9-4055-9a66-94eba93c3519 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:23.294336 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-a0d14610-ecfc-4b87-a1bf-8e8d68d4b1c0 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:23.302228 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-a0d14610-ecfc-4b87-a1bf-8e8d68d4b1c0 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.161615 Jul 11 11:43:23.303181 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1040/2086] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:23 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:23.307783 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-1153ba5d-4cc8-4365-bdbf-54a6e06d72be tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:23.308464 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-1153ba5d-4cc8-4365-bdbf-54a6e06d72be tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:23.314741 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1153ba5d-4cc8-4365-bdbf-54a6e06d72be tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:23.315189 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1153ba5d-4cc8-4365-bdbf-54a6e06d72be tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:23.315996 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1153ba5d-4cc8-4365-bdbf-54a6e06d72be tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:23.316607 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1153ba5d-4cc8-4365-bdbf-54a6e06d72be tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:23.336534 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-efd839e1-8ba9-4055-9a66-94eba93c3519 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:23.347815 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-efd839e1-8ba9-4055-9a66-94eba93c3519 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.169468 Jul 11 11:43:23.348397 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1047/2087] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:23 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:43:23.384473 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-1153ba5d-4cc8-4365-bdbf-54a6e06d72be tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:23.392706 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-1153ba5d-4cc8-4365-bdbf-54a6e06d72be tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.088311 Jul 11 11:43:23.393295 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1041/2088] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:23 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:24.319489 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-caf06007-56a9-43d8-bef5-96b46db034ec tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:24.320107 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-caf06007-56a9-43d8-bef5-96b46db034ec tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:24.326929 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-caf06007-56a9-43d8-bef5-96b46db034ec tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:24.327328 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-caf06007-56a9-43d8-bef5-96b46db034ec tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:24.328080 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-caf06007-56a9-43d8-bef5-96b46db034ec tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:24.328512 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-caf06007-56a9-43d8-bef5-96b46db034ec tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:24.364910 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-0c7f62af-44b8-4625-949a-3b92ebb43611 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:24.372207 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-0c7f62af-44b8-4625-949a-3b92ebb43611 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:24.372374 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0c7f62af-44b8-4625-949a-3b92ebb43611 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:24.372904 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0c7f62af-44b8-4625-949a-3b92ebb43611 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:24.373675 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0c7f62af-44b8-4625-949a-3b92ebb43611 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:24.374114 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0c7f62af-44b8-4625-949a-3b92ebb43611 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:24.455180 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-caf06007-56a9-43d8-bef5-96b46db034ec tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:24.463664 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-caf06007-56a9-43d8-bef5-96b46db034ec tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.147974 Jul 11 11:43:24.464251 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1048/2089] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:24 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:24.468665 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-da6d38ca-5bd2-4415-8e8d-cb3a4d7f9bbb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:24.469449 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-da6d38ca-5bd2-4415-8e8d-cb3a4d7f9bbb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:24.475154 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-da6d38ca-5bd2-4415-8e8d-cb3a4d7f9bbb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:24.476175 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-da6d38ca-5bd2-4415-8e8d-cb3a4d7f9bbb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:24.476941 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-da6d38ca-5bd2-4415-8e8d-cb3a4d7f9bbb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:24.477376 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-da6d38ca-5bd2-4415-8e8d-cb3a4d7f9bbb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:24.503549 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-0c7f62af-44b8-4625-949a-3b92ebb43611 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:24.512335 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-0c7f62af-44b8-4625-949a-3b92ebb43611 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.151052 Jul 11 11:43:24.512909 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1042/2090] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:24 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:43:24.541648 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-da6d38ca-5bd2-4415-8e8d-cb3a4d7f9bbb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:24.549491 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-da6d38ca-5bd2-4415-8e8d-cb3a4d7f9bbb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.084317 Jul 11 11:43:24.550056 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1049/2091] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:24 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:25.480580 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-199d207e-efa9-45f9-a50b-cfeb08be94a8 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:25.481221 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-199d207e-efa9-45f9-a50b-cfeb08be94a8 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:25.487658 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-199d207e-efa9-45f9-a50b-cfeb08be94a8 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:25.488111 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-199d207e-efa9-45f9-a50b-cfeb08be94a8 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:25.488881 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-199d207e-efa9-45f9-a50b-cfeb08be94a8 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:25.489323 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-199d207e-efa9-45f9-a50b-cfeb08be94a8 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:25.529419 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-3ab2f812-90bd-4787-9e65-63706e440a3a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:25.530155 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-3ab2f812-90bd-4787-9e65-63706e440a3a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:25.536842 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3ab2f812-90bd-4787-9e65-63706e440a3a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:25.537284 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3ab2f812-90bd-4787-9e65-63706e440a3a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:25.538039 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3ab2f812-90bd-4787-9e65-63706e440a3a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:25.538465 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3ab2f812-90bd-4787-9e65-63706e440a3a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:25.623285 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-199d207e-efa9-45f9-a50b-cfeb08be94a8 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:25.631318 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-199d207e-efa9-45f9-a50b-cfeb08be94a8 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.154552 Jul 11 11:43:25.632498 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1043/2092] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:25 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:25.637060 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-256fd6e7-b270-4b6e-911b-154ab390c916 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:25.637860 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-256fd6e7-b270-4b6e-911b-154ab390c916 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:25.643772 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-256fd6e7-b270-4b6e-911b-154ab390c916 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:25.644217 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-256fd6e7-b270-4b6e-911b-154ab390c916 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:25.644980 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-256fd6e7-b270-4b6e-911b-154ab390c916 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:25.645417 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-256fd6e7-b270-4b6e-911b-154ab390c916 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:25.669378 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-3ab2f812-90bd-4787-9e65-63706e440a3a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:25.677378 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-3ab2f812-90bd-4787-9e65-63706e440a3a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.151780 Jul 11 11:43:25.677951 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1050/2093] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:25 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:43:25.706551 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-256fd6e7-b270-4b6e-911b-154ab390c916 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:25.714928 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-256fd6e7-b270-4b6e-911b-154ab390c916 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.081434 Jul 11 11:43:25.715520 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1044/2094] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:25 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:26.648882 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-c9b88e47-e8a7-4076-80cd-99b8975fd026 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:26.649490 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-c9b88e47-e8a7-4076-80cd-99b8975fd026 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:26.655971 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c9b88e47-e8a7-4076-80cd-99b8975fd026 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:26.656439 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c9b88e47-e8a7-4076-80cd-99b8975fd026 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:26.657197 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c9b88e47-e8a7-4076-80cd-99b8975fd026 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:26.657629 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c9b88e47-e8a7-4076-80cd-99b8975fd026 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:26.693624 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-37b3a1f2-7137-40c8-b0a3-31fc11f12f0d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:26.694844 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-37b3a1f2-7137-40c8-b0a3-31fc11f12f0d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:26.701791 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-37b3a1f2-7137-40c8-b0a3-31fc11f12f0d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:26.702238 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-37b3a1f2-7137-40c8-b0a3-31fc11f12f0d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:26.703004 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-37b3a1f2-7137-40c8-b0a3-31fc11f12f0d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:26.703471 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-37b3a1f2-7137-40c8-b0a3-31fc11f12f0d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:26.789354 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-c9b88e47-e8a7-4076-80cd-99b8975fd026 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:26.797458 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-c9b88e47-e8a7-4076-80cd-99b8975fd026 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.152440 Jul 11 11:43:26.798129 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1051/2095] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:26 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:26.802539 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-ef87beb5-888d-40f7-a40f-2473c3cce558 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:26.803212 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-ef87beb5-888d-40f7-a40f-2473c3cce558 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:26.809535 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ef87beb5-888d-40f7-a40f-2473c3cce558 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:26.809985 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ef87beb5-888d-40f7-a40f-2473c3cce558 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:26.810741 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ef87beb5-888d-40f7-a40f-2473c3cce558 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:26.811174 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ef87beb5-888d-40f7-a40f-2473c3cce558 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:26.834883 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-37b3a1f2-7137-40c8-b0a3-31fc11f12f0d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:26.842769 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-37b3a1f2-7137-40c8-b0a3-31fc11f12f0d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.152954 Jul 11 11:43:26.843578 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1045/2096] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:26 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:43:26.877093 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-ef87beb5-888d-40f7-a40f-2473c3cce558 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:26.885593 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-ef87beb5-888d-40f7-a40f-2473c3cce558 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.086475 Jul 11 11:43:26.886153 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1052/2097] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:26 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:27.815003 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-e20895cd-09e8-4582-b73e-1f4799c258f1 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:27.815629 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-e20895cd-09e8-4582-b73e-1f4799c258f1 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:27.822975 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e20895cd-09e8-4582-b73e-1f4799c258f1 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:27.823460 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e20895cd-09e8-4582-b73e-1f4799c258f1 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:27.824224 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e20895cd-09e8-4582-b73e-1f4799c258f1 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:27.824664 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e20895cd-09e8-4582-b73e-1f4799c258f1 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:27.860138 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-84c7662a-79eb-4968-a866-a0cf7db227df tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:27.860759 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-84c7662a-79eb-4968-a866-a0cf7db227df tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:27.867462 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-84c7662a-79eb-4968-a866-a0cf7db227df tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:27.867916 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-84c7662a-79eb-4968-a866-a0cf7db227df tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:27.868980 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-84c7662a-79eb-4968-a866-a0cf7db227df tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:27.869415 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-84c7662a-79eb-4968-a866-a0cf7db227df tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:27.955498 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-e20895cd-09e8-4582-b73e-1f4799c258f1 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:27.964057 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-e20895cd-09e8-4582-b73e-1f4799c258f1 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.152904 Jul 11 11:43:27.964849 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1046/2098] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:27 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:27.969306 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-f03cbbac-cad7-4e07-b06b-56e9d9b8e621 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:27.969778 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-f03cbbac-cad7-4e07-b06b-56e9d9b8e621 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:27.976076 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f03cbbac-cad7-4e07-b06b-56e9d9b8e621 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:27.976527 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f03cbbac-cad7-4e07-b06b-56e9d9b8e621 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:27.977293 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f03cbbac-cad7-4e07-b06b-56e9d9b8e621 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:27.977733 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f03cbbac-cad7-4e07-b06b-56e9d9b8e621 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:27.999957 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-84c7662a-79eb-4968-a866-a0cf7db227df tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:28.008256 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-84c7662a-79eb-4968-a866-a0cf7db227df tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.152022 Jul 11 11:43:28.008835 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1053/2099] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:27 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:43:28.038607 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-f03cbbac-cad7-4e07-b06b-56e9d9b8e621 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:28.046867 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-f03cbbac-cad7-4e07-b06b-56e9d9b8e621 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.081198 Jul 11 11:43:28.047474 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1047/2100] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:27 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:28.980537 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-931fb8a0-57e0-4b79-9b3b-e515ab6c8c86 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:28.981171 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-931fb8a0-57e0-4b79-9b3b-e515ab6c8c86 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:28.987614 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-931fb8a0-57e0-4b79-9b3b-e515ab6c8c86 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:28.988057 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-931fb8a0-57e0-4b79-9b3b-e515ab6c8c86 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:28.988802 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-931fb8a0-57e0-4b79-9b3b-e515ab6c8c86 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:28.989275 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-931fb8a0-57e0-4b79-9b3b-e515ab6c8c86 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:29.025937 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-4d6939e3-9962-4daf-aa45-0f74390d042a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:29.026625 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-4d6939e3-9962-4daf-aa45-0f74390d042a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:29.033551 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4d6939e3-9962-4daf-aa45-0f74390d042a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:29.033996 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4d6939e3-9962-4daf-aa45-0f74390d042a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:29.034788 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4d6939e3-9962-4daf-aa45-0f74390d042a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:29.035218 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4d6939e3-9962-4daf-aa45-0f74390d042a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:29.119410 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-931fb8a0-57e0-4b79-9b3b-e515ab6c8c86 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:29.127354 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-931fb8a0-57e0-4b79-9b3b-e515ab6c8c86 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.150670 Jul 11 11:43:29.128198 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1054/2101] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:28 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:29.132560 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-37469d1c-5bc2-4ddc-8571-733bdc415632 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:29.133159 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-37469d1c-5bc2-4ddc-8571-733bdc415632 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:29.138814 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-37469d1c-5bc2-4ddc-8571-733bdc415632 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:29.139273 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-37469d1c-5bc2-4ddc-8571-733bdc415632 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:29.140042 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-37469d1c-5bc2-4ddc-8571-733bdc415632 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:29.140472 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-37469d1c-5bc2-4ddc-8571-733bdc415632 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:29.166562 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-4d6939e3-9962-4daf-aa45-0f74390d042a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:29.174566 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-4d6939e3-9962-4daf-aa45-0f74390d042a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.152932 Jul 11 11:43:29.175135 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1048/2102] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:29 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:43:29.204540 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-37469d1c-5bc2-4ddc-8571-733bdc415632 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:29.212324 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-37469d1c-5bc2-4ddc-8571-733bdc415632 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.083213 Jul 11 11:43:29.212884 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1055/2103] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:29 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:30.144641 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-4913b781-3e36-4d8b-9429-871f8ca6e635 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:30.145254 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-4913b781-3e36-4d8b-9429-871f8ca6e635 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:30.152383 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4913b781-3e36-4d8b-9429-871f8ca6e635 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:30.152830 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4913b781-3e36-4d8b-9429-871f8ca6e635 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:30.153584 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4913b781-3e36-4d8b-9429-871f8ca6e635 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:30.154016 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4913b781-3e36-4d8b-9429-871f8ca6e635 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:30.191885 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-91221419-34e6-40d2-a6b1-098259386d73 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:30.192499 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-91221419-34e6-40d2-a6b1-098259386d73 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:30.199284 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-91221419-34e6-40d2-a6b1-098259386d73 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:30.199742 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-91221419-34e6-40d2-a6b1-098259386d73 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:30.200512 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-91221419-34e6-40d2-a6b1-098259386d73 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:30.200950 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-91221419-34e6-40d2-a6b1-098259386d73 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:30.288284 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-4913b781-3e36-4d8b-9429-871f8ca6e635 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:30.296253 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-4913b781-3e36-4d8b-9429-871f8ca6e635 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.155467 Jul 11 11:43:30.296830 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1049/2104] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:30 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:30.302402 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-1aca8b6c-edc3-4853-aa20-706c796468c6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:30.303008 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-1aca8b6c-edc3-4853-aa20-706c796468c6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:30.309818 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1aca8b6c-edc3-4853-aa20-706c796468c6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:30.310288 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1aca8b6c-edc3-4853-aa20-706c796468c6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:30.311051 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1aca8b6c-edc3-4853-aa20-706c796468c6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:30.311600 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1aca8b6c-edc3-4853-aa20-706c796468c6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:30.332097 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-91221419-34e6-40d2-a6b1-098259386d73 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:30.340041 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-91221419-34e6-40d2-a6b1-098259386d73 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.151948 Jul 11 11:43:30.340622 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1056/2105] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:30 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:43:30.375179 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-1aca8b6c-edc3-4853-aa20-706c796468c6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:30.383384 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-1aca8b6c-edc3-4853-aa20-706c796468c6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.085597 Jul 11 11:43:30.383949 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1050/2106] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:30 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:31.314037 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-63a6db07-d18f-480e-aa62-885e724743bd tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:31.314676 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-63a6db07-d18f-480e-aa62-885e724743bd tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:31.321160 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-63a6db07-d18f-480e-aa62-885e724743bd tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:31.321607 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-63a6db07-d18f-480e-aa62-885e724743bd tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:31.322623 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-63a6db07-d18f-480e-aa62-885e724743bd tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:31.323055 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-63a6db07-d18f-480e-aa62-885e724743bd tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:31.337901 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:43:31.357967 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-826e9521-5993-43b5-97f9-c89086be336b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:31.358575 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-826e9521-5993-43b5-97f9-c89086be336b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:31.365153 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-826e9521-5993-43b5-97f9-c89086be336b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:31.365608 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-826e9521-5993-43b5-97f9-c89086be336b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:31.366375 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-826e9521-5993-43b5-97f9-c89086be336b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:31.368478 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-826e9521-5993-43b5-97f9-c89086be336b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:31.385655 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=100 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:43:31.453359 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-63a6db07-d18f-480e-aa62-885e724743bd tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:31.461632 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-63a6db07-d18f-480e-aa62-885e724743bd tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.151405 Jul 11 11:43:31.462218 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1057/2107] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:31 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:31.466689 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-4f1e0c99-bf41-431f-ba96-037569e170a1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:31.467316 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-4f1e0c99-bf41-431f-ba96-037569e170a1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:31.473162 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4f1e0c99-bf41-431f-ba96-037569e170a1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:31.473609 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4f1e0c99-bf41-431f-ba96-037569e170a1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:31.474372 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4f1e0c99-bf41-431f-ba96-037569e170a1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:31.474810 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4f1e0c99-bf41-431f-ba96-037569e170a1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:31.501325 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-826e9521-5993-43b5-97f9-c89086be336b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:31.509262 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-826e9521-5993-43b5-97f9-c89086be336b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.154999 Jul 11 11:43:31.509840 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1051/2108] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:31 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:43:31.540566 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-4f1e0c99-bf41-431f-ba96-037569e170a1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:31.548490 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-4f1e0c99-bf41-431f-ba96-037569e170a1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.085344 Jul 11 11:43:31.549065 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1058/2109] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:31 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:32.478400 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-d70364a5-f3a1-4108-9f10-b368900e6821 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:32.479014 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-d70364a5-f3a1-4108-9f10-b368900e6821 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:32.485521 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d70364a5-f3a1-4108-9f10-b368900e6821 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:32.485972 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d70364a5-f3a1-4108-9f10-b368900e6821 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:32.486729 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d70364a5-f3a1-4108-9f10-b368900e6821 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:32.487165 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d70364a5-f3a1-4108-9f10-b368900e6821 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:32.526990 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-c2fcf26b-d24f-41de-832a-f6e464c683e7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:32.527651 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-c2fcf26b-d24f-41de-832a-f6e464c683e7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:32.534143 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c2fcf26b-d24f-41de-832a-f6e464c683e7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:32.534584 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c2fcf26b-d24f-41de-832a-f6e464c683e7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:32.535373 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c2fcf26b-d24f-41de-832a-f6e464c683e7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:32.535807 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c2fcf26b-d24f-41de-832a-f6e464c683e7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:32.620166 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-d70364a5-f3a1-4108-9f10-b368900e6821 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:32.628180 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-d70364a5-f3a1-4108-9f10-b368900e6821 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.153653 Jul 11 11:43:32.628752 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1052/2110] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:32 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:32.633732 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-fc568c91-cc29-44e5-a376-ed1afc323106 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:32.634323 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-fc568c91-cc29-44e5-a376-ed1afc323106 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:32.639945 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fc568c91-cc29-44e5-a376-ed1afc323106 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:32.640388 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fc568c91-cc29-44e5-a376-ed1afc323106 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:32.641143 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fc568c91-cc29-44e5-a376-ed1afc323106 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:32.641574 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fc568c91-cc29-44e5-a376-ed1afc323106 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:32.664414 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-c2fcf26b-d24f-41de-832a-f6e464c683e7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:32.672501 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-c2fcf26b-d24f-41de-832a-f6e464c683e7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.150047 Jul 11 11:43:32.673159 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1059/2111] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:32 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:43:32.702672 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-fc568c91-cc29-44e5-a376-ed1afc323106 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:32.710561 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-fc568c91-cc29-44e5-a376-ed1afc323106 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.080853 Jul 11 11:43:32.711125 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1053/2112] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:32 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:33.645702 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-21105059-72c8-490c-8e0e-92266c10bc48 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:33.646307 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-21105059-72c8-490c-8e0e-92266c10bc48 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:33.652799 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-21105059-72c8-490c-8e0e-92266c10bc48 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:33.653242 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-21105059-72c8-490c-8e0e-92266c10bc48 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:33.653991 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-21105059-72c8-490c-8e0e-92266c10bc48 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:33.654419 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-21105059-72c8-490c-8e0e-92266c10bc48 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:33.690146 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-3947e8f5-0483-4740-99d8-65dfa7852179 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:33.690762 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-3947e8f5-0483-4740-99d8-65dfa7852179 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:33.698246 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3947e8f5-0483-4740-99d8-65dfa7852179 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:33.698691 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3947e8f5-0483-4740-99d8-65dfa7852179 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:33.699479 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3947e8f5-0483-4740-99d8-65dfa7852179 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:33.699917 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3947e8f5-0483-4740-99d8-65dfa7852179 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:33.781426 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-21105059-72c8-490c-8e0e-92266c10bc48 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:33.790289 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-21105059-72c8-490c-8e0e-92266c10bc48 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.148383 Jul 11 11:43:33.790901 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1060/2113] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:33 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:33.795867 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-199cdce9-43b8-4e67-adad-15b42e4dff6a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:33.796582 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-199cdce9-43b8-4e67-adad-15b42e4dff6a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:33.802245 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-199cdce9-43b8-4e67-adad-15b42e4dff6a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:33.802688 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-199cdce9-43b8-4e67-adad-15b42e4dff6a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:33.803545 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-199cdce9-43b8-4e67-adad-15b42e4dff6a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:33.804007 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-199cdce9-43b8-4e67-adad-15b42e4dff6a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:33.834692 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-3947e8f5-0483-4740-99d8-65dfa7852179 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:33.842749 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-3947e8f5-0483-4740-99d8-65dfa7852179 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.156395 Jul 11 11:43:33.843338 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1054/2114] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:33 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:43:33.868883 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-199cdce9-43b8-4e67-adad-15b42e4dff6a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:33.876669 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-199cdce9-43b8-4e67-adad-15b42e4dff6a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.084795 Jul 11 11:43:33.877228 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1061/2115] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:33 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:34.808369 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-a45a1183-e408-4afa-b6e0-7784592de61c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:34.808980 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-a45a1183-e408-4afa-b6e0-7784592de61c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:34.815434 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a45a1183-e408-4afa-b6e0-7784592de61c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:34.815875 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a45a1183-e408-4afa-b6e0-7784592de61c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:34.816621 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a45a1183-e408-4afa-b6e0-7784592de61c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:34.817055 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a45a1183-e408-4afa-b6e0-7784592de61c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:34.859656 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-afb39b24-e172-4cc0-8815-ad870dd4177b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:34.860296 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-afb39b24-e172-4cc0-8815-ad870dd4177b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:34.867178 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-afb39b24-e172-4cc0-8815-ad870dd4177b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:34.867650 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-afb39b24-e172-4cc0-8815-ad870dd4177b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:34.868404 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-afb39b24-e172-4cc0-8815-ad870dd4177b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:34.868826 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-afb39b24-e172-4cc0-8815-ad870dd4177b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:34.944975 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-a45a1183-e408-4afa-b6e0-7784592de61c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:34.953248 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-a45a1183-e408-4afa-b6e0-7784592de61c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.149282 Jul 11 11:43:34.953816 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1055/2116] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:34 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:34.958211 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-845b37b0-78d1-4576-a81b-980f2b584617 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:34.958807 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-845b37b0-78d1-4576-a81b-980f2b584617 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:34.965106 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-845b37b0-78d1-4576-a81b-980f2b584617 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:34.965561 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-845b37b0-78d1-4576-a81b-980f2b584617 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:34.966318 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-845b37b0-78d1-4576-a81b-980f2b584617 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:34.966750 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-845b37b0-78d1-4576-a81b-980f2b584617 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:34.997341 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-afb39b24-e172-4cc0-8815-ad870dd4177b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:35.005724 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-afb39b24-e172-4cc0-8815-ad870dd4177b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.149811 Jul 11 11:43:35.006304 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1062/2117] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:34 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:43:35.027279 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-845b37b0-78d1-4576-a81b-980f2b584617 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:35.035504 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-845b37b0-78d1-4576-a81b-980f2b584617 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.080666 Jul 11 11:43:35.036353 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1056/2118] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:34 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:35.970694 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-e60bd196-69dc-4a16-8e14-30db5595f8e9 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:35.971331 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-e60bd196-69dc-4a16-8e14-30db5595f8e9 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:35.978425 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e60bd196-69dc-4a16-8e14-30db5595f8e9 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:35.978873 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e60bd196-69dc-4a16-8e14-30db5595f8e9 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:35.979658 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e60bd196-69dc-4a16-8e14-30db5595f8e9 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:35.980091 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e60bd196-69dc-4a16-8e14-30db5595f8e9 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:36.022337 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-d8a36514-5386-4b34-b403-957e8236dd2a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:36.023586 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-d8a36514-5386-4b34-b403-957e8236dd2a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:36.030270 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d8a36514-5386-4b34-b403-957e8236dd2a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:36.030726 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d8a36514-5386-4b34-b403-957e8236dd2a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:36.031518 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d8a36514-5386-4b34-b403-957e8236dd2a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:36.031954 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d8a36514-5386-4b34-b403-957e8236dd2a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:36.116026 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-e60bd196-69dc-4a16-8e14-30db5595f8e9 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:36.124238 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-e60bd196-69dc-4a16-8e14-30db5595f8e9 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.157308 Jul 11 11:43:36.125047 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1063/2119] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:35 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:36.129303 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-cde557a1-efd9-459a-b65d-cfc09e93a2ad tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:36.129899 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-cde557a1-efd9-459a-b65d-cfc09e93a2ad tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:36.136275 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-cde557a1-efd9-459a-b65d-cfc09e93a2ad tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:36.136716 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-cde557a1-efd9-459a-b65d-cfc09e93a2ad tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:36.137474 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-cde557a1-efd9-459a-b65d-cfc09e93a2ad tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:36.137908 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-cde557a1-efd9-459a-b65d-cfc09e93a2ad tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:36.167407 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-d8a36514-5386-4b34-b403-957e8236dd2a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:36.175680 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-d8a36514-5386-4b34-b403-957e8236dd2a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.157211 Jul 11 11:43:36.176334 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1057/2120] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:36 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:43:36.202644 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-cde557a1-efd9-459a-b65d-cfc09e93a2ad tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:36.211474 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-cde557a1-efd9-459a-b65d-cfc09e93a2ad tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.085648 Jul 11 11:43:36.212051 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1064/2121] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:36 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:37.141560 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-c09c333b-385f-4a06-be21-5683ed55afab tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:37.142170 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-c09c333b-385f-4a06-be21-5683ed55afab tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:37.149228 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c09c333b-385f-4a06-be21-5683ed55afab tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:37.149670 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c09c333b-385f-4a06-be21-5683ed55afab tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:37.150421 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c09c333b-385f-4a06-be21-5683ed55afab tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:37.150852 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c09c333b-385f-4a06-be21-5683ed55afab tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:37.193122 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-945a7c1d-e076-4acd-9893-c65419f30ad3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:37.193694 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-945a7c1d-e076-4acd-9893-c65419f30ad3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:37.200490 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-945a7c1d-e076-4acd-9893-c65419f30ad3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:37.201036 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-945a7c1d-e076-4acd-9893-c65419f30ad3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:37.201879 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-945a7c1d-e076-4acd-9893-c65419f30ad3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:37.202393 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-945a7c1d-e076-4acd-9893-c65419f30ad3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:37.280815 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-c09c333b-385f-4a06-be21-5683ed55afab tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:37.289607 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-c09c333b-385f-4a06-be21-5683ed55afab tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.151794 Jul 11 11:43:37.290174 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1058/2122] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:37 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:37.294959 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-862d2c88-9eb9-4aae-ae2f-2a77a57d3368 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:37.295586 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-862d2c88-9eb9-4aae-ae2f-2a77a57d3368 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:37.301498 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-862d2c88-9eb9-4aae-ae2f-2a77a57d3368 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:37.301938 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-862d2c88-9eb9-4aae-ae2f-2a77a57d3368 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:37.302689 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-862d2c88-9eb9-4aae-ae2f-2a77a57d3368 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:37.303117 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-862d2c88-9eb9-4aae-ae2f-2a77a57d3368 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:37.338082 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-945a7c1d-e076-4acd-9893-c65419f30ad3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:37.346152 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-945a7c1d-e076-4acd-9893-c65419f30ad3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.157235 Jul 11 11:43:37.346732 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1065/2123] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:37 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:37.364142 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-862d2c88-9eb9-4aae-ae2f-2a77a57d3368 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:37.372187 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-862d2c88-9eb9-4aae-ae2f-2a77a57d3368 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.081096 Jul 11 11:43:37.372743 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1059/2124] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:37 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:38.307010 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-edfada80-a828-4276-ace3-999be548d7ea tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:38.307662 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-edfada80-a828-4276-ace3-999be548d7ea tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:38.314180 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-edfada80-a828-4276-ace3-999be548d7ea tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:38.314615 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-edfada80-a828-4276-ace3-999be548d7ea tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:38.315453 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-edfada80-a828-4276-ace3-999be548d7ea tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:38.315881 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-edfada80-a828-4276-ace3-999be548d7ea tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:38.364199 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-55852f16-ef81-48ba-bb65-dbc63ab02c8f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:38.364747 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-55852f16-ef81-48ba-bb65-dbc63ab02c8f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:38.371444 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-55852f16-ef81-48ba-bb65-dbc63ab02c8f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:38.371889 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-55852f16-ef81-48ba-bb65-dbc63ab02c8f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:38.372656 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-55852f16-ef81-48ba-bb65-dbc63ab02c8f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:38.373089 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-55852f16-ef81-48ba-bb65-dbc63ab02c8f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:38.457820 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-edfada80-a828-4276-ace3-999be548d7ea tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:38.466367 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-edfada80-a828-4276-ace3-999be548d7ea tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.163779 Jul 11 11:43:38.467162 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1066/2125] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:38 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:38.471384 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-bdcb713e-ccba-4dbb-91c9-a65c22cd7feb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:38.472021 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-bdcb713e-ccba-4dbb-91c9-a65c22cd7feb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:38.478325 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bdcb713e-ccba-4dbb-91c9-a65c22cd7feb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:38.478813 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bdcb713e-ccba-4dbb-91c9-a65c22cd7feb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:38.479613 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bdcb713e-ccba-4dbb-91c9-a65c22cd7feb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:38.480050 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bdcb713e-ccba-4dbb-91c9-a65c22cd7feb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:38.508656 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-55852f16-ef81-48ba-bb65-dbc63ab02c8f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:38.516826 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-55852f16-ef81-48ba-bb65-dbc63ab02c8f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.156518 Jul 11 11:43:38.517400 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1060/2126] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:38 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:43:38.543567 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-bdcb713e-ccba-4dbb-91c9-a65c22cd7feb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:38.551490 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-bdcb713e-ccba-4dbb-91c9-a65c22cd7feb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.083547 Jul 11 11:43:38.552062 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1067/2127] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:38 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:39.484011 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-0d605b95-4bcb-4e36-8531-3a806c0b8beb tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:39.484657 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-0d605b95-4bcb-4e36-8531-3a806c0b8beb tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:39.491882 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0d605b95-4bcb-4e36-8531-3a806c0b8beb tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:39.492321 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0d605b95-4bcb-4e36-8531-3a806c0b8beb tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:39.493071 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0d605b95-4bcb-4e36-8531-3a806c0b8beb tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:39.493502 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0d605b95-4bcb-4e36-8531-3a806c0b8beb tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:39.533800 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-c29cd013-a600-4622-8df3-9d330007f289 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:39.534408 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-c29cd013-a600-4622-8df3-9d330007f289 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:39.540861 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c29cd013-a600-4622-8df3-9d330007f289 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:39.541299 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c29cd013-a600-4622-8df3-9d330007f289 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:39.542050 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c29cd013-a600-4622-8df3-9d330007f289 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:39.542769 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c29cd013-a600-4622-8df3-9d330007f289 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:39.623699 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-0d605b95-4bcb-4e36-8531-3a806c0b8beb tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:39.631896 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-0d605b95-4bcb-4e36-8531-3a806c0b8beb tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.151691 Jul 11 11:43:39.632462 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1061/2128] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:39 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:39.637178 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-b85169d2-65a2-4314-aa1d-ab9f0d42a0a7 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:39.637776 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-b85169d2-65a2-4314-aa1d-ab9f0d42a0a7 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:39.645116 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b85169d2-65a2-4314-aa1d-ab9f0d42a0a7 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:39.645558 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b85169d2-65a2-4314-aa1d-ab9f0d42a0a7 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:39.646317 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b85169d2-65a2-4314-aa1d-ab9f0d42a0a7 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:39.646750 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b85169d2-65a2-4314-aa1d-ab9f0d42a0a7 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:39.680788 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-c29cd013-a600-4622-8df3-9d330007f289 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:39.688765 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-c29cd013-a600-4622-8df3-9d330007f289 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.158775 Jul 11 11:43:39.689350 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1068/2129] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:39 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:43:39.708683 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-b85169d2-65a2-4314-aa1d-ab9f0d42a0a7 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:39.717032 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-b85169d2-65a2-4314-aa1d-ab9f0d42a0a7 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.083476 Jul 11 11:43:39.717588 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1062/2130] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:39 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:40.648831 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-331f47fc-7c89-4fc6-a8e3-6c86bb7950be tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:40.649392 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-331f47fc-7c89-4fc6-a8e3-6c86bb7950be tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:40.655908 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-331f47fc-7c89-4fc6-a8e3-6c86bb7950be tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:40.656355 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-331f47fc-7c89-4fc6-a8e3-6c86bb7950be tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:40.657107 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-331f47fc-7c89-4fc6-a8e3-6c86bb7950be tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:40.657551 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-331f47fc-7c89-4fc6-a8e3-6c86bb7950be tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:40.708304 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-8a0f6d16-d2bb-4c6c-a7ef-3465675a3bf9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:40.709817 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-8a0f6d16-d2bb-4c6c-a7ef-3465675a3bf9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:40.716554 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8a0f6d16-d2bb-4c6c-a7ef-3465675a3bf9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:40.717080 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8a0f6d16-d2bb-4c6c-a7ef-3465675a3bf9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:40.717912 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8a0f6d16-d2bb-4c6c-a7ef-3465675a3bf9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:40.718350 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8a0f6d16-d2bb-4c6c-a7ef-3465675a3bf9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:40.790158 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-331f47fc-7c89-4fc6-a8e3-6c86bb7950be tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:40.804701 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-331f47fc-7c89-4fc6-a8e3-6c86bb7950be tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.153634 Jul 11 11:43:40.804701 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1069/2131] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:40 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:40.804701 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-bda06e81-0bf0-431c-91cd-13f1369d9ba8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:40.805004 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-bda06e81-0bf0-431c-91cd-13f1369d9ba8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:40.811022 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bda06e81-0bf0-431c-91cd-13f1369d9ba8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:40.811498 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bda06e81-0bf0-431c-91cd-13f1369d9ba8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:40.812257 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bda06e81-0bf0-431c-91cd-13f1369d9ba8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:40.812698 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bda06e81-0bf0-431c-91cd-13f1369d9ba8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:40.851421 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-8a0f6d16-d2bb-4c6c-a7ef-3465675a3bf9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:40.859540 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-8a0f6d16-d2bb-4c6c-a7ef-3465675a3bf9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.154998 Jul 11 11:43:40.860115 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1063/2132] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:40 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:43:40.877634 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-bda06e81-0bf0-431c-91cd-13f1369d9ba8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:40.885530 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-bda06e81-0bf0-431c-91cd-13f1369d9ba8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.085441 Jul 11 11:43:40.886090 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1070/2133] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:40 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:41.816188 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-06734c66-dd08-4bd0-bc9a-6cb51b76af71 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:41.816793 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-06734c66-dd08-4bd0-bc9a-6cb51b76af71 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:41.824169 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-06734c66-dd08-4bd0-bc9a-6cb51b76af71 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:41.824620 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-06734c66-dd08-4bd0-bc9a-6cb51b76af71 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:41.825380 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-06734c66-dd08-4bd0-bc9a-6cb51b76af71 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:41.825818 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-06734c66-dd08-4bd0-bc9a-6cb51b76af71 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:41.877874 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-f825954e-f43f-44e3-beac-41ec6a840960 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:41.878595 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-f825954e-f43f-44e3-beac-41ec6a840960 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:41.885771 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f825954e-f43f-44e3-beac-41ec6a840960 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:41.886288 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f825954e-f43f-44e3-beac-41ec6a840960 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:41.887107 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f825954e-f43f-44e3-beac-41ec6a840960 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:41.887625 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f825954e-f43f-44e3-beac-41ec6a840960 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:41.956688 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-06734c66-dd08-4bd0-bc9a-6cb51b76af71 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:41.964552 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-06734c66-dd08-4bd0-bc9a-6cb51b76af71 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.152241 Jul 11 11:43:41.965086 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1064/2134] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:41 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:41.970757 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-efb39153-6782-42e9-be76-a8fb13ab33ee tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:41.970757 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-efb39153-6782-42e9-be76-a8fb13ab33ee tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:41.976619 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-efb39153-6782-42e9-be76-a8fb13ab33ee tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:41.977065 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-efb39153-6782-42e9-be76-a8fb13ab33ee tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:41.977828 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-efb39153-6782-42e9-be76-a8fb13ab33ee tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:41.978259 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-efb39153-6782-42e9-be76-a8fb13ab33ee tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:42.017149 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-f825954e-f43f-44e3-beac-41ec6a840960 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:42.025287 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-f825954e-f43f-44e3-beac-41ec6a840960 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.151385 Jul 11 11:43:42.025867 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1071/2135] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:41 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:43:42.039562 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-efb39153-6782-42e9-be76-a8fb13ab33ee tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:42.047587 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-efb39153-6782-42e9-be76-a8fb13ab33ee tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.081519 Jul 11 11:43:42.048213 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1065/2136] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:41 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:42.981579 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-98f4543c-c1ab-4adb-b072-d5465c057a98 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:42.982180 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-98f4543c-c1ab-4adb-b072-d5465c057a98 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:42.988651 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-98f4543c-c1ab-4adb-b072-d5465c057a98 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:42.989094 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-98f4543c-c1ab-4adb-b072-d5465c057a98 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:42.989855 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-98f4543c-c1ab-4adb-b072-d5465c057a98 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:42.990289 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-98f4543c-c1ab-4adb-b072-d5465c057a98 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:43.041921 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-70bf720d-3309-4158-ad42-6506b8ca7755 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:43.042525 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-70bf720d-3309-4158-ad42-6506b8ca7755 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:43.049488 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-70bf720d-3309-4158-ad42-6506b8ca7755 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:43.049967 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-70bf720d-3309-4158-ad42-6506b8ca7755 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:43.050850 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-70bf720d-3309-4158-ad42-6506b8ca7755 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:43.051159 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-70bf720d-3309-4158-ad42-6506b8ca7755 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:43.122311 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-98f4543c-c1ab-4adb-b072-d5465c057a98 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:43.130305 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-98f4543c-c1ab-4adb-b072-d5465c057a98 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.152583 Jul 11 11:43:43.130866 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1072/2137] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:42 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:43.136256 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-8258d098-7e57-4853-995d-3a766f7cce0f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:43.136855 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-8258d098-7e57-4853-995d-3a766f7cce0f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:43.142565 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8258d098-7e57-4853-995d-3a766f7cce0f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:43.143006 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8258d098-7e57-4853-995d-3a766f7cce0f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:43.143788 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8258d098-7e57-4853-995d-3a766f7cce0f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:43.144216 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8258d098-7e57-4853-995d-3a766f7cce0f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:43.186242 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-70bf720d-3309-4158-ad42-6506b8ca7755 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:43.194233 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-70bf720d-3309-4158-ad42-6506b8ca7755 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.156174 Jul 11 11:43:43.195370 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1066/2138] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:43 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:43:43.211025 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-8258d098-7e57-4853-995d-3a766f7cce0f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:43.218967 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-8258d098-7e57-4853-995d-3a766f7cce0f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.086141 Jul 11 11:43:43.219566 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1073/2139] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:43 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:44.147944 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-3d16a91e-1085-40cd-af5f-3e3b8a9f74b3 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:44.148631 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-3d16a91e-1085-40cd-af5f-3e3b8a9f74b3 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:44.155066 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3d16a91e-1085-40cd-af5f-3e3b8a9f74b3 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:44.155559 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3d16a91e-1085-40cd-af5f-3e3b8a9f74b3 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:44.156324 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3d16a91e-1085-40cd-af5f-3e3b8a9f74b3 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:44.156759 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3d16a91e-1085-40cd-af5f-3e3b8a9f74b3 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:44.212464 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-bd1db855-e136-4c0e-b83f-b32366c41ffc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:44.213075 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-bd1db855-e136-4c0e-b83f-b32366c41ffc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:44.219578 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bd1db855-e136-4c0e-b83f-b32366c41ffc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:44.220029 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bd1db855-e136-4c0e-b83f-b32366c41ffc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:44.221232 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bd1db855-e136-4c0e-b83f-b32366c41ffc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:44.221232 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bd1db855-e136-4c0e-b83f-b32366c41ffc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:44.228847 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=100 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:43:44.289456 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-3d16a91e-1085-40cd-af5f-3e3b8a9f74b3 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:44.297702 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-3d16a91e-1085-40cd-af5f-3e3b8a9f74b3 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.153650 Jul 11 11:43:44.298274 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1067/2140] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:44 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:44.302940 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-ff1f8d3c-8546-4e13-aeed-c48e8b62a791 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:44.303664 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-ff1f8d3c-8546-4e13-aeed-c48e8b62a791 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:44.310545 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ff1f8d3c-8546-4e13-aeed-c48e8b62a791 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:44.311003 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ff1f8d3c-8546-4e13-aeed-c48e8b62a791 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:44.311803 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ff1f8d3c-8546-4e13-aeed-c48e8b62a791 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:44.312244 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ff1f8d3c-8546-4e13-aeed-c48e8b62a791 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:44.318257 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=100 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:43:44.352944 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-bd1db855-e136-4c0e-b83f-b32366c41ffc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:44.361018 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-bd1db855-e136-4c0e-b83f-b32366c41ffc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.152356 Jul 11 11:43:44.361597 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1074/2141] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:44 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:43:44.377677 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-ff1f8d3c-8546-4e13-aeed-c48e8b62a791 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:44.386220 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-ff1f8d3c-8546-4e13-aeed-c48e8b62a791 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.087024 Jul 11 11:43:44.387119 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1068/2142] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:44 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:45.314847 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-7d9c6201-c135-4bd9-baef-ecdfec215a69 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:45.315494 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-7d9c6201-c135-4bd9-baef-ecdfec215a69 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:45.321738 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7d9c6201-c135-4bd9-baef-ecdfec215a69 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:45.322445 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7d9c6201-c135-4bd9-baef-ecdfec215a69 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:45.323197 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7d9c6201-c135-4bd9-baef-ecdfec215a69 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:45.323705 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7d9c6201-c135-4bd9-baef-ecdfec215a69 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:45.377939 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-d76cf6bd-3cba-4f6f-88b8-fc34804eb092 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:45.378555 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-d76cf6bd-3cba-4f6f-88b8-fc34804eb092 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:45.385167 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d76cf6bd-3cba-4f6f-88b8-fc34804eb092 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:45.385617 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d76cf6bd-3cba-4f6f-88b8-fc34804eb092 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:45.386378 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d76cf6bd-3cba-4f6f-88b8-fc34804eb092 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:45.386815 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d76cf6bd-3cba-4f6f-88b8-fc34804eb092 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:45.453956 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-7d9c6201-c135-4bd9-baef-ecdfec215a69 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:45.462465 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-7d9c6201-c135-4bd9-baef-ecdfec215a69 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.151448 Jul 11 11:43:45.463045 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1075/2143] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:45 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:45.467758 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-64e67591-ad33-40a5-9af1-e79322472534 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:45.468350 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-64e67591-ad33-40a5-9af1-e79322472534 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:45.474000 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-64e67591-ad33-40a5-9af1-e79322472534 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:45.474446 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-64e67591-ad33-40a5-9af1-e79322472534 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:45.475192 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-64e67591-ad33-40a5-9af1-e79322472534 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:45.476328 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-64e67591-ad33-40a5-9af1-e79322472534 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:45.531730 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-d76cf6bd-3cba-4f6f-88b8-fc34804eb092 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:45.540075 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-d76cf6bd-3cba-4f6f-88b8-fc34804eb092 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.165853 Jul 11 11:43:45.540451 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1069/2144] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:45 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:43:45.542515 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-64e67591-ad33-40a5-9af1-e79322472534 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:45.551749 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-64e67591-ad33-40a5-9af1-e79322472534 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.087732 Jul 11 11:43:45.552311 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1076/2145] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:45 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:46.479897 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-1cd3e79a-2da3-4bd8-8dd1-95a58fc35d26 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:46.480511 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-1cd3e79a-2da3-4bd8-8dd1-95a58fc35d26 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:46.486699 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1cd3e79a-2da3-4bd8-8dd1-95a58fc35d26 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:46.487146 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1cd3e79a-2da3-4bd8-8dd1-95a58fc35d26 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:46.487926 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1cd3e79a-2da3-4bd8-8dd1-95a58fc35d26 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:46.488359 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1cd3e79a-2da3-4bd8-8dd1-95a58fc35d26 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:46.557484 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-995d40cb-219d-4da0-be82-e6663e50209e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:46.558132 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-995d40cb-219d-4da0-be82-e6663e50209e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:46.564356 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-995d40cb-219d-4da0-be82-e6663e50209e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:46.564805 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-995d40cb-219d-4da0-be82-e6663e50209e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:46.565568 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-995d40cb-219d-4da0-be82-e6663e50209e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:46.566003 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-995d40cb-219d-4da0-be82-e6663e50209e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:46.617891 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-1cd3e79a-2da3-4bd8-8dd1-95a58fc35d26 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:46.626132 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-1cd3e79a-2da3-4bd8-8dd1-95a58fc35d26 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.150572 Jul 11 11:43:46.626941 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1070/2146] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:46 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:46.631348 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-8f21df4c-8b00-4311-a8e2-dbcd09628617 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:46.632551 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-8f21df4c-8b00-4311-a8e2-dbcd09628617 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:46.638713 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8f21df4c-8b00-4311-a8e2-dbcd09628617 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:46.639167 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8f21df4c-8b00-4311-a8e2-dbcd09628617 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:46.639978 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8f21df4c-8b00-4311-a8e2-dbcd09628617 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:46.640412 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8f21df4c-8b00-4311-a8e2-dbcd09628617 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:46.716405 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-8f21df4c-8b00-4311-a8e2-dbcd09628617 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:46.724645 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-8f21df4c-8b00-4311-a8e2-dbcd09628617 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.096888 Jul 11 11:43:46.725232 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1071/2147] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:46 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:46.925550 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-995d40cb-219d-4da0-be82-e6663e50209e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:46.933315 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-995d40cb-219d-4da0-be82-e6663e50209e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.379809 Jul 11 11:43:46.933884 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1077/2148] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:46 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:43:47.644286 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-6f53338b-9c71-4c23-97ef-13ac4e22a93d tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:47.644886 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-6f53338b-9c71-4c23-97ef-13ac4e22a93d tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:47.651450 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6f53338b-9c71-4c23-97ef-13ac4e22a93d tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:47.651900 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6f53338b-9c71-4c23-97ef-13ac4e22a93d tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:47.652654 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6f53338b-9c71-4c23-97ef-13ac4e22a93d tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:47.653089 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6f53338b-9c71-4c23-97ef-13ac4e22a93d tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:47.742360 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-c03db874-1deb-4af4-9e2e-a8244b8b735e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:47.742970 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-c03db874-1deb-4af4-9e2e-a8244b8b735e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:47.749359 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c03db874-1deb-4af4-9e2e-a8244b8b735e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:47.758494 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c03db874-1deb-4af4-9e2e-a8244b8b735e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:47.758494 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c03db874-1deb-4af4-9e2e-a8244b8b735e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:47.758494 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c03db874-1deb-4af4-9e2e-a8244b8b735e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:47.787212 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-6f53338b-9c71-4c23-97ef-13ac4e22a93d tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:47.795604 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-6f53338b-9c71-4c23-97ef-13ac4e22a93d tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.155062 Jul 11 11:43:47.796217 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1072/2149] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:47 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:47.817614 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-c03db874-1deb-4af4-9e2e-a8244b8b735e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:47.826356 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-c03db874-1deb-4af4-9e2e-a8244b8b735e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.088503 Jul 11 11:43:47.826924 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1078/2150] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:47 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:43:47.950600 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-d63bad46-a324-43cd-a3e8-63ed6af118ed tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:47.951217 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-d63bad46-a324-43cd-a3e8-63ed6af118ed tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:47.957189 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d63bad46-a324-43cd-a3e8-63ed6af118ed tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:47.957643 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d63bad46-a324-43cd-a3e8-63ed6af118ed tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:47.958397 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d63bad46-a324-43cd-a3e8-63ed6af118ed tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:47.958834 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d63bad46-a324-43cd-a3e8-63ed6af118ed tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:48.088303 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-d63bad46-a324-43cd-a3e8-63ed6af118ed tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:48.096349 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-d63bad46-a324-43cd-a3e8-63ed6af118ed tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.149896 Jul 11 11:43:48.096914 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1073/2151] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:47 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:48.812707 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-6d764dc1-46ff-4077-9848-7b5431238753 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:48.813323 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-6d764dc1-46ff-4077-9848-7b5431238753 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:48.820532 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6d764dc1-46ff-4077-9848-7b5431238753 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:48.820977 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6d764dc1-46ff-4077-9848-7b5431238753 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:48.821733 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6d764dc1-46ff-4077-9848-7b5431238753 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:48.822425 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6d764dc1-46ff-4077-9848-7b5431238753 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:48.843085 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-1384a32d-8fd6-4b54-a0e8-6ab635bdd658 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:48.843801 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-1384a32d-8fd6-4b54-a0e8-6ab635bdd658 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:48.850108 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1384a32d-8fd6-4b54-a0e8-6ab635bdd658 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:48.850584 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1384a32d-8fd6-4b54-a0e8-6ab635bdd658 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:48.851363 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1384a32d-8fd6-4b54-a0e8-6ab635bdd658 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:48.851798 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1384a32d-8fd6-4b54-a0e8-6ab635bdd658 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:48.917079 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-1384a32d-8fd6-4b54-a0e8-6ab635bdd658 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:48.925017 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-1384a32d-8fd6-4b54-a0e8-6ab635bdd658 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.085756 Jul 11 11:43:48.925577 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1074/2152] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:48 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:43:48.953460 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-6d764dc1-46ff-4077-9848-7b5431238753 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:48.961227 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-6d764dc1-46ff-4077-9848-7b5431238753 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.152411 Jul 11 11:43:48.961786 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1079/2153] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:48 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:49.113946 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-adde490b-1b62-47ce-b86a-a02fe9140318 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:49.114560 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-adde490b-1b62-47ce-b86a-a02fe9140318 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:49.121133 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-adde490b-1b62-47ce-b86a-a02fe9140318 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:49.121582 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-adde490b-1b62-47ce-b86a-a02fe9140318 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:49.122334 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-adde490b-1b62-47ce-b86a-a02fe9140318 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:49.122767 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-adde490b-1b62-47ce-b86a-a02fe9140318 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:49.249008 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-adde490b-1b62-47ce-b86a-a02fe9140318 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:49.256921 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-adde490b-1b62-47ce-b86a-a02fe9140318 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.146814 Jul 11 11:43:49.257471 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1075/2154] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:49 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:49.942485 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-fc3311f9-7c47-408a-a9ad-1ffd6e28cb7a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:49.943172 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-fc3311f9-7c47-408a-a9ad-1ffd6e28cb7a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:49.950476 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fc3311f9-7c47-408a-a9ad-1ffd6e28cb7a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:49.950925 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fc3311f9-7c47-408a-a9ad-1ffd6e28cb7a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:49.951721 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fc3311f9-7c47-408a-a9ad-1ffd6e28cb7a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:49.952160 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fc3311f9-7c47-408a-a9ad-1ffd6e28cb7a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:49.978355 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-0e892854-99ee-4d0f-b99b-8df491c2cddb tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:49.978996 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-0e892854-99ee-4d0f-b99b-8df491c2cddb tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:49.985558 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0e892854-99ee-4d0f-b99b-8df491c2cddb tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:49.986029 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0e892854-99ee-4d0f-b99b-8df491c2cddb tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:49.986835 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0e892854-99ee-4d0f-b99b-8df491c2cddb tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:49.987201 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0e892854-99ee-4d0f-b99b-8df491c2cddb tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:50.015921 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-fc3311f9-7c47-408a-a9ad-1ffd6e28cb7a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:50.023986 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-fc3311f9-7c47-408a-a9ad-1ffd6e28cb7a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.085319 Jul 11 11:43:50.024678 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1080/2155] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:49 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:43:50.119929 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-0e892854-99ee-4d0f-b99b-8df491c2cddb tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:50.127853 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-0e892854-99ee-4d0f-b99b-8df491c2cddb tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.153830 Jul 11 11:43:50.128424 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1076/2156] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:49 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:43:50.273874 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-5f093f82-acc1-49a2-81e1-5004d108bc49 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:50.274559 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-5f093f82-acc1-49a2-81e1-5004d108bc49 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:50.280531 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5f093f82-acc1-49a2-81e1-5004d108bc49 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:50.280979 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5f093f82-acc1-49a2-81e1-5004d108bc49 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:50.281735 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5f093f82-acc1-49a2-81e1-5004d108bc49 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:50.282170 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5f093f82-acc1-49a2-81e1-5004d108bc49 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:50.412181 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-5f093f82-acc1-49a2-81e1-5004d108bc49 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:50.420517 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-5f093f82-acc1-49a2-81e1-5004d108bc49 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.150526 Jul 11 11:43:50.421084 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1081/2157] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:50 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:51.041165 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-a8bc5820-da6a-48a3-8ad9-ba606bbc4a03 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:51.041784 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-a8bc5820-da6a-48a3-8ad9-ba606bbc4a03 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:51.044069 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_api:SELECT=82 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:43:51.048773 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a8bc5820-da6a-48a3-8ad9-ba606bbc4a03 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:51.049223 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a8bc5820-da6a-48a3-8ad9-ba606bbc4a03 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:51.051747 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a8bc5820-da6a-48a3-8ad9-ba606bbc4a03 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:51.051747 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a8bc5820-da6a-48a3-8ad9-ba606bbc4a03 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:51.117181 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-a8bc5820-da6a-48a3-8ad9-ba606bbc4a03 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:51.128686 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-a8bc5820-da6a-48a3-8ad9-ba606bbc4a03 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.089475 Jul 11 11:43:51.129278 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1077/2158] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:51 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:51.145748 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-384efaca-abf9-4501-ad93-5e3acda772e6 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:51.146362 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-384efaca-abf9-4501-ad93-5e3acda772e6 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:51.149344 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:43:51.154068 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-384efaca-abf9-4501-ad93-5e3acda772e6 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:51.154514 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-384efaca-abf9-4501-ad93-5e3acda772e6 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:51.155289 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-384efaca-abf9-4501-ad93-5e3acda772e6 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:51.155739 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-384efaca-abf9-4501-ad93-5e3acda772e6 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:51.286651 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-384efaca-abf9-4501-ad93-5e3acda772e6 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:51.294997 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-384efaca-abf9-4501-ad93-5e3acda772e6 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.152988 Jul 11 11:43:51.295533 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1082/2159] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:51 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:51.438775 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-3dc27428-b016-47fa-8e1f-bcdc20159efe tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:51.439406 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-3dc27428-b016-47fa-8e1f-bcdc20159efe tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:51.447430 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3dc27428-b016-47fa-8e1f-bcdc20159efe tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:51.447897 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3dc27428-b016-47fa-8e1f-bcdc20159efe tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:51.449192 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3dc27428-b016-47fa-8e1f-bcdc20159efe tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:51.449963 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3dc27428-b016-47fa-8e1f-bcdc20159efe tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:51.587489 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-3dc27428-b016-47fa-8e1f-bcdc20159efe tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:51.595303 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-3dc27428-b016-47fa-8e1f-bcdc20159efe tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.160383 Jul 11 11:43:51.595875 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1078/2160] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:51 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:52.145953 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-922f5c75-ed07-433f-89ba-933c0cb38ca0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:52.146563 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-922f5c75-ed07-433f-89ba-933c0cb38ca0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:52.152701 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-922f5c75-ed07-433f-89ba-933c0cb38ca0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:52.153139 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-922f5c75-ed07-433f-89ba-933c0cb38ca0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:52.153896 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-922f5c75-ed07-433f-89ba-933c0cb38ca0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:52.154328 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-922f5c75-ed07-433f-89ba-933c0cb38ca0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:52.214635 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-922f5c75-ed07-433f-89ba-933c0cb38ca0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:52.222411 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-922f5c75-ed07-433f-89ba-933c0cb38ca0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.080278 Jul 11 11:43:52.222976 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1083/2161] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:52 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:52.312268 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-e6d32495-5b72-4e81-b478-30c078cf9b7a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:52.312872 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-e6d32495-5b72-4e81-b478-30c078cf9b7a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:52.319949 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e6d32495-5b72-4e81-b478-30c078cf9b7a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:52.320395 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e6d32495-5b72-4e81-b478-30c078cf9b7a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:52.321148 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e6d32495-5b72-4e81-b478-30c078cf9b7a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:52.321579 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e6d32495-5b72-4e81-b478-30c078cf9b7a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:52.446311 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-e6d32495-5b72-4e81-b478-30c078cf9b7a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:52.454283 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-e6d32495-5b72-4e81-b478-30c078cf9b7a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.145870 Jul 11 11:43:52.454850 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1079/2162] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:52 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:52.612392 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-c33c9b5a-ebfa-4f40-93f9-5187d5c6cfb4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:52.612999 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-c33c9b5a-ebfa-4f40-93f9-5187d5c6cfb4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:52.619653 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c33c9b5a-ebfa-4f40-93f9-5187d5c6cfb4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:52.620104 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c33c9b5a-ebfa-4f40-93f9-5187d5c6cfb4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:52.620859 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c33c9b5a-ebfa-4f40-93f9-5187d5c6cfb4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:52.621292 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c33c9b5a-ebfa-4f40-93f9-5187d5c6cfb4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:52.746057 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-c33c9b5a-ebfa-4f40-93f9-5187d5c6cfb4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:52.753971 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-c33c9b5a-ebfa-4f40-93f9-5187d5c6cfb4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.145385 Jul 11 11:43:52.754543 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1084/2163] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:52 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:53.239576 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-04864fe4-101f-4696-b2cc-b71ea3a1d85c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:53.240188 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-04864fe4-101f-4696-b2cc-b71ea3a1d85c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:53.246443 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-04864fe4-101f-4696-b2cc-b71ea3a1d85c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:53.246919 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-04864fe4-101f-4696-b2cc-b71ea3a1d85c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:53.247707 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-04864fe4-101f-4696-b2cc-b71ea3a1d85c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:53.248206 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-04864fe4-101f-4696-b2cc-b71ea3a1d85c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:53.311456 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-04864fe4-101f-4696-b2cc-b71ea3a1d85c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:53.320321 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-04864fe4-101f-4696-b2cc-b71ea3a1d85c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.084667 Jul 11 11:43:53.320916 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1080/2164] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:53 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:53.472013 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-357e75b9-fc71-42b6-a1d8-10d9f0cfaa2c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:53.473897 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-357e75b9-fc71-42b6-a1d8-10d9f0cfaa2c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:53.480036 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-357e75b9-fc71-42b6-a1d8-10d9f0cfaa2c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:53.480488 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-357e75b9-fc71-42b6-a1d8-10d9f0cfaa2c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:53.481250 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-357e75b9-fc71-42b6-a1d8-10d9f0cfaa2c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:53.481688 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-357e75b9-fc71-42b6-a1d8-10d9f0cfaa2c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:53.613688 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-357e75b9-fc71-42b6-a1d8-10d9f0cfaa2c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:53.622034 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-357e75b9-fc71-42b6-a1d8-10d9f0cfaa2c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.153948 Jul 11 11:43:53.622601 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1085/2165] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:53 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:53.771587 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-c37b624b-8ea1-4274-b828-79d9ff606428 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:53.772161 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-c37b624b-8ea1-4274-b828-79d9ff606428 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:53.778149 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c37b624b-8ea1-4274-b828-79d9ff606428 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:53.778599 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c37b624b-8ea1-4274-b828-79d9ff606428 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:53.779385 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c37b624b-8ea1-4274-b828-79d9ff606428 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:53.779820 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c37b624b-8ea1-4274-b828-79d9ff606428 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:53.914886 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-c37b624b-8ea1-4274-b828-79d9ff606428 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:53.922769 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-c37b624b-8ea1-4274-b828-79d9ff606428 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.155125 Jul 11 11:43:53.923355 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1081/2166] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:53 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:54.337122 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-0b85e0b7-ac62-456d-a969-57ce398e7235 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:54.337658 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-0b85e0b7-ac62-456d-a969-57ce398e7235 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:54.343587 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0b85e0b7-ac62-456d-a969-57ce398e7235 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:54.344032 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0b85e0b7-ac62-456d-a969-57ce398e7235 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:54.344803 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0b85e0b7-ac62-456d-a969-57ce398e7235 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:54.345233 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0b85e0b7-ac62-456d-a969-57ce398e7235 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:54.405068 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-0b85e0b7-ac62-456d-a969-57ce398e7235 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:54.413454 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-0b85e0b7-ac62-456d-a969-57ce398e7235 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.080823 Jul 11 11:43:54.414036 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1086/2167] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:54 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:54.638572 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-79710cd2-a994-4b3d-b3b9-3cb76ca3ffb8 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:54.639126 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-79710cd2-a994-4b3d-b3b9-3cb76ca3ffb8 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:54.645681 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-79710cd2-a994-4b3d-b3b9-3cb76ca3ffb8 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:54.646133 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-79710cd2-a994-4b3d-b3b9-3cb76ca3ffb8 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:54.646890 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-79710cd2-a994-4b3d-b3b9-3cb76ca3ffb8 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:54.647415 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-79710cd2-a994-4b3d-b3b9-3cb76ca3ffb8 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:54.772531 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-79710cd2-a994-4b3d-b3b9-3cb76ca3ffb8 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:54.780433 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-79710cd2-a994-4b3d-b3b9-3cb76ca3ffb8 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.145849 Jul 11 11:43:54.781003 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1082/2168] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:54 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:54.938917 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-497b40c2-8722-4478-bc47-fc528ae9594b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:54.939571 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-497b40c2-8722-4478-bc47-fc528ae9594b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:54.945990 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-497b40c2-8722-4478-bc47-fc528ae9594b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:54.946442 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-497b40c2-8722-4478-bc47-fc528ae9594b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:54.947502 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-497b40c2-8722-4478-bc47-fc528ae9594b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:54.947942 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-497b40c2-8722-4478-bc47-fc528ae9594b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:55.077509 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-497b40c2-8722-4478-bc47-fc528ae9594b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:55.085461 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-497b40c2-8722-4478-bc47-fc528ae9594b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.150383 Jul 11 11:43:55.086027 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1087/2169] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:54 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:55.430630 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-36a8b822-8f9d-42ff-b007-1422c8c701f8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:55.431235 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-36a8b822-8f9d-42ff-b007-1422c8c701f8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:55.437202 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-36a8b822-8f9d-42ff-b007-1422c8c701f8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:55.437647 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-36a8b822-8f9d-42ff-b007-1422c8c701f8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:55.438393 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-36a8b822-8f9d-42ff-b007-1422c8c701f8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:55.438824 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-36a8b822-8f9d-42ff-b007-1422c8c701f8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:55.511293 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-36a8b822-8f9d-42ff-b007-1422c8c701f8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:55.519231 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-36a8b822-8f9d-42ff-b007-1422c8c701f8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.093015 Jul 11 11:43:55.519823 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1083/2170] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:55 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:55.798037 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-2c246bd7-62ba-47cb-b877-f39eb7cde35e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:55.798557 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-2c246bd7-62ba-47cb-b877-f39eb7cde35e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:55.805158 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2c246bd7-62ba-47cb-b877-f39eb7cde35e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:55.805601 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2c246bd7-62ba-47cb-b877-f39eb7cde35e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:55.806353 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2c246bd7-62ba-47cb-b877-f39eb7cde35e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:55.806812 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2c246bd7-62ba-47cb-b877-f39eb7cde35e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:55.933558 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-2c246bd7-62ba-47cb-b877-f39eb7cde35e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:55.942219 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-2c246bd7-62ba-47cb-b877-f39eb7cde35e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.147873 Jul 11 11:43:55.943313 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1088/2171] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:55 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:56.104008 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-ebe84990-4905-457a-8b7c-b7bbb325b507 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:56.104763 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-ebe84990-4905-457a-8b7c-b7bbb325b507 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:56.112063 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ebe84990-4905-457a-8b7c-b7bbb325b507 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:56.112510 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ebe84990-4905-457a-8b7c-b7bbb325b507 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:56.113265 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ebe84990-4905-457a-8b7c-b7bbb325b507 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:56.113693 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ebe84990-4905-457a-8b7c-b7bbb325b507 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:56.243132 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-ebe84990-4905-457a-8b7c-b7bbb325b507 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:56.245326 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=100 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:43:56.251633 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-ebe84990-4905-457a-8b7c-b7bbb325b507 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.151617 Jul 11 11:43:56.252208 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1084/2172] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:56 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:56.536353 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-3b425e60-e3af-41dc-a3c1-479f2d06174d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:56.536962 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-3b425e60-e3af-41dc-a3c1-479f2d06174d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:56.543387 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3b425e60-e3af-41dc-a3c1-479f2d06174d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:56.543833 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3b425e60-e3af-41dc-a3c1-479f2d06174d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:56.544584 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3b425e60-e3af-41dc-a3c1-479f2d06174d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:56.545018 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3b425e60-e3af-41dc-a3c1-479f2d06174d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:56.605192 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-3b425e60-e3af-41dc-a3c1-479f2d06174d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:56.613107 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-3b425e60-e3af-41dc-a3c1-479f2d06174d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.080596 Jul 11 11:43:56.613678 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1089/2173] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:56 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:56.960661 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-ce773114-d4f2-460d-b3b8-9706b96653a2 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:56.961273 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-ce773114-d4f2-460d-b3b8-9706b96653a2 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:56.967360 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ce773114-d4f2-460d-b3b8-9706b96653a2 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:56.967807 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ce773114-d4f2-460d-b3b8-9706b96653a2 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:56.968557 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ce773114-d4f2-460d-b3b8-9706b96653a2 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:56.968989 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ce773114-d4f2-460d-b3b8-9706b96653a2 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:57.095422 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-ce773114-d4f2-460d-b3b8-9706b96653a2 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:57.103865 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-ce773114-d4f2-460d-b3b8-9706b96653a2 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.147377 Jul 11 11:43:57.104433 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1085/2174] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:56 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:57.269206 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-166131a7-2b10-40b8-b726-07670c010cdf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:57.269756 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-166131a7-2b10-40b8-b726-07670c010cdf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:57.275836 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-166131a7-2b10-40b8-b726-07670c010cdf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:57.276289 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-166131a7-2b10-40b8-b726-07670c010cdf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:57.277044 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-166131a7-2b10-40b8-b726-07670c010cdf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:57.277482 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-166131a7-2b10-40b8-b726-07670c010cdf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:57.406007 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-166131a7-2b10-40b8-b726-07670c010cdf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:57.408186 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=100 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:43:57.415030 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-166131a7-2b10-40b8-b726-07670c010cdf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.149718 Jul 11 11:43:57.421820 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1090/2175] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:57 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:57.630635 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-1907868f-3c52-44e4-9e4d-2a038b92e419 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:57.631173 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-1907868f-3c52-44e4-9e4d-2a038b92e419 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:57.637660 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1907868f-3c52-44e4-9e4d-2a038b92e419 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:57.638114 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1907868f-3c52-44e4-9e4d-2a038b92e419 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:57.638878 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1907868f-3c52-44e4-9e4d-2a038b92e419 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:57.639339 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1907868f-3c52-44e4-9e4d-2a038b92e419 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:57.704838 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-1907868f-3c52-44e4-9e4d-2a038b92e419 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:57.713247 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-1907868f-3c52-44e4-9e4d-2a038b92e419 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.086520 Jul 11 11:43:57.713816 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1086/2176] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:57 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:58.121916 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-9a921c24-4dcf-4d62-aa41-4ae9454d0a18 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:58.122527 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-9a921c24-4dcf-4d62-aa41-4ae9454d0a18 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:58.129056 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9a921c24-4dcf-4d62-aa41-4ae9454d0a18 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:58.129507 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9a921c24-4dcf-4d62-aa41-4ae9454d0a18 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:58.130267 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9a921c24-4dcf-4d62-aa41-4ae9454d0a18 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:58.130704 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9a921c24-4dcf-4d62-aa41-4ae9454d0a18 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:58.257901 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-9a921c24-4dcf-4d62-aa41-4ae9454d0a18 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:58.265833 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-9a921c24-4dcf-4d62-aa41-4ae9454d0a18 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.148177 Jul 11 11:43:58.266403 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1091/2177] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:58 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:58.436918 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-ac2e4c74-f544-4a9b-af40-537c47c253ba tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:58.437529 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-ac2e4c74-f544-4a9b-af40-537c47c253ba tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:58.443580 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ac2e4c74-f544-4a9b-af40-537c47c253ba tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:58.444653 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ac2e4c74-f544-4a9b-af40-537c47c253ba tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:58.445402 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ac2e4c74-f544-4a9b-af40-537c47c253ba tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:58.445838 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ac2e4c74-f544-4a9b-af40-537c47c253ba tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:58.570980 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-ac2e4c74-f544-4a9b-af40-537c47c253ba tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:58.579128 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-ac2e4c74-f544-4a9b-af40-537c47c253ba tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.146066 Jul 11 11:43:58.579719 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1087/2178] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:58 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:58.730941 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-bf0a1970-bf37-4a5d-afa9-ab1a28d28661 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:58.731507 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-bf0a1970-bf37-4a5d-afa9-ab1a28d28661 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:58.737483 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bf0a1970-bf37-4a5d-afa9-ab1a28d28661 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:58.737934 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bf0a1970-bf37-4a5d-afa9-ab1a28d28661 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:58.738698 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bf0a1970-bf37-4a5d-afa9-ab1a28d28661 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:58.739133 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bf0a1970-bf37-4a5d-afa9-ab1a28d28661 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:58.798673 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-bf0a1970-bf37-4a5d-afa9-ab1a28d28661 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:58.807117 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-bf0a1970-bf37-4a5d-afa9-ab1a28d28661 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.080153 Jul 11 11:43:58.807725 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1092/2179] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:58 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:59.282643 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-5b213fc4-9b77-427e-bb12-10cd35af9f80 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:59.283275 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-5b213fc4-9b77-427e-bb12-10cd35af9f80 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:59.289841 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5b213fc4-9b77-427e-bb12-10cd35af9f80 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:59.290289 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5b213fc4-9b77-427e-bb12-10cd35af9f80 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:59.291054 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5b213fc4-9b77-427e-bb12-10cd35af9f80 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:59.291543 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5b213fc4-9b77-427e-bb12-10cd35af9f80 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:59.419346 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-5b213fc4-9b77-427e-bb12-10cd35af9f80 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:59.427192 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-5b213fc4-9b77-427e-bb12-10cd35af9f80 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.148400 Jul 11 11:43:59.427837 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1088/2180] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:59 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:59.596397 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-44626ea9-a7a6-4463-bfcc-9ab1f5fc24d9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:59.596922 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-44626ea9-a7a6-4463-bfcc-9ab1f5fc24d9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:59.604084 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-44626ea9-a7a6-4463-bfcc-9ab1f5fc24d9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:59.604526 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-44626ea9-a7a6-4463-bfcc-9ab1f5fc24d9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:59.605268 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-44626ea9-a7a6-4463-bfcc-9ab1f5fc24d9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:59.605692 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-44626ea9-a7a6-4463-bfcc-9ab1f5fc24d9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:59.736265 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-44626ea9-a7a6-4463-bfcc-9ab1f5fc24d9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:59.744355 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-44626ea9-a7a6-4463-bfcc-9ab1f5fc24d9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.152218 Jul 11 11:43:59.744917 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1093/2181] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:59 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:43:59.824184 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-d14bbc41-d519-48bf-a492-2651a18f63b2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:43:59.824801 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-d14bbc41-d519-48bf-a492-2651a18f63b2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:43:59.830802 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d14bbc41-d519-48bf-a492-2651a18f63b2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:59.831279 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d14bbc41-d519-48bf-a492-2651a18f63b2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:59.832048 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d14bbc41-d519-48bf-a492-2651a18f63b2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:43:59.832487 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d14bbc41-d519-48bf-a492-2651a18f63b2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:43:59.896023 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-d14bbc41-d519-48bf-a492-2651a18f63b2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:43:59.904537 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-d14bbc41-d519-48bf-a492-2651a18f63b2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.084416 Jul 11 11:43:59.905131 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1089/2182] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:43:59 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:44:00.444703 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-c6c3f2cf-b266-4dbb-b302-2192b7092bce tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:00.445312 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-c6c3f2cf-b266-4dbb-b302-2192b7092bce tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:00.451639 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c6c3f2cf-b266-4dbb-b302-2192b7092bce tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:00.452088 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c6c3f2cf-b266-4dbb-b302-2192b7092bce tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:00.452843 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c6c3f2cf-b266-4dbb-b302-2192b7092bce tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:00.453273 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c6c3f2cf-b266-4dbb-b302-2192b7092bce tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:00.577831 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-c6c3f2cf-b266-4dbb-b302-2192b7092bce tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:00.586131 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-c6c3f2cf-b266-4dbb-b302-2192b7092bce tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.145902 Jul 11 11:44:00.586696 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1094/2183] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:00 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:00.762038 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-39dfb826-fd0f-41ce-82a0-00f5c2bc33f4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:00.762652 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-39dfb826-fd0f-41ce-82a0-00f5c2bc33f4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:00.769199 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-39dfb826-fd0f-41ce-82a0-00f5c2bc33f4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:00.769648 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-39dfb826-fd0f-41ce-82a0-00f5c2bc33f4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:00.770400 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-39dfb826-fd0f-41ce-82a0-00f5c2bc33f4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:00.770834 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-39dfb826-fd0f-41ce-82a0-00f5c2bc33f4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:00.896998 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-39dfb826-fd0f-41ce-82a0-00f5c2bc33f4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:00.904828 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-39dfb826-fd0f-41ce-82a0-00f5c2bc33f4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.146662 Jul 11 11:44:00.905390 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1090/2184] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:00 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:00.921722 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-7d255a1b-9f06-4204-9f14-121db6b5a5f2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:00.922341 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-7d255a1b-9f06-4204-9f14-121db6b5a5f2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:00.929346 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7d255a1b-9f06-4204-9f14-121db6b5a5f2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:00.929795 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7d255a1b-9f06-4204-9f14-121db6b5a5f2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:00.930555 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7d255a1b-9f06-4204-9f14-121db6b5a5f2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:00.930989 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7d255a1b-9f06-4204-9f14-121db6b5a5f2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:00.994577 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-7d255a1b-9f06-4204-9f14-121db6b5a5f2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:01.002385 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-7d255a1b-9f06-4204-9f14-121db6b5a5f2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.084496 Jul 11 11:44:01.002988 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1095/2185] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:00 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:01.602236 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-0840fb1a-d4bb-46d7-8a9e-8432bc0122c9 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:01.602850 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-0840fb1a-d4bb-46d7-8a9e-8432bc0122c9 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:01.608952 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0840fb1a-d4bb-46d7-8a9e-8432bc0122c9 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:01.609407 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0840fb1a-d4bb-46d7-8a9e-8432bc0122c9 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:01.610181 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0840fb1a-d4bb-46d7-8a9e-8432bc0122c9 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:01.610601 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0840fb1a-d4bb-46d7-8a9e-8432bc0122c9 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:01.738371 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-0840fb1a-d4bb-46d7-8a9e-8432bc0122c9 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:01.746744 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-0840fb1a-d4bb-46d7-8a9e-8432bc0122c9 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.148412 Jul 11 11:44:01.747329 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1091/2186] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:01 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:01.922429 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-a3160a26-fe8a-4d57-a776-1d1a7ef5b7f7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:01.923046 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-a3160a26-fe8a-4d57-a776-1d1a7ef5b7f7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:01.929638 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a3160a26-fe8a-4d57-a776-1d1a7ef5b7f7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:01.930089 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a3160a26-fe8a-4d57-a776-1d1a7ef5b7f7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:01.930855 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a3160a26-fe8a-4d57-a776-1d1a7ef5b7f7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:01.931378 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a3160a26-fe8a-4d57-a776-1d1a7ef5b7f7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:02.018931 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-b641652b-fa8c-4b4b-9474-fd5c7e7464e2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:02.019678 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-b641652b-fa8c-4b4b-9474-fd5c7e7464e2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:02.026133 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b641652b-fa8c-4b4b-9474-fd5c7e7464e2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:02.026661 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b641652b-fa8c-4b4b-9474-fd5c7e7464e2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:02.027530 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b641652b-fa8c-4b4b-9474-fd5c7e7464e2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:02.028060 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b641652b-fa8c-4b4b-9474-fd5c7e7464e2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:02.060701 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-a3160a26-fe8a-4d57-a776-1d1a7ef5b7f7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:02.069720 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-a3160a26-fe8a-4d57-a776-1d1a7ef5b7f7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.150430 Jul 11 11:44:02.070527 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1096/2187] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:01 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:02.094289 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-b641652b-fa8c-4b4b-9474-fd5c7e7464e2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:02.102165 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-b641652b-fa8c-4b4b-9474-fd5c7e7464e2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.087019 Jul 11 11:44:02.102730 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1092/2188] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:02 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:44:02.765928 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-f2430944-720d-4dc4-a894-0fc3269af4dd tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:02.766532 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-f2430944-720d-4dc4-a894-0fc3269af4dd tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:02.773544 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f2430944-720d-4dc4-a894-0fc3269af4dd tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:02.773983 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f2430944-720d-4dc4-a894-0fc3269af4dd tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:02.774733 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f2430944-720d-4dc4-a894-0fc3269af4dd tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:02.775159 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f2430944-720d-4dc4-a894-0fc3269af4dd tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:02.903858 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-f2430944-720d-4dc4-a894-0fc3269af4dd tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:02.911599 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-f2430944-720d-4dc4-a894-0fc3269af4dd tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.151465 Jul 11 11:44:02.912162 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1097/2189] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:02 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:03.086990 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-af6bddb8-269f-4a28-a031-2ec335b95a1a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:03.087643 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-af6bddb8-269f-4a28-a031-2ec335b95a1a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:03.094236 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-af6bddb8-269f-4a28-a031-2ec335b95a1a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:03.094691 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-af6bddb8-269f-4a28-a031-2ec335b95a1a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:03.095470 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-af6bddb8-269f-4a28-a031-2ec335b95a1a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:03.095909 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-af6bddb8-269f-4a28-a031-2ec335b95a1a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:03.119725 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-f7eeac90-53f6-47af-a9d3-4e0a16cf1668 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:03.120372 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-f7eeac90-53f6-47af-a9d3-4e0a16cf1668 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:03.127300 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f7eeac90-53f6-47af-a9d3-4e0a16cf1668 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:03.127757 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f7eeac90-53f6-47af-a9d3-4e0a16cf1668 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:03.128574 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f7eeac90-53f6-47af-a9d3-4e0a16cf1668 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:03.129046 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f7eeac90-53f6-47af-a9d3-4e0a16cf1668 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:03.198282 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-f7eeac90-53f6-47af-a9d3-4e0a16cf1668 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:03.206312 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-f7eeac90-53f6-47af-a9d3-4e0a16cf1668 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.091019 Jul 11 11:44:03.206928 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1098/2190] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:03 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:44:03.230201 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-af6bddb8-269f-4a28-a031-2ec335b95a1a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:03.238147 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-af6bddb8-269f-4a28-a031-2ec335b95a1a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.155011 Jul 11 11:44:03.241444 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1093/2191] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:03 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:03.927885 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-fdc720a5-72bb-45f9-82e6-57de5068f608 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:03.929065 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-fdc720a5-72bb-45f9-82e6-57de5068f608 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:03.935026 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fdc720a5-72bb-45f9-82e6-57de5068f608 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:03.935511 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fdc720a5-72bb-45f9-82e6-57de5068f608 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:03.936270 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fdc720a5-72bb-45f9-82e6-57de5068f608 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:03.936706 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fdc720a5-72bb-45f9-82e6-57de5068f608 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:04.061137 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-fdc720a5-72bb-45f9-82e6-57de5068f608 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:04.069585 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-fdc720a5-72bb-45f9-82e6-57de5068f608 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.145040 Jul 11 11:44:04.070485 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1099/2192] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:03 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:04.223753 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-7dfe2fa8-baaa-45f8-8831-5df1eac77dea tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:04.224307 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-7dfe2fa8-baaa-45f8-8831-5df1eac77dea tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:04.230766 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7dfe2fa8-baaa-45f8-8831-5df1eac77dea tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:04.231688 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7dfe2fa8-baaa-45f8-8831-5df1eac77dea tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:04.231991 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7dfe2fa8-baaa-45f8-8831-5df1eac77dea tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:04.232424 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7dfe2fa8-baaa-45f8-8831-5df1eac77dea tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:04.257053 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-fe750a97-e174-4c55-a986-4cedd3448dd0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:04.257918 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-fe750a97-e174-4c55-a986-4cedd3448dd0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:04.264739 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fe750a97-e174-4c55-a986-4cedd3448dd0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:04.265265 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fe750a97-e174-4c55-a986-4cedd3448dd0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:04.266101 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fe750a97-e174-4c55-a986-4cedd3448dd0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:04.266612 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fe750a97-e174-4c55-a986-4cedd3448dd0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:04.296432 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-7dfe2fa8-baaa-45f8-8831-5df1eac77dea tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:04.305480 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-7dfe2fa8-baaa-45f8-8831-5df1eac77dea tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.085652 Jul 11 11:44:04.306199 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1094/2193] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:04 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:04.394931 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-fe750a97-e174-4c55-a986-4cedd3448dd0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:04.402994 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-fe750a97-e174-4c55-a986-4cedd3448dd0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.150379 Jul 11 11:44:04.406573 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1100/2194] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:04 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:44:05.086304 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-c5b86b23-8473-44bd-b965-6821618d3593 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:05.086914 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-c5b86b23-8473-44bd-b965-6821618d3593 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:05.093014 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c5b86b23-8473-44bd-b965-6821618d3593 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:05.093443 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c5b86b23-8473-44bd-b965-6821618d3593 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:05.094194 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c5b86b23-8473-44bd-b965-6821618d3593 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:05.094626 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c5b86b23-8473-44bd-b965-6821618d3593 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:05.224609 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-c5b86b23-8473-44bd-b965-6821618d3593 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:05.233819 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-c5b86b23-8473-44bd-b965-6821618d3593 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.151814 Jul 11 11:44:05.234601 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1095/2195] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:05 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:05.323391 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-a749028a-d4d5-4c59-be16-d28ffa3dd6c0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:05.323932 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-a749028a-d4d5-4c59-be16-d28ffa3dd6c0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:05.330282 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a749028a-d4d5-4c59-be16-d28ffa3dd6c0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:05.330736 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a749028a-d4d5-4c59-be16-d28ffa3dd6c0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:05.331528 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a749028a-d4d5-4c59-be16-d28ffa3dd6c0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:05.331969 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a749028a-d4d5-4c59-be16-d28ffa3dd6c0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:05.398687 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-a749028a-d4d5-4c59-be16-d28ffa3dd6c0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:05.406561 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-a749028a-d4d5-4c59-be16-d28ffa3dd6c0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.087978 Jul 11 11:44:05.407127 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1101/2196] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:05 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:05.419815 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-4d0da062-3c33-4074-81a4-6ba060a993b3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:05.420431 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-4d0da062-3c33-4074-81a4-6ba060a993b3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:05.426386 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4d0da062-3c33-4074-81a4-6ba060a993b3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:05.426837 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4d0da062-3c33-4074-81a4-6ba060a993b3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:05.427627 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4d0da062-3c33-4074-81a4-6ba060a993b3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:05.428098 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4d0da062-3c33-4074-81a4-6ba060a993b3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:05.563243 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-4d0da062-3c33-4074-81a4-6ba060a993b3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:05.572545 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-4d0da062-3c33-4074-81a4-6ba060a993b3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.156196 Jul 11 11:44:05.574225 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1096/2197] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:05 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:06.249733 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-44683957-1541-4011-8f7b-a3796666d83a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:06.250350 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-44683957-1541-4011-8f7b-a3796666d83a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:06.256961 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-44683957-1541-4011-8f7b-a3796666d83a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:06.257348 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-44683957-1541-4011-8f7b-a3796666d83a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:06.258104 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-44683957-1541-4011-8f7b-a3796666d83a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:06.258539 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-44683957-1541-4011-8f7b-a3796666d83a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:06.388506 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-44683957-1541-4011-8f7b-a3796666d83a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:06.396470 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-44683957-1541-4011-8f7b-a3796666d83a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.150555 Jul 11 11:44:06.397040 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1102/2198] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:06 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:06.422901 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-7dc8367a-e345-4529-ad0e-03a6f80fc369 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:06.423543 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-7dc8367a-e345-4529-ad0e-03a6f80fc369 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:06.430490 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7dc8367a-e345-4529-ad0e-03a6f80fc369 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:06.430936 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7dc8367a-e345-4529-ad0e-03a6f80fc369 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:06.431716 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7dc8367a-e345-4529-ad0e-03a6f80fc369 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:06.432153 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7dc8367a-e345-4529-ad0e-03a6f80fc369 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:06.501094 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-7dc8367a-e345-4529-ad0e-03a6f80fc369 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:06.513739 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-7dc8367a-e345-4529-ad0e-03a6f80fc369 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.094608 Jul 11 11:44:06.514241 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1097/2199] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:06 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:06.589767 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-1d7067da-f494-4318-9088-49d4bb090d74 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:06.590378 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-1d7067da-f494-4318-9088-49d4bb090d74 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:06.596366 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1d7067da-f494-4318-9088-49d4bb090d74 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:06.596814 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1d7067da-f494-4318-9088-49d4bb090d74 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:06.597568 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1d7067da-f494-4318-9088-49d4bb090d74 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:06.598001 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1d7067da-f494-4318-9088-49d4bb090d74 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:06.727828 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-1d7067da-f494-4318-9088-49d4bb090d74 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:06.735675 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-1d7067da-f494-4318-9088-49d4bb090d74 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.149688 Jul 11 11:44:06.736269 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1103/2200] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:06 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:07.414045 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-382b7efd-8711-496c-935d-e3ff365f1330 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:07.414651 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-382b7efd-8711-496c-935d-e3ff365f1330 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:07.420651 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-382b7efd-8711-496c-935d-e3ff365f1330 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:07.421097 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-382b7efd-8711-496c-935d-e3ff365f1330 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:07.421842 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-382b7efd-8711-496c-935d-e3ff365f1330 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:07.422271 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-382b7efd-8711-496c-935d-e3ff365f1330 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:07.533130 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-b206a215-8c31-445b-af71-56a7ad10c5c6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:07.533870 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-b206a215-8c31-445b-af71-56a7ad10c5c6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:07.542134 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b206a215-8c31-445b-af71-56a7ad10c5c6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:07.542578 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b206a215-8c31-445b-af71-56a7ad10c5c6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:07.543372 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b206a215-8c31-445b-af71-56a7ad10c5c6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:07.544103 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b206a215-8c31-445b-af71-56a7ad10c5c6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:07.560161 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-382b7efd-8711-496c-935d-e3ff365f1330 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:07.574128 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-382b7efd-8711-496c-935d-e3ff365f1330 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.164396 Jul 11 11:44:07.574774 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1098/2201] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:07 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:07.615406 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-b206a215-8c31-445b-af71-56a7ad10c5c6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:07.623611 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-b206a215-8c31-445b-af71-56a7ad10c5c6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.095444 Jul 11 11:44:07.624182 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1104/2202] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:07 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:44:07.753501 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-245ac261-23f2-4dc6-a0e3-9ff1f353b646 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:07.754113 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-245ac261-23f2-4dc6-a0e3-9ff1f353b646 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:07.760610 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-245ac261-23f2-4dc6-a0e3-9ff1f353b646 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:07.761054 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-245ac261-23f2-4dc6-a0e3-9ff1f353b646 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:07.761803 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-245ac261-23f2-4dc6-a0e3-9ff1f353b646 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:07.762235 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-245ac261-23f2-4dc6-a0e3-9ff1f353b646 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:07.889675 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-245ac261-23f2-4dc6-a0e3-9ff1f353b646 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:07.898024 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-245ac261-23f2-4dc6-a0e3-9ff1f353b646 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.148450 Jul 11 11:44:07.898586 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1099/2203] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:07 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:08.591327 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-da4281e8-9b5f-4ace-9116-73db159d871e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:08.591871 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-da4281e8-9b5f-4ace-9116-73db159d871e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:08.598349 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-da4281e8-9b5f-4ace-9116-73db159d871e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:08.598795 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-da4281e8-9b5f-4ace-9116-73db159d871e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:08.599568 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-da4281e8-9b5f-4ace-9116-73db159d871e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:08.600003 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-da4281e8-9b5f-4ace-9116-73db159d871e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:08.641146 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-837402f8-ef1f-495e-b810-b915029d2c03 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:08.641770 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-837402f8-ef1f-495e-b810-b915029d2c03 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:08.648274 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-837402f8-ef1f-495e-b810-b915029d2c03 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:08.648726 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-837402f8-ef1f-495e-b810-b915029d2c03 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:08.649489 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-837402f8-ef1f-495e-b810-b915029d2c03 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:08.649956 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-837402f8-ef1f-495e-b810-b915029d2c03 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:08.711666 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-837402f8-ef1f-495e-b810-b915029d2c03 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:08.719586 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-837402f8-ef1f-495e-b810-b915029d2c03 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.082326 Jul 11 11:44:08.720344 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1100/2204] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:08 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:44:08.727376 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-da4281e8-9b5f-4ace-9116-73db159d871e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:08.735344 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-da4281e8-9b5f-4ace-9116-73db159d871e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.147949 Jul 11 11:44:08.735904 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1105/2205] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:08 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:08.914176 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-ea6f2076-d70c-4da1-abf8-4fb26bc85b43 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:08.914789 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-ea6f2076-d70c-4da1-abf8-4fb26bc85b43 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:08.920782 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ea6f2076-d70c-4da1-abf8-4fb26bc85b43 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:08.921232 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ea6f2076-d70c-4da1-abf8-4fb26bc85b43 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:08.921984 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ea6f2076-d70c-4da1-abf8-4fb26bc85b43 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:08.922455 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ea6f2076-d70c-4da1-abf8-4fb26bc85b43 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:08.937065 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=100 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:44:09.050978 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-ea6f2076-d70c-4da1-abf8-4fb26bc85b43 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:09.059516 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-ea6f2076-d70c-4da1-abf8-4fb26bc85b43 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.149115 Jul 11 11:44:09.060080 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1101/2206] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:08 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:09.736630 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-a1cd742d-148a-49f7-bf60-3cbfe885fee5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:09.737236 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-a1cd742d-148a-49f7-bf60-3cbfe885fee5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:09.744121 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a1cd742d-148a-49f7-bf60-3cbfe885fee5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:09.744560 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a1cd742d-148a-49f7-bf60-3cbfe885fee5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:09.745306 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a1cd742d-148a-49f7-bf60-3cbfe885fee5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:09.745735 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a1cd742d-148a-49f7-bf60-3cbfe885fee5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:09.753054 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-214f6e81-fbb3-469f-843e-1875d292220f tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:09.753694 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-214f6e81-fbb3-469f-843e-1875d292220f tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:09.760701 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-214f6e81-fbb3-469f-843e-1875d292220f tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:09.761146 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-214f6e81-fbb3-469f-843e-1875d292220f tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:09.761930 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-214f6e81-fbb3-469f-843e-1875d292220f tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:09.762364 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-214f6e81-fbb3-469f-843e-1875d292220f tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:09.807567 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-a1cd742d-148a-49f7-bf60-3cbfe885fee5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:09.815517 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-a1cd742d-148a-49f7-bf60-3cbfe885fee5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.082725 Jul 11 11:44:09.816099 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1106/2207] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:09 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:09.903784 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-214f6e81-fbb3-469f-843e-1875d292220f tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:09.911759 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-214f6e81-fbb3-469f-843e-1875d292220f tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.162415 Jul 11 11:44:09.912389 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1102/2208] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:09 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:44:10.076929 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-93e60d76-c37f-4643-a300-e6dc3165e4bd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:10.077532 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-93e60d76-c37f-4643-a300-e6dc3165e4bd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:10.083518 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-93e60d76-c37f-4643-a300-e6dc3165e4bd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:10.083965 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-93e60d76-c37f-4643-a300-e6dc3165e4bd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:10.085407 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-93e60d76-c37f-4643-a300-e6dc3165e4bd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:10.085837 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-93e60d76-c37f-4643-a300-e6dc3165e4bd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:10.100061 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=100 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:44:10.214785 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-93e60d76-c37f-4643-a300-e6dc3165e4bd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:10.222717 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-93e60d76-c37f-4643-a300-e6dc3165e4bd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.149810 Jul 11 11:44:10.223298 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1107/2209] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:10 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:10.833390 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-04f1a3c8-afe1-458e-89c0-8c0edcb0bbcf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:10.834017 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-04f1a3c8-afe1-458e-89c0-8c0edcb0bbcf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:10.840660 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-04f1a3c8-afe1-458e-89c0-8c0edcb0bbcf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:10.841109 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-04f1a3c8-afe1-458e-89c0-8c0edcb0bbcf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:10.841860 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-04f1a3c8-afe1-458e-89c0-8c0edcb0bbcf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:10.842296 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-04f1a3c8-afe1-458e-89c0-8c0edcb0bbcf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:10.906338 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-04f1a3c8-afe1-458e-89c0-8c0edcb0bbcf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:10.914971 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-04f1a3c8-afe1-458e-89c0-8c0edcb0bbcf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.085454 Jul 11 11:44:10.915578 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1103/2210] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:10 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:10.929689 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-3fd38ce6-bcbb-4806-bde4-12d68199ac52 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:10.930322 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-3fd38ce6-bcbb-4806-bde4-12d68199ac52 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:10.936997 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3fd38ce6-bcbb-4806-bde4-12d68199ac52 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:10.937424 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3fd38ce6-bcbb-4806-bde4-12d68199ac52 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:10.938175 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3fd38ce6-bcbb-4806-bde4-12d68199ac52 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:10.938607 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3fd38ce6-bcbb-4806-bde4-12d68199ac52 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:11.070731 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-3fd38ce6-bcbb-4806-bde4-12d68199ac52 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:11.081924 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-3fd38ce6-bcbb-4806-bde4-12d68199ac52 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.156572 Jul 11 11:44:11.082827 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1108/2211] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:10 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:11.240078 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-9159bb7d-58fe-4000-a9b4-d0dec2da35f7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:11.240736 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-9159bb7d-58fe-4000-a9b4-d0dec2da35f7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:11.247413 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9159bb7d-58fe-4000-a9b4-d0dec2da35f7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:11.247858 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9159bb7d-58fe-4000-a9b4-d0dec2da35f7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:11.248605 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9159bb7d-58fe-4000-a9b4-d0dec2da35f7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:11.249048 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9159bb7d-58fe-4000-a9b4-d0dec2da35f7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:11.385328 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-9159bb7d-58fe-4000-a9b4-d0dec2da35f7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:11.393490 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-9159bb7d-58fe-4000-a9b4-d0dec2da35f7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.157135 Jul 11 11:44:11.394042 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1104/2212] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:11 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:11.933599 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-e65a20d2-72c3-4059-9a90-7bd9aeee4ecd tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:11.934214 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-e65a20d2-72c3-4059-9a90-7bd9aeee4ecd tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:11.940761 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e65a20d2-72c3-4059-9a90-7bd9aeee4ecd tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:11.941211 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e65a20d2-72c3-4059-9a90-7bd9aeee4ecd tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:11.941966 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e65a20d2-72c3-4059-9a90-7bd9aeee4ecd tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:11.942401 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e65a20d2-72c3-4059-9a90-7bd9aeee4ecd tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:12.006661 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-e65a20d2-72c3-4059-9a90-7bd9aeee4ecd tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:12.014717 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-e65a20d2-72c3-4059-9a90-7bd9aeee4ecd tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.084957 Jul 11 11:44:12.015326 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1109/2213] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:11 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:12.100493 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-5e5a5215-f182-4c55-8b22-f6dbb55fca11 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:12.101105 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-5e5a5215-f182-4c55-8b22-f6dbb55fca11 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:12.107732 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5e5a5215-f182-4c55-8b22-f6dbb55fca11 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:12.108181 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5e5a5215-f182-4c55-8b22-f6dbb55fca11 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:12.108936 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5e5a5215-f182-4c55-8b22-f6dbb55fca11 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:12.109376 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5e5a5215-f182-4c55-8b22-f6dbb55fca11 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:12.235236 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-5e5a5215-f182-4c55-8b22-f6dbb55fca11 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:12.243467 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-5e5a5215-f182-4c55-8b22-f6dbb55fca11 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.147296 Jul 11 11:44:12.244028 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1105/2214] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:12 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:12.410467 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-c65916eb-adeb-4aaf-8fff-b43f2e3b1bde tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:12.411082 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-c65916eb-adeb-4aaf-8fff-b43f2e3b1bde tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:12.417697 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c65916eb-adeb-4aaf-8fff-b43f2e3b1bde tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:12.418150 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c65916eb-adeb-4aaf-8fff-b43f2e3b1bde tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:12.418910 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c65916eb-adeb-4aaf-8fff-b43f2e3b1bde tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:12.419376 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c65916eb-adeb-4aaf-8fff-b43f2e3b1bde tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:12.547217 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-c65916eb-adeb-4aaf-8fff-b43f2e3b1bde tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:12.555025 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-c65916eb-adeb-4aaf-8fff-b43f2e3b1bde tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.148393 Jul 11 11:44:12.555619 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1110/2215] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:12 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:13.031596 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-22681c24-0fb8-4ad1-bd7e-0d9ab7abc1af tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:13.032218 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-22681c24-0fb8-4ad1-bd7e-0d9ab7abc1af tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:13.038233 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-22681c24-0fb8-4ad1-bd7e-0d9ab7abc1af tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:13.038685 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-22681c24-0fb8-4ad1-bd7e-0d9ab7abc1af tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:13.039487 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-22681c24-0fb8-4ad1-bd7e-0d9ab7abc1af tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:13.039924 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-22681c24-0fb8-4ad1-bd7e-0d9ab7abc1af tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:13.104975 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-22681c24-0fb8-4ad1-bd7e-0d9ab7abc1af tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:13.113184 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-22681c24-0fb8-4ad1-bd7e-0d9ab7abc1af tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.085557 Jul 11 11:44:13.114084 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1106/2216] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:13 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:13.260886 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-8e490e49-fcf1-44c6-85ec-8f25f0f3665d tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:13.261496 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-8e490e49-fcf1-44c6-85ec-8f25f0f3665d tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:13.267981 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8e490e49-fcf1-44c6-85ec-8f25f0f3665d tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:13.268429 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8e490e49-fcf1-44c6-85ec-8f25f0f3665d tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:13.269183 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8e490e49-fcf1-44c6-85ec-8f25f0f3665d tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:13.269613 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8e490e49-fcf1-44c6-85ec-8f25f0f3665d tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:13.395343 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-8e490e49-fcf1-44c6-85ec-8f25f0f3665d tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:13.403170 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-8e490e49-fcf1-44c6-85ec-8f25f0f3665d tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.146134 Jul 11 11:44:13.403770 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1111/2217] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:13 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:13.571642 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-f47b0c5d-fb9a-4930-aa9c-dbd25547f378 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:13.572506 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-f47b0c5d-fb9a-4930-aa9c-dbd25547f378 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:13.578413 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f47b0c5d-fb9a-4930-aa9c-dbd25547f378 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:13.578875 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f47b0c5d-fb9a-4930-aa9c-dbd25547f378 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:13.579653 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f47b0c5d-fb9a-4930-aa9c-dbd25547f378 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:13.580084 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f47b0c5d-fb9a-4930-aa9c-dbd25547f378 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:13.713565 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-f47b0c5d-fb9a-4930-aa9c-dbd25547f378 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:13.721441 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-f47b0c5d-fb9a-4930-aa9c-dbd25547f378 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.153647 Jul 11 11:44:13.721978 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1107/2218] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:13 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:14.130401 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-fc93e92e-cbff-4dea-9f51-8ffefd301a41 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:14.131005 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-fc93e92e-cbff-4dea-9f51-8ffefd301a41 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:14.137008 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fc93e92e-cbff-4dea-9f51-8ffefd301a41 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:14.137450 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fc93e92e-cbff-4dea-9f51-8ffefd301a41 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:14.138223 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fc93e92e-cbff-4dea-9f51-8ffefd301a41 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:14.139132 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fc93e92e-cbff-4dea-9f51-8ffefd301a41 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:14.202456 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-fc93e92e-cbff-4dea-9f51-8ffefd301a41 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:14.210880 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-fc93e92e-cbff-4dea-9f51-8ffefd301a41 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.084292 Jul 11 11:44:14.211475 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1112/2219] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:14 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:14.420055 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-aa54d520-7968-43e4-b7d2-833684473dab tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:14.421665 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-aa54d520-7968-43e4-b7d2-833684473dab tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:14.427219 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-aa54d520-7968-43e4-b7d2-833684473dab tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:14.427702 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-aa54d520-7968-43e4-b7d2-833684473dab tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:14.428466 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-aa54d520-7968-43e4-b7d2-833684473dab tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:14.428908 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-aa54d520-7968-43e4-b7d2-833684473dab tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:14.555218 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-aa54d520-7968-43e4-b7d2-833684473dab tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:14.563212 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-aa54d520-7968-43e4-b7d2-833684473dab tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.147066 Jul 11 11:44:14.563809 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1108/2220] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:14 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:14.739094 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-d95eeb24-9be6-4d2a-8ee0-3f742ddc41d0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:14.739642 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-d95eeb24-9be6-4d2a-8ee0-3f742ddc41d0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:14.746275 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d95eeb24-9be6-4d2a-8ee0-3f742ddc41d0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:14.746735 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d95eeb24-9be6-4d2a-8ee0-3f742ddc41d0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:14.747509 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d95eeb24-9be6-4d2a-8ee0-3f742ddc41d0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:14.747934 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d95eeb24-9be6-4d2a-8ee0-3f742ddc41d0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:14.873355 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-d95eeb24-9be6-4d2a-8ee0-3f742ddc41d0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:14.881663 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-d95eeb24-9be6-4d2a-8ee0-3f742ddc41d0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.145898 Jul 11 11:44:14.882228 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1113/2221] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:14 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:15.228432 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-b4e562d1-bc20-4814-a667-928c23298cf6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:15.229049 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-b4e562d1-bc20-4814-a667-928c23298cf6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:15.235065 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b4e562d1-bc20-4814-a667-928c23298cf6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:15.235553 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b4e562d1-bc20-4814-a667-928c23298cf6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:15.244740 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b4e562d1-bc20-4814-a667-928c23298cf6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:15.244740 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b4e562d1-bc20-4814-a667-928c23298cf6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:15.305256 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-b4e562d1-bc20-4814-a667-928c23298cf6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:15.313272 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-b4e562d1-bc20-4814-a667-928c23298cf6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.089650 Jul 11 11:44:15.313842 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1109/2222] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:15 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:15.581298 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-89a8d604-cd38-4510-b835-804501376315 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:15.581913 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-89a8d604-cd38-4510-b835-804501376315 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:15.587998 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-89a8d604-cd38-4510-b835-804501376315 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:15.588451 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-89a8d604-cd38-4510-b835-804501376315 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:15.589210 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-89a8d604-cd38-4510-b835-804501376315 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:15.589645 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-89a8d604-cd38-4510-b835-804501376315 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:15.715397 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-89a8d604-cd38-4510-b835-804501376315 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:15.723335 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-89a8d604-cd38-4510-b835-804501376315 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.145863 Jul 11 11:44:15.723912 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1114/2223] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:15 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:15.898594 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-c2c615dd-97ec-4318-bdaf-b281f4a45f4b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:15.899157 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-c2c615dd-97ec-4318-bdaf-b281f4a45f4b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:15.905314 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c2c615dd-97ec-4318-bdaf-b281f4a45f4b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:15.905756 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c2c615dd-97ec-4318-bdaf-b281f4a45f4b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:15.906501 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c2c615dd-97ec-4318-bdaf-b281f4a45f4b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:15.906933 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c2c615dd-97ec-4318-bdaf-b281f4a45f4b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:16.032184 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-c2c615dd-97ec-4318-bdaf-b281f4a45f4b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:16.039991 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-c2c615dd-97ec-4318-bdaf-b281f4a45f4b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.145896 Jul 11 11:44:16.040586 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1110/2224] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:15 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:16.329772 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-5052089b-c9ec-4e80-946f-07235ecd97d4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:16.330373 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-5052089b-c9ec-4e80-946f-07235ecd97d4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:16.336981 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5052089b-c9ec-4e80-946f-07235ecd97d4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:16.337422 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5052089b-c9ec-4e80-946f-07235ecd97d4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:16.338164 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5052089b-c9ec-4e80-946f-07235ecd97d4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:16.338590 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5052089b-c9ec-4e80-946f-07235ecd97d4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:16.402279 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-5052089b-c9ec-4e80-946f-07235ecd97d4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:16.410290 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-5052089b-c9ec-4e80-946f-07235ecd97d4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.084351 Jul 11 11:44:16.410852 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1115/2225] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:16 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:16.740971 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-8645abd3-17b2-474e-8d0a-9ec1b24aacb3 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:16.742333 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-8645abd3-17b2-474e-8d0a-9ec1b24aacb3 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:16.748492 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8645abd3-17b2-474e-8d0a-9ec1b24aacb3 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:16.748933 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8645abd3-17b2-474e-8d0a-9ec1b24aacb3 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:16.749680 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8645abd3-17b2-474e-8d0a-9ec1b24aacb3 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:16.750111 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8645abd3-17b2-474e-8d0a-9ec1b24aacb3 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:16.876944 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-8645abd3-17b2-474e-8d0a-9ec1b24aacb3 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:16.885468 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-8645abd3-17b2-474e-8d0a-9ec1b24aacb3 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.148384 Jul 11 11:44:16.886031 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1111/2226] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:16 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:17.057431 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-ba0666a3-dbcf-4839-b60f-1d664eb79294 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:17.057964 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-ba0666a3-dbcf-4839-b60f-1d664eb79294 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:17.064012 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ba0666a3-dbcf-4839-b60f-1d664eb79294 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:17.064459 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ba0666a3-dbcf-4839-b60f-1d664eb79294 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:17.065216 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ba0666a3-dbcf-4839-b60f-1d664eb79294 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:17.065650 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ba0666a3-dbcf-4839-b60f-1d664eb79294 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:17.191185 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-ba0666a3-dbcf-4839-b60f-1d664eb79294 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:17.199859 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-ba0666a3-dbcf-4839-b60f-1d664eb79294 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.146824 Jul 11 11:44:17.200425 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1116/2227] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:17 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:17.426965 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-85e598ca-ac1e-47c6-b73b-f029614d0895 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:17.427722 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-85e598ca-ac1e-47c6-b73b-f029614d0895 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:17.434710 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-85e598ca-ac1e-47c6-b73b-f029614d0895 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:17.435154 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-85e598ca-ac1e-47c6-b73b-f029614d0895 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:17.435952 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-85e598ca-ac1e-47c6-b73b-f029614d0895 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:17.436389 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-85e598ca-ac1e-47c6-b73b-f029614d0895 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:17.499956 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-85e598ca-ac1e-47c6-b73b-f029614d0895 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:17.507856 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-85e598ca-ac1e-47c6-b73b-f029614d0895 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.084694 Jul 11 11:44:17.508429 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1112/2228] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:17 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:17.902972 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-07cff614-c81f-4505-b9de-186b0a6dec65 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:17.903616 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-07cff614-c81f-4505-b9de-186b0a6dec65 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:17.910034 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-07cff614-c81f-4505-b9de-186b0a6dec65 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:17.910478 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-07cff614-c81f-4505-b9de-186b0a6dec65 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:17.911227 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-07cff614-c81f-4505-b9de-186b0a6dec65 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:17.911686 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-07cff614-c81f-4505-b9de-186b0a6dec65 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:18.037151 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-07cff614-c81f-4505-b9de-186b0a6dec65 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:18.045083 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-07cff614-c81f-4505-b9de-186b0a6dec65 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.145990 Jul 11 11:44:18.045653 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1117/2229] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:17 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:18.217315 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-eb4f8e1a-f335-4013-864b-3b83d17ed903 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:18.218375 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-eb4f8e1a-f335-4013-864b-3b83d17ed903 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:18.224044 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-eb4f8e1a-f335-4013-864b-3b83d17ed903 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:18.224499 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-eb4f8e1a-f335-4013-864b-3b83d17ed903 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:18.225251 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-eb4f8e1a-f335-4013-864b-3b83d17ed903 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:18.225753 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-eb4f8e1a-f335-4013-864b-3b83d17ed903 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:18.350818 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-eb4f8e1a-f335-4013-864b-3b83d17ed903 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:18.358633 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-eb4f8e1a-f335-4013-864b-3b83d17ed903 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.145201 Jul 11 11:44:18.359208 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1113/2230] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:18 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:18.388153 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 11:44:18.388340 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Mon Jul 11 11:44:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 11:44:18.526058 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-76449887-3cfd-4040-b194-33e039b660a2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:18.526907 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-76449887-3cfd-4040-b194-33e039b660a2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:18.534345 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-76449887-3cfd-4040-b194-33e039b660a2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:18.534792 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-76449887-3cfd-4040-b194-33e039b660a2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:18.535583 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-76449887-3cfd-4040-b194-33e039b660a2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:18.536020 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-76449887-3cfd-4040-b194-33e039b660a2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:18.599592 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-76449887-3cfd-4040-b194-33e039b660a2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:18.607452 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-76449887-3cfd-4040-b194-33e039b660a2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.086344 Jul 11 11:44:18.608009 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1118/2231] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:18 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:19.002996 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 11:44:19.003602 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Mon Jul 11 11:44:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 11:44:19.061839 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-e209eb19-bb67-4526-81fc-87d8eae95de4 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:19.062452 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-e209eb19-bb67-4526-81fc-87d8eae95de4 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:19.069056 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e209eb19-bb67-4526-81fc-87d8eae95de4 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:19.069505 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e209eb19-bb67-4526-81fc-87d8eae95de4 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:19.070262 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e209eb19-bb67-4526-81fc-87d8eae95de4 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:19.070697 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e209eb19-bb67-4526-81fc-87d8eae95de4 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:19.195652 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-e209eb19-bb67-4526-81fc-87d8eae95de4 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:19.203775 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-e209eb19-bb67-4526-81fc-87d8eae95de4 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.145665 Jul 11 11:44:19.204339 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1114/2232] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:19 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:19.376272 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-a92b2674-fbd7-49f4-b5da-8ad899dfbbfe tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:19.376878 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-a92b2674-fbd7-49f4-b5da-8ad899dfbbfe tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:19.383211 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a92b2674-fbd7-49f4-b5da-8ad899dfbbfe tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:19.383694 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a92b2674-fbd7-49f4-b5da-8ad899dfbbfe tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:19.384426 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a92b2674-fbd7-49f4-b5da-8ad899dfbbfe tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:19.384883 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a92b2674-fbd7-49f4-b5da-8ad899dfbbfe tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:19.512780 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-a92b2674-fbd7-49f4-b5da-8ad899dfbbfe tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:19.520599 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-a92b2674-fbd7-49f4-b5da-8ad899dfbbfe tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.148138 Jul 11 11:44:19.521163 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1119/2233] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:19 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:44:19.624187 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-36d3ef26-05e2-44ab-ac08-f6fa9e1338ac tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:19.624702 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-36d3ef26-05e2-44ab-ac08-f6fa9e1338ac tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:19.630593 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-36d3ef26-05e2-44ab-ac08-f6fa9e1338ac tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:19.631036 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-36d3ef26-05e2-44ab-ac08-f6fa9e1338ac tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:19.631866 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-36d3ef26-05e2-44ab-ac08-f6fa9e1338ac tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:19.632301 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-36d3ef26-05e2-44ab-ac08-f6fa9e1338ac tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:19.695224 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-36d3ef26-05e2-44ab-ac08-f6fa9e1338ac tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:19.703201 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-36d3ef26-05e2-44ab-ac08-f6fa9e1338ac tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.082939 Jul 11 11:44:19.703779 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1115/2234] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:19 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:20.221393 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-84a1edfb-0c9e-402a-9d0a-d37eb08184c6 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:20.222001 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-84a1edfb-0c9e-402a-9d0a-d37eb08184c6 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:20.228248 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-84a1edfb-0c9e-402a-9d0a-d37eb08184c6 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:20.228695 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-84a1edfb-0c9e-402a-9d0a-d37eb08184c6 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:20.229446 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-84a1edfb-0c9e-402a-9d0a-d37eb08184c6 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:20.229880 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-84a1edfb-0c9e-402a-9d0a-d37eb08184c6 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:20.353948 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-84a1edfb-0c9e-402a-9d0a-d37eb08184c6 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:20.361711 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-84a1edfb-0c9e-402a-9d0a-d37eb08184c6 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.144222 Jul 11 11:44:20.362267 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1120/2235] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:20 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:20.537938 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-c7313641-024b-4bc0-a860-6079d7c4f8d3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:20.538553 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-c7313641-024b-4bc0-a860-6079d7c4f8d3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:20.545138 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c7313641-024b-4bc0-a860-6079d7c4f8d3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:20.545585 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c7313641-024b-4bc0-a860-6079d7c4f8d3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:20.546338 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c7313641-024b-4bc0-a860-6079d7c4f8d3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:20.546773 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c7313641-024b-4bc0-a860-6079d7c4f8d3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:20.672239 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-c7313641-024b-4bc0-a860-6079d7c4f8d3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:20.680599 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-c7313641-024b-4bc0-a860-6079d7c4f8d3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.146484 Jul 11 11:44:20.681162 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1116/2236] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:20 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:20.719909 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-543665a9-62ea-4097-808b-f6fcb72041bf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:20.720523 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-543665a9-62ea-4097-808b-f6fcb72041bf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:20.726937 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-543665a9-62ea-4097-808b-f6fcb72041bf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:20.727417 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-543665a9-62ea-4097-808b-f6fcb72041bf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:20.728178 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-543665a9-62ea-4097-808b-f6fcb72041bf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:20.728615 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-543665a9-62ea-4097-808b-f6fcb72041bf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:20.791866 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-543665a9-62ea-4097-808b-f6fcb72041bf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:20.799748 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-543665a9-62ea-4097-808b-f6fcb72041bf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.083705 Jul 11 11:44:20.800314 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1121/2237] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:20 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:21.377807 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-6ed88dce-9fe9-4bfa-a6aa-260e0894e2c9 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:21.378416 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-6ed88dce-9fe9-4bfa-a6aa-260e0894e2c9 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:21.380429 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_api:SELECT=80 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:44:21.385467 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6ed88dce-9fe9-4bfa-a6aa-260e0894e2c9 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:21.390048 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6ed88dce-9fe9-4bfa-a6aa-260e0894e2c9 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:21.390048 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6ed88dce-9fe9-4bfa-a6aa-260e0894e2c9 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:21.390048 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6ed88dce-9fe9-4bfa-a6aa-260e0894e2c9 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:21.522175 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-6ed88dce-9fe9-4bfa-a6aa-260e0894e2c9 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:21.530622 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-6ed88dce-9fe9-4bfa-a6aa-260e0894e2c9 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.156626 Jul 11 11:44:21.531190 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1117/2238] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:21 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:21.698783 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-22812e24-0f59-4a58-8229-fc14939960b1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:21.699900 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-22812e24-0f59-4a58-8229-fc14939960b1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:21.703039 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_api:SELECT=80 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:44:21.706414 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-22812e24-0f59-4a58-8229-fc14939960b1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:21.706884 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-22812e24-0f59-4a58-8229-fc14939960b1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:21.707668 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-22812e24-0f59-4a58-8229-fc14939960b1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:21.708105 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-22812e24-0f59-4a58-8229-fc14939960b1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:21.818521 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-c3e6e146-003a-4800-ad28-0f0cfc00a8f3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:21.819737 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-c3e6e146-003a-4800-ad28-0f0cfc00a8f3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:21.826706 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c3e6e146-003a-4800-ad28-0f0cfc00a8f3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:21.827234 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c3e6e146-003a-4800-ad28-0f0cfc00a8f3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:21.828099 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c3e6e146-003a-4800-ad28-0f0cfc00a8f3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:21.828603 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c3e6e146-003a-4800-ad28-0f0cfc00a8f3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:21.832746 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=100 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:44:21.847073 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-22812e24-0f59-4a58-8229-fc14939960b1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:21.854992 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-22812e24-0f59-4a58-8229-fc14939960b1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.160788 Jul 11 11:44:21.855624 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1122/2239] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:21 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:21.893390 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-c3e6e146-003a-4800-ad28-0f0cfc00a8f3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:21.901941 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-c3e6e146-003a-4800-ad28-0f0cfc00a8f3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.088308 Jul 11 11:44:21.902511 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1118/2240] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:21 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:44:21.929165 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 11:44:21.929301 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Mon Jul 11 11:44:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 11:44:22.549214 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-8a04ed86-9464-4202-aaf0-c7e6063b4322 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:22.549937 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-8a04ed86-9464-4202-aaf0-c7e6063b4322 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:22.556600 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8a04ed86-9464-4202-aaf0-c7e6063b4322 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:22.557077 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8a04ed86-9464-4202-aaf0-c7e6063b4322 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:22.557830 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8a04ed86-9464-4202-aaf0-c7e6063b4322 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:22.558260 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8a04ed86-9464-4202-aaf0-c7e6063b4322 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:22.682329 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-8a04ed86-9464-4202-aaf0-c7e6063b4322 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:22.690089 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-8a04ed86-9464-4202-aaf0-c7e6063b4322 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.145557 Jul 11 11:44:22.690656 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1123/2241] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:22 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:22.872290 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-8cf634c9-6e54-49cc-bc5b-4e911b3df365 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:22.872843 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-8cf634c9-6e54-49cc-bc5b-4e911b3df365 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:22.879323 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8cf634c9-6e54-49cc-bc5b-4e911b3df365 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:22.879776 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8cf634c9-6e54-49cc-bc5b-4e911b3df365 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:22.880525 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8cf634c9-6e54-49cc-bc5b-4e911b3df365 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:22.880959 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8cf634c9-6e54-49cc-bc5b-4e911b3df365 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:22.919703 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-3a8c2a91-2110-4808-af2d-bd44b18581df tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:22.920312 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-3a8c2a91-2110-4808-af2d-bd44b18581df tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:22.926742 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3a8c2a91-2110-4808-af2d-bd44b18581df tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:22.927188 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3a8c2a91-2110-4808-af2d-bd44b18581df tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:22.927994 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3a8c2a91-2110-4808-af2d-bd44b18581df tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:22.928428 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3a8c2a91-2110-4808-af2d-bd44b18581df tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:22.930978 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=100 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:44:22.993724 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-3a8c2a91-2110-4808-af2d-bd44b18581df tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:23.001525 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-3a8c2a91-2110-4808-af2d-bd44b18581df tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.085534 Jul 11 11:44:23.002127 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1124/2242] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:22 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:44:23.009930 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-8cf634c9-6e54-49cc-bc5b-4e911b3df365 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:23.018040 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-8cf634c9-6e54-49cc-bc5b-4e911b3df365 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.149683 Jul 11 11:44:23.018606 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1119/2243] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:22 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:23.707309 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-54e5d9e6-04c7-4f17-9761-36285078ad8f tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:23.707926 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-54e5d9e6-04c7-4f17-9761-36285078ad8f tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:23.714170 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-54e5d9e6-04c7-4f17-9761-36285078ad8f tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:23.714621 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-54e5d9e6-04c7-4f17-9761-36285078ad8f tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:23.715427 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-54e5d9e6-04c7-4f17-9761-36285078ad8f tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:23.715868 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-54e5d9e6-04c7-4f17-9761-36285078ad8f tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:23.840205 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-54e5d9e6-04c7-4f17-9761-36285078ad8f tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:23.848169 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-54e5d9e6-04c7-4f17-9761-36285078ad8f tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.144712 Jul 11 11:44:23.850225 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1125/2244] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:23 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:24.017714 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-cc6bea5b-a8cb-4f96-9270-878b67ee1d20 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:24.018255 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-cc6bea5b-a8cb-4f96-9270-878b67ee1d20 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:24.024719 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cc6bea5b-a8cb-4f96-9270-878b67ee1d20 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:24.025159 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cc6bea5b-a8cb-4f96-9270-878b67ee1d20 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:24.025906 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cc6bea5b-a8cb-4f96-9270-878b67ee1d20 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:24.026337 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cc6bea5b-a8cb-4f96-9270-878b67ee1d20 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:24.035513 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-1384c180-4cdc-47f1-90e3-4361fc101eaa tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:24.036123 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-1384c180-4cdc-47f1-90e3-4361fc101eaa tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:24.043094 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1384c180-4cdc-47f1-90e3-4361fc101eaa tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:24.043566 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1384c180-4cdc-47f1-90e3-4361fc101eaa tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:24.044314 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1384c180-4cdc-47f1-90e3-4361fc101eaa tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:24.044745 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1384c180-4cdc-47f1-90e3-4361fc101eaa tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:24.089161 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-cc6bea5b-a8cb-4f96-9270-878b67ee1d20 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:24.097099 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-cc6bea5b-a8cb-4f96-9270-878b67ee1d20 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.083194 Jul 11 11:44:24.097675 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1120/2245] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:24 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:24.183967 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-1384c180-4cdc-47f1-90e3-4361fc101eaa tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:24.192158 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-1384c180-4cdc-47f1-90e3-4361fc101eaa tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.160702 Jul 11 11:44:24.192730 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1126/2246] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:24 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:44:24.865152 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-3c21792a-542a-416d-b04d-5e071394f244 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:24.865764 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-3c21792a-542a-416d-b04d-5e071394f244 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:24.871980 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3c21792a-542a-416d-b04d-5e071394f244 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:24.872433 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3c21792a-542a-416d-b04d-5e071394f244 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:24.873191 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3c21792a-542a-416d-b04d-5e071394f244 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:24.873627 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3c21792a-542a-416d-b04d-5e071394f244 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:25.001139 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-3c21792a-542a-416d-b04d-5e071394f244 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:25.009442 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-3c21792a-542a-416d-b04d-5e071394f244 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.148105 Jul 11 11:44:25.010008 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1121/2247] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:24 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:25.117302 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-de2e088e-25d9-4e20-ac76-61b8d184ff6a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:25.117898 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-de2e088e-25d9-4e20-ac76-61b8d184ff6a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:25.124496 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-de2e088e-25d9-4e20-ac76-61b8d184ff6a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:25.124943 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-de2e088e-25d9-4e20-ac76-61b8d184ff6a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:25.125701 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-de2e088e-25d9-4e20-ac76-61b8d184ff6a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:25.126131 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-de2e088e-25d9-4e20-ac76-61b8d184ff6a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:25.188625 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-de2e088e-25d9-4e20-ac76-61b8d184ff6a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:25.196996 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-de2e088e-25d9-4e20-ac76-61b8d184ff6a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.085568 Jul 11 11:44:25.197812 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1127/2248] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:25 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:25.209806 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-c5ce7b2e-b43f-40ec-9097-4e94196db11c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:25.210509 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-c5ce7b2e-b43f-40ec-9097-4e94196db11c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:25.216901 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c5ce7b2e-b43f-40ec-9097-4e94196db11c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:25.217343 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c5ce7b2e-b43f-40ec-9097-4e94196db11c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:25.218138 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c5ce7b2e-b43f-40ec-9097-4e94196db11c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:25.218574 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c5ce7b2e-b43f-40ec-9097-4e94196db11c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:25.346522 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-c5ce7b2e-b43f-40ec-9097-4e94196db11c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:25.354521 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-c5ce7b2e-b43f-40ec-9097-4e94196db11c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.148670 Jul 11 11:44:25.355091 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1122/2249] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:25 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:26.026438 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-63ac3603-fb77-41d6-b5f7-a6944365c6a7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:26.027045 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-63ac3603-fb77-41d6-b5f7-a6944365c6a7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:26.033134 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-63ac3603-fb77-41d6-b5f7-a6944365c6a7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:26.033582 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-63ac3603-fb77-41d6-b5f7-a6944365c6a7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:26.034332 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-63ac3603-fb77-41d6-b5f7-a6944365c6a7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:26.034765 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-63ac3603-fb77-41d6-b5f7-a6944365c6a7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:26.161981 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-63ac3603-fb77-41d6-b5f7-a6944365c6a7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:26.170365 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-63ac3603-fb77-41d6-b5f7-a6944365c6a7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.148292 Jul 11 11:44:26.170931 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1128/2250] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:26 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:26.214570 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-89e92469-7d19-4a11-ab8d-81f194c8f92e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:26.215171 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-89e92469-7d19-4a11-ab8d-81f194c8f92e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:26.221570 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-89e92469-7d19-4a11-ab8d-81f194c8f92e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:26.222013 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-89e92469-7d19-4a11-ab8d-81f194c8f92e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:26.222758 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-89e92469-7d19-4a11-ab8d-81f194c8f92e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:26.223187 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-89e92469-7d19-4a11-ab8d-81f194c8f92e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:26.288660 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-89e92469-7d19-4a11-ab8d-81f194c8f92e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:26.296453 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-89e92469-7d19-4a11-ab8d-81f194c8f92e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.086302 Jul 11 11:44:26.297016 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1123/2251] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:26 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:26.371482 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-893c4297-40af-4229-9a63-41bc9164a2d0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:26.372081 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-893c4297-40af-4229-9a63-41bc9164a2d0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:26.378032 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-893c4297-40af-4229-9a63-41bc9164a2d0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:26.378477 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-893c4297-40af-4229-9a63-41bc9164a2d0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:26.379220 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-893c4297-40af-4229-9a63-41bc9164a2d0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:26.379672 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-893c4297-40af-4229-9a63-41bc9164a2d0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:26.504190 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-893c4297-40af-4229-9a63-41bc9164a2d0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:26.512482 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-893c4297-40af-4229-9a63-41bc9164a2d0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.144845 Jul 11 11:44:26.513040 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1129/2252] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:26 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:27.186892 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-02b3ac7a-f0e8-4102-bbe1-b19ba964a820 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:27.187559 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-02b3ac7a-f0e8-4102-bbe1-b19ba964a820 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:27.193566 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-02b3ac7a-f0e8-4102-bbe1-b19ba964a820 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:27.194018 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-02b3ac7a-f0e8-4102-bbe1-b19ba964a820 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:27.194768 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-02b3ac7a-f0e8-4102-bbe1-b19ba964a820 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:27.195202 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-02b3ac7a-f0e8-4102-bbe1-b19ba964a820 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:27.313728 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-dd808700-7169-4e21-a328-9b382793661c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:27.314486 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-dd808700-7169-4e21-a328-9b382793661c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:27.321071 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-dd808700-7169-4e21-a328-9b382793661c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:27.321595 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-dd808700-7169-4e21-a328-9b382793661c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:27.322685 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-dd808700-7169-4e21-a328-9b382793661c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:27.323281 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-dd808700-7169-4e21-a328-9b382793661c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:27.325824 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-02b3ac7a-f0e8-4102-bbe1-b19ba964a820 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:27.333746 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-02b3ac7a-f0e8-4102-bbe1-b19ba964a820 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.150642 Jul 11 11:44:27.334316 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1124/2253] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:27 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:27.387785 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-dd808700-7169-4e21-a328-9b382793661c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:27.395603 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-dd808700-7169-4e21-a328-9b382793661c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.086149 Jul 11 11:44:27.396168 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1130/2254] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:27 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:44:27.529670 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-4127b418-7123-40c0-9e8b-fc29aae572be tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:27.530280 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-4127b418-7123-40c0-9e8b-fc29aae572be tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:27.536215 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4127b418-7123-40c0-9e8b-fc29aae572be tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:27.536662 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4127b418-7123-40c0-9e8b-fc29aae572be tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:27.537411 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4127b418-7123-40c0-9e8b-fc29aae572be tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:27.537850 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4127b418-7123-40c0-9e8b-fc29aae572be tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:27.670480 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-4127b418-7123-40c0-9e8b-fc29aae572be tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:27.678247 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-4127b418-7123-40c0-9e8b-fc29aae572be tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.152487 Jul 11 11:44:27.679137 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1125/2255] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:27 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:28.351928 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-ec85679e-9728-44d9-9ae6-c240f22674d7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:28.352658 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-ec85679e-9728-44d9-9ae6-c240f22674d7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:28.360187 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ec85679e-9728-44d9-9ae6-c240f22674d7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:28.360636 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ec85679e-9728-44d9-9ae6-c240f22674d7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:28.361394 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ec85679e-9728-44d9-9ae6-c240f22674d7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:28.361827 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ec85679e-9728-44d9-9ae6-c240f22674d7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:28.412929 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-3b6778ef-b14f-4645-a74b-75c7384a53b3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:28.413567 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-3b6778ef-b14f-4645-a74b-75c7384a53b3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:28.420551 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3b6778ef-b14f-4645-a74b-75c7384a53b3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:28.420994 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3b6778ef-b14f-4645-a74b-75c7384a53b3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:28.421748 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3b6778ef-b14f-4645-a74b-75c7384a53b3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:28.422181 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3b6778ef-b14f-4645-a74b-75c7384a53b3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:28.484103 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-3b6778ef-b14f-4645-a74b-75c7384a53b3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:28.489503 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-ec85679e-9728-44d9-9ae6-c240f22674d7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:28.492632 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-3b6778ef-b14f-4645-a74b-75c7384a53b3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.083519 Jul 11 11:44:28.493412 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1126/2256] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:28 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:44:28.498027 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-ec85679e-9728-44d9-9ae6-c240f22674d7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.150203 Jul 11 11:44:28.498590 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1131/2257] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:28 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:28.695485 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-46c10f29-e7f8-4279-9050-da32f0bf7505 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:28.696108 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-46c10f29-e7f8-4279-9050-da32f0bf7505 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:28.702806 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-46c10f29-e7f8-4279-9050-da32f0bf7505 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:28.703418 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-46c10f29-e7f8-4279-9050-da32f0bf7505 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:28.704185 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-46c10f29-e7f8-4279-9050-da32f0bf7505 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:28.704615 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-46c10f29-e7f8-4279-9050-da32f0bf7505 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:28.838202 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-46c10f29-e7f8-4279-9050-da32f0bf7505 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:28.846245 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-46c10f29-e7f8-4279-9050-da32f0bf7505 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.154693 Jul 11 11:44:28.847284 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1127/2258] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:28 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:29.510106 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-7a57efff-b952-4ef9-961c-020e45685372 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:29.510718 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-7a57efff-b952-4ef9-961c-020e45685372 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:29.514410 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-9bf0002c-9c72-47be-8100-0efdf34c8974 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:29.515052 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-9bf0002c-9c72-47be-8100-0efdf34c8974 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:29.517250 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7a57efff-b952-4ef9-961c-020e45685372 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:29.517699 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7a57efff-b952-4ef9-961c-020e45685372 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:29.518461 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7a57efff-b952-4ef9-961c-020e45685372 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:29.518893 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7a57efff-b952-4ef9-961c-020e45685372 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:29.521368 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9bf0002c-9c72-47be-8100-0efdf34c8974 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:29.521831 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9bf0002c-9c72-47be-8100-0efdf34c8974 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:29.523240 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9bf0002c-9c72-47be-8100-0efdf34c8974 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:29.523708 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9bf0002c-9c72-47be-8100-0efdf34c8974 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:29.580700 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-7a57efff-b952-4ef9-961c-020e45685372 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:29.589717 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-7a57efff-b952-4ef9-961c-020e45685372 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.084074 Jul 11 11:44:29.590298 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1132/2259] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:29 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:29.654820 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-9bf0002c-9c72-47be-8100-0efdf34c8974 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:29.663374 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-9bf0002c-9c72-47be-8100-0efdf34c8974 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.152667 Jul 11 11:44:29.663945 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1128/2260] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:29 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:44:29.864210 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-9399d441-7392-490d-bc5e-432b3c6ccd95 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:29.864735 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-9399d441-7392-490d-bc5e-432b3c6ccd95 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:29.871121 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9399d441-7392-490d-bc5e-432b3c6ccd95 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:29.871598 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9399d441-7392-490d-bc5e-432b3c6ccd95 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:29.872345 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9399d441-7392-490d-bc5e-432b3c6ccd95 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:29.872770 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9399d441-7392-490d-bc5e-432b3c6ccd95 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:30.003377 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-9399d441-7392-490d-bc5e-432b3c6ccd95 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:30.011215 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-9399d441-7392-490d-bc5e-432b3c6ccd95 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.150935 Jul 11 11:44:30.011794 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1133/2261] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:29 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:30.606727 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-97bd78bc-f3e0-49bb-896e-0bc96a263e23 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:30.607241 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-97bd78bc-f3e0-49bb-896e-0bc96a263e23 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:30.613668 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-97bd78bc-f3e0-49bb-896e-0bc96a263e23 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:30.614109 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-97bd78bc-f3e0-49bb-896e-0bc96a263e23 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:30.614852 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-97bd78bc-f3e0-49bb-896e-0bc96a263e23 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:30.615302 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-97bd78bc-f3e0-49bb-896e-0bc96a263e23 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:30.675379 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-97bd78bc-f3e0-49bb-896e-0bc96a263e23 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:30.680088 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-0ee54438-0bb4-4875-9850-7057427cdeba tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:30.680696 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-0ee54438-0bb4-4875-9850-7057427cdeba tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:30.683524 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-97bd78bc-f3e0-49bb-896e-0bc96a263e23 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.080625 Jul 11 11:44:30.684093 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1129/2262] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:30 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:30.687618 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0ee54438-0bb4-4875-9850-7057427cdeba tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:30.688130 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0ee54438-0bb4-4875-9850-7057427cdeba tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:30.688987 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0ee54438-0bb4-4875-9850-7057427cdeba tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:30.689481 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0ee54438-0bb4-4875-9850-7057427cdeba tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:30.820964 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-0ee54438-0bb4-4875-9850-7057427cdeba tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:30.825256 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-0ee54438-0bb4-4875-9850-7057427cdeba tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.148959 Jul 11 11:44:30.825826 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1134/2263] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:30 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:44:31.028812 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-aaddb801-6070-42f8-b3ad-8208c32d4d59 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:31.029455 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-aaddb801-6070-42f8-b3ad-8208c32d4d59 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:31.035384 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-aaddb801-6070-42f8-b3ad-8208c32d4d59 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:31.035825 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-aaddb801-6070-42f8-b3ad-8208c32d4d59 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:31.036571 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-aaddb801-6070-42f8-b3ad-8208c32d4d59 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:31.036995 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-aaddb801-6070-42f8-b3ad-8208c32d4d59 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:31.164667 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-aaddb801-6070-42f8-b3ad-8208c32d4d59 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:31.172446 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-aaddb801-6070-42f8-b3ad-8208c32d4d59 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.147468 Jul 11 11:44:31.173010 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1130/2264] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:31 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:31.700891 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-c55ef33d-a9ed-4dea-97f6-9342ddf2dade tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:31.702327 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-c55ef33d-a9ed-4dea-97f6-9342ddf2dade tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:31.709275 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c55ef33d-a9ed-4dea-97f6-9342ddf2dade tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:31.709729 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c55ef33d-a9ed-4dea-97f6-9342ddf2dade tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:31.710532 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c55ef33d-a9ed-4dea-97f6-9342ddf2dade tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:31.710961 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c55ef33d-a9ed-4dea-97f6-9342ddf2dade tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:31.771797 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-c55ef33d-a9ed-4dea-97f6-9342ddf2dade tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:31.779618 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-c55ef33d-a9ed-4dea-97f6-9342ddf2dade tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.082820 Jul 11 11:44:31.780188 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1135/2265] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:31 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:31.841722 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-60a9ce97-dfda-4e38-b872-d268d62c0d91 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:31.842357 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-60a9ce97-dfda-4e38-b872-d268d62c0d91 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:31.848846 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-60a9ce97-dfda-4e38-b872-d268d62c0d91 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:31.849290 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-60a9ce97-dfda-4e38-b872-d268d62c0d91 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:31.850034 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-60a9ce97-dfda-4e38-b872-d268d62c0d91 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:31.851090 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-60a9ce97-dfda-4e38-b872-d268d62c0d91 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:31.976121 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-60a9ce97-dfda-4e38-b872-d268d62c0d91 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:31.983953 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-60a9ce97-dfda-4e38-b872-d268d62c0d91 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.146030 Jul 11 11:44:31.984514 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1131/2266] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:31 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:32.189776 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-e4a2ce22-fafa-4db2-89d9-062c383cc780 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:32.190383 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-e4a2ce22-fafa-4db2-89d9-062c383cc780 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:32.197645 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e4a2ce22-fafa-4db2-89d9-062c383cc780 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:32.198310 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e4a2ce22-fafa-4db2-89d9-062c383cc780 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:32.199290 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e4a2ce22-fafa-4db2-89d9-062c383cc780 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:32.199725 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e4a2ce22-fafa-4db2-89d9-062c383cc780 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:32.329373 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-e4a2ce22-fafa-4db2-89d9-062c383cc780 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:32.337221 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-e4a2ce22-fafa-4db2-89d9-062c383cc780 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.151275 Jul 11 11:44:32.338863 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1136/2267] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:32 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:32.796924 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-6cf46fff-3ef4-426d-b709-d361bd79e79c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:32.797561 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-6cf46fff-3ef4-426d-b709-d361bd79e79c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:32.803606 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6cf46fff-3ef4-426d-b709-d361bd79e79c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:32.804054 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6cf46fff-3ef4-426d-b709-d361bd79e79c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:32.804799 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6cf46fff-3ef4-426d-b709-d361bd79e79c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:32.805231 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6cf46fff-3ef4-426d-b709-d361bd79e79c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:32.868017 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-6cf46fff-3ef4-426d-b709-d361bd79e79c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:32.875814 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-6cf46fff-3ef4-426d-b709-d361bd79e79c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.082740 Jul 11 11:44:32.876372 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1132/2268] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:32 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:33.000692 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-79383c07-5b95-4ed2-ac4c-f74196e3b2bd tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:33.001298 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-79383c07-5b95-4ed2-ac4c-f74196e3b2bd tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:33.007741 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-79383c07-5b95-4ed2-ac4c-f74196e3b2bd tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:33.008692 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-79383c07-5b95-4ed2-ac4c-f74196e3b2bd tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:33.009454 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-79383c07-5b95-4ed2-ac4c-f74196e3b2bd tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:33.009886 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-79383c07-5b95-4ed2-ac4c-f74196e3b2bd tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:33.136393 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-79383c07-5b95-4ed2-ac4c-f74196e3b2bd tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:33.144249 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-79383c07-5b95-4ed2-ac4c-f74196e3b2bd tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.147419 Jul 11 11:44:33.144816 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1137/2269] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:32 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:33.354240 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-2686e26c-94f0-4e74-99f2-a0fc5462452b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:33.354777 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-2686e26c-94f0-4e74-99f2-a0fc5462452b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:33.360716 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2686e26c-94f0-4e74-99f2-a0fc5462452b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:33.361159 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2686e26c-94f0-4e74-99f2-a0fc5462452b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:33.361902 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2686e26c-94f0-4e74-99f2-a0fc5462452b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:33.362365 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2686e26c-94f0-4e74-99f2-a0fc5462452b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:33.487659 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-2686e26c-94f0-4e74-99f2-a0fc5462452b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:33.496116 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-2686e26c-94f0-4e74-99f2-a0fc5462452b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.146133 Jul 11 11:44:33.496676 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1133/2270] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:33 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:33.892842 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-5b60df32-b6c9-44bb-ad3f-8504d33056f4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:33.893450 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-5b60df32-b6c9-44bb-ad3f-8504d33056f4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:33.899575 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5b60df32-b6c9-44bb-ad3f-8504d33056f4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:33.900013 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5b60df32-b6c9-44bb-ad3f-8504d33056f4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:33.900758 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5b60df32-b6c9-44bb-ad3f-8504d33056f4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:33.901189 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5b60df32-b6c9-44bb-ad3f-8504d33056f4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:33.965588 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-5b60df32-b6c9-44bb-ad3f-8504d33056f4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:33.973465 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-5b60df32-b6c9-44bb-ad3f-8504d33056f4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.084541 Jul 11 11:44:33.974037 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1138/2271] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:33 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:34.160872 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-b2e90b38-6e0c-4faf-85a6-cdc173cf8ac0 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:34.161533 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-b2e90b38-6e0c-4faf-85a6-cdc173cf8ac0 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:34.168927 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b2e90b38-6e0c-4faf-85a6-cdc173cf8ac0 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:34.169741 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b2e90b38-6e0c-4faf-85a6-cdc173cf8ac0 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:34.170142 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b2e90b38-6e0c-4faf-85a6-cdc173cf8ac0 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:34.171237 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b2e90b38-6e0c-4faf-85a6-cdc173cf8ac0 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:34.302787 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-b2e90b38-6e0c-4faf-85a6-cdc173cf8ac0 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:34.305065 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=100 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:44:34.311279 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-b2e90b38-6e0c-4faf-85a6-cdc173cf8ac0 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.154336 Jul 11 11:44:34.312433 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1134/2272] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:34 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:34.514170 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-55db41e4-3b94-49c2-878a-da1ae7c1fa4c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:34.514733 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-55db41e4-3b94-49c2-878a-da1ae7c1fa4c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:34.521152 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-55db41e4-3b94-49c2-878a-da1ae7c1fa4c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:34.521596 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-55db41e4-3b94-49c2-878a-da1ae7c1fa4c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:34.522343 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-55db41e4-3b94-49c2-878a-da1ae7c1fa4c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:34.522803 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-55db41e4-3b94-49c2-878a-da1ae7c1fa4c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:34.650871 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-55db41e4-3b94-49c2-878a-da1ae7c1fa4c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:34.658751 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-55db41e4-3b94-49c2-878a-da1ae7c1fa4c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.148539 Jul 11 11:44:34.659334 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1139/2273] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:34 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:34.990869 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-05346c5e-ea14-4158-9682-d5b8d1e8b91d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:34.991517 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-05346c5e-ea14-4158-9682-d5b8d1e8b91d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:34.998383 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-05346c5e-ea14-4158-9682-d5b8d1e8b91d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:34.998830 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-05346c5e-ea14-4158-9682-d5b8d1e8b91d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:34.999641 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-05346c5e-ea14-4158-9682-d5b8d1e8b91d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:35.000078 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-05346c5e-ea14-4158-9682-d5b8d1e8b91d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:35.062545 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-05346c5e-ea14-4158-9682-d5b8d1e8b91d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:35.070481 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-05346c5e-ea14-4158-9682-d5b8d1e8b91d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.083349 Jul 11 11:44:35.071676 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1135/2274] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:34 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:35.328532 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-2b3f14fb-253c-48e9-a366-13d4c9f21691 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:35.329093 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-2b3f14fb-253c-48e9-a366-13d4c9f21691 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:35.335061 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2b3f14fb-253c-48e9-a366-13d4c9f21691 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:35.335534 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2b3f14fb-253c-48e9-a366-13d4c9f21691 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:35.336312 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2b3f14fb-253c-48e9-a366-13d4c9f21691 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:35.336741 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2b3f14fb-253c-48e9-a366-13d4c9f21691 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:35.461217 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-2b3f14fb-253c-48e9-a366-13d4c9f21691 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:35.465938 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=100 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:44:35.469573 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-2b3f14fb-253c-48e9-a366-13d4c9f21691 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.144986 Jul 11 11:44:35.470141 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1140/2275] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:35 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:35.675917 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-1195c279-471d-4907-a98b-8d4f79612d50 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:35.676530 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-1195c279-471d-4907-a98b-8d4f79612d50 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:35.682986 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1195c279-471d-4907-a98b-8d4f79612d50 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:35.683470 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1195c279-471d-4907-a98b-8d4f79612d50 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:35.684226 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1195c279-471d-4907-a98b-8d4f79612d50 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:35.684661 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1195c279-471d-4907-a98b-8d4f79612d50 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:35.811533 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-1195c279-471d-4907-a98b-8d4f79612d50 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:35.819312 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-1195c279-471d-4907-a98b-8d4f79612d50 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.147222 Jul 11 11:44:35.819873 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1136/2276] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:35 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:36.089167 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-8b4acb26-63a4-45b7-a8fc-b8f60c76a641 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:36.089781 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-8b4acb26-63a4-45b7-a8fc-b8f60c76a641 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:36.096629 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8b4acb26-63a4-45b7-a8fc-b8f60c76a641 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:36.097082 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8b4acb26-63a4-45b7-a8fc-b8f60c76a641 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:36.097844 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8b4acb26-63a4-45b7-a8fc-b8f60c76a641 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:36.098282 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8b4acb26-63a4-45b7-a8fc-b8f60c76a641 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:36.158600 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-8b4acb26-63a4-45b7-a8fc-b8f60c76a641 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:36.166476 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-8b4acb26-63a4-45b7-a8fc-b8f60c76a641 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.082252 Jul 11 11:44:36.167038 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1141/2277] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:36 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:36.486924 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-1658bd1e-e999-451c-9ce7-5b9e591e3998 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:36.487578 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-1658bd1e-e999-451c-9ce7-5b9e591e3998 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:36.494037 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1658bd1e-e999-451c-9ce7-5b9e591e3998 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:36.494478 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1658bd1e-e999-451c-9ce7-5b9e591e3998 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:36.495222 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1658bd1e-e999-451c-9ce7-5b9e591e3998 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:36.495682 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1658bd1e-e999-451c-9ce7-5b9e591e3998 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:36.625328 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-1658bd1e-e999-451c-9ce7-5b9e591e3998 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:36.633818 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-1658bd1e-e999-451c-9ce7-5b9e591e3998 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.150068 Jul 11 11:44:36.634380 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1137/2278] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:36 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:36.836599 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-e5dc5b84-bb3a-4170-96fb-1825c47853d2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:36.837240 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-e5dc5b84-bb3a-4170-96fb-1825c47853d2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:36.843384 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e5dc5b84-bb3a-4170-96fb-1825c47853d2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:36.843835 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e5dc5b84-bb3a-4170-96fb-1825c47853d2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:36.844579 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e5dc5b84-bb3a-4170-96fb-1825c47853d2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:36.845012 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e5dc5b84-bb3a-4170-96fb-1825c47853d2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:36.983674 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-e5dc5b84-bb3a-4170-96fb-1825c47853d2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:36.991452 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-e5dc5b84-bb3a-4170-96fb-1825c47853d2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.158642 Jul 11 11:44:36.992011 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1142/2279] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:36 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:37.183410 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-1ff6b43f-5559-4769-bc72-e5cb4291a444 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:37.184097 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-1ff6b43f-5559-4769-bc72-e5cb4291a444 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:37.190471 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1ff6b43f-5559-4769-bc72-e5cb4291a444 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:37.190918 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1ff6b43f-5559-4769-bc72-e5cb4291a444 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:37.191701 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1ff6b43f-5559-4769-bc72-e5cb4291a444 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:37.192136 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1ff6b43f-5559-4769-bc72-e5cb4291a444 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:37.255856 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-1ff6b43f-5559-4769-bc72-e5cb4291a444 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:37.269183 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-1ff6b43f-5559-4769-bc72-e5cb4291a444 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.089604 Jul 11 11:44:37.269766 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1138/2280] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:37 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:37.650425 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-e199c061-3190-45c3-97c3-04df58bae1e0 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:37.651042 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-e199c061-3190-45c3-97c3-04df58bae1e0 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:37.657506 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e199c061-3190-45c3-97c3-04df58bae1e0 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:37.657962 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e199c061-3190-45c3-97c3-04df58bae1e0 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:37.658721 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e199c061-3190-45c3-97c3-04df58bae1e0 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:37.659154 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e199c061-3190-45c3-97c3-04df58bae1e0 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:37.792238 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-e199c061-3190-45c3-97c3-04df58bae1e0 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:37.800086 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-e199c061-3190-45c3-97c3-04df58bae1e0 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.154099 Jul 11 11:44:37.800660 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1143/2281] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:37 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:38.009543 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-e2eaec18-b59f-42c4-888e-283ed9c42e3f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:38.010159 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-e2eaec18-b59f-42c4-888e-283ed9c42e3f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:38.016413 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e2eaec18-b59f-42c4-888e-283ed9c42e3f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:38.016866 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e2eaec18-b59f-42c4-888e-283ed9c42e3f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:38.017634 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e2eaec18-b59f-42c4-888e-283ed9c42e3f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:38.018077 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e2eaec18-b59f-42c4-888e-283ed9c42e3f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:38.146593 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-e2eaec18-b59f-42c4-888e-283ed9c42e3f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:38.155030 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-e2eaec18-b59f-42c4-888e-283ed9c42e3f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.149912 Jul 11 11:44:38.155635 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1139/2282] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:38 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:38.288836 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-c8143218-e448-4d1d-940e-d1db52bd0fc6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:38.289940 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-c8143218-e448-4d1d-940e-d1db52bd0fc6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:38.295979 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c8143218-e448-4d1d-940e-d1db52bd0fc6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:38.296425 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c8143218-e448-4d1d-940e-d1db52bd0fc6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:38.297172 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c8143218-e448-4d1d-940e-d1db52bd0fc6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:38.297598 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c8143218-e448-4d1d-940e-d1db52bd0fc6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:38.360858 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-c8143218-e448-4d1d-940e-d1db52bd0fc6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:38.369339 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-c8143218-e448-4d1d-940e-d1db52bd0fc6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.084394 Jul 11 11:44:38.369893 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1144/2283] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:38 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:38.817631 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-88f2d920-6395-4949-8d8d-a7b1d06d6c01 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:38.818246 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-88f2d920-6395-4949-8d8d-a7b1d06d6c01 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:38.825095 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-88f2d920-6395-4949-8d8d-a7b1d06d6c01 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:38.825543 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-88f2d920-6395-4949-8d8d-a7b1d06d6c01 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:38.826300 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-88f2d920-6395-4949-8d8d-a7b1d06d6c01 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:38.826734 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-88f2d920-6395-4949-8d8d-a7b1d06d6c01 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:38.954204 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-88f2d920-6395-4949-8d8d-a7b1d06d6c01 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:38.962934 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-88f2d920-6395-4949-8d8d-a7b1d06d6c01 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.148591 Jul 11 11:44:38.963547 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1140/2284] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:38 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:39.173355 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-bb823003-411f-48a3-b001-d895a4a4f820 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:39.173966 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-bb823003-411f-48a3-b001-d895a4a4f820 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:39.180451 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bb823003-411f-48a3-b001-d895a4a4f820 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:39.180904 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bb823003-411f-48a3-b001-d895a4a4f820 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:39.181640 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bb823003-411f-48a3-b001-d895a4a4f820 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:39.182073 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bb823003-411f-48a3-b001-d895a4a4f820 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:39.310163 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-bb823003-411f-48a3-b001-d895a4a4f820 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:39.318054 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-bb823003-411f-48a3-b001-d895a4a4f820 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.148573 Jul 11 11:44:39.318622 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1145/2285] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:39 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:39.385869 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-99c1343d-e37c-47e1-83c2-bc281707ea50 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:39.386447 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-99c1343d-e37c-47e1-83c2-bc281707ea50 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:39.392592 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-99c1343d-e37c-47e1-83c2-bc281707ea50 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:39.393047 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-99c1343d-e37c-47e1-83c2-bc281707ea50 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:39.393806 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-99c1343d-e37c-47e1-83c2-bc281707ea50 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:39.394246 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-99c1343d-e37c-47e1-83c2-bc281707ea50 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:39.458365 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-99c1343d-e37c-47e1-83c2-bc281707ea50 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:39.467106 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-99c1343d-e37c-47e1-83c2-bc281707ea50 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.085179 Jul 11 11:44:39.467710 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1141/2286] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:39 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:39.980009 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-d38dee4f-4247-4bd4-af7f-98603d688968 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:39.980623 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-d38dee4f-4247-4bd4-af7f-98603d688968 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:39.986712 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d38dee4f-4247-4bd4-af7f-98603d688968 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:39.987160 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d38dee4f-4247-4bd4-af7f-98603d688968 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:39.987980 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d38dee4f-4247-4bd4-af7f-98603d688968 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:39.988418 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d38dee4f-4247-4bd4-af7f-98603d688968 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:40.113703 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-d38dee4f-4247-4bd4-af7f-98603d688968 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:40.122123 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-d38dee4f-4247-4bd4-af7f-98603d688968 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.146021 Jul 11 11:44:40.122730 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1146/2287] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:39 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:40.335676 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-3938df42-b6a7-4bde-bd01-70124069f41e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:40.336286 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-3938df42-b6a7-4bde-bd01-70124069f41e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:40.342724 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3938df42-b6a7-4bde-bd01-70124069f41e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:40.343169 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3938df42-b6a7-4bde-bd01-70124069f41e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:40.343954 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3938df42-b6a7-4bde-bd01-70124069f41e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:40.344390 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3938df42-b6a7-4bde-bd01-70124069f41e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:40.469169 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-3938df42-b6a7-4bde-bd01-70124069f41e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:40.477512 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-3938df42-b6a7-4bde-bd01-70124069f41e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.145194 Jul 11 11:44:40.478079 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1142/2288] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:40 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:40.483911 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-964f4518-2de7-46b5-8f84-565ab80872cf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:40.484517 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-964f4518-2de7-46b5-8f84-565ab80872cf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:40.490873 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-964f4518-2de7-46b5-8f84-565ab80872cf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:40.491366 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-964f4518-2de7-46b5-8f84-565ab80872cf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:40.492121 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-964f4518-2de7-46b5-8f84-565ab80872cf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:40.493185 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-964f4518-2de7-46b5-8f84-565ab80872cf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:40.561034 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-964f4518-2de7-46b5-8f84-565ab80872cf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:40.564408 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-964f4518-2de7-46b5-8f84-565ab80872cf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.084278 Jul 11 11:44:40.564996 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1147/2289] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:40 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:44:41.138986 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-d29d7e0e-0531-473a-81f2-fa2437362e7e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:41.139624 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-d29d7e0e-0531-473a-81f2-fa2437362e7e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:41.145801 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d29d7e0e-0531-473a-81f2-fa2437362e7e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:41.146251 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d29d7e0e-0531-473a-81f2-fa2437362e7e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:41.146993 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d29d7e0e-0531-473a-81f2-fa2437362e7e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:41.147457 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d29d7e0e-0531-473a-81f2-fa2437362e7e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:41.273058 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-d29d7e0e-0531-473a-81f2-fa2437362e7e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:41.280870 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-d29d7e0e-0531-473a-81f2-fa2437362e7e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.145721 Jul 11 11:44:41.281435 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1143/2290] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:41 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:41.494444 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-ec3eda88-46bf-4d24-9c52-4ed8a014a39c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:41.495054 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-ec3eda88-46bf-4d24-9c52-4ed8a014a39c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:41.501555 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ec3eda88-46bf-4d24-9c52-4ed8a014a39c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:41.501996 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ec3eda88-46bf-4d24-9c52-4ed8a014a39c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:41.502740 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ec3eda88-46bf-4d24-9c52-4ed8a014a39c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:41.503165 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ec3eda88-46bf-4d24-9c52-4ed8a014a39c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:41.586881 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-09d5f874-4110-4b0b-9e02-c23b57dab7a4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:41.587622 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-09d5f874-4110-4b0b-9e02-c23b57dab7a4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:41.596333 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-09d5f874-4110-4b0b-9e02-c23b57dab7a4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:41.596789 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-09d5f874-4110-4b0b-9e02-c23b57dab7a4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:41.600165 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-09d5f874-4110-4b0b-9e02-c23b57dab7a4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:41.600649 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-09d5f874-4110-4b0b-9e02-c23b57dab7a4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:41.633614 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-ec3eda88-46bf-4d24-9c52-4ed8a014a39c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:41.641803 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-ec3eda88-46bf-4d24-9c52-4ed8a014a39c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.151797 Jul 11 11:44:41.642382 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1148/2291] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:41 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:41.669719 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-09d5f874-4110-4b0b-9e02-c23b57dab7a4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:41.677641 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-09d5f874-4110-4b0b-9e02-c23b57dab7a4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.095100 Jul 11 11:44:41.678211 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1144/2292] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:41 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:44:42.298007 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-820bdda6-8f69-4eb1-9923-67b785d6fd5c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:42.298609 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-820bdda6-8f69-4eb1-9923-67b785d6fd5c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:42.304667 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-820bdda6-8f69-4eb1-9923-67b785d6fd5c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:42.305136 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-820bdda6-8f69-4eb1-9923-67b785d6fd5c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:42.305880 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-820bdda6-8f69-4eb1-9923-67b785d6fd5c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:42.306309 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-820bdda6-8f69-4eb1-9923-67b785d6fd5c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:42.433178 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-820bdda6-8f69-4eb1-9923-67b785d6fd5c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:42.440971 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-820bdda6-8f69-4eb1-9923-67b785d6fd5c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.146837 Jul 11 11:44:42.441573 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1149/2293] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:42 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:42.659391 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-03b6ce32-efe5-406f-8bd9-49fb1881ae88 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:42.659965 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-03b6ce32-efe5-406f-8bd9-49fb1881ae88 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:42.667036 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-03b6ce32-efe5-406f-8bd9-49fb1881ae88 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:42.667508 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-03b6ce32-efe5-406f-8bd9-49fb1881ae88 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:42.668258 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-03b6ce32-efe5-406f-8bd9-49fb1881ae88 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:42.668692 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-03b6ce32-efe5-406f-8bd9-49fb1881ae88 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:42.693749 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-59b20162-6bfb-4a40-b665-f6361a32b36a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:42.694356 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-59b20162-6bfb-4a40-b665-f6361a32b36a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:42.701523 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-59b20162-6bfb-4a40-b665-f6361a32b36a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:42.701965 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-59b20162-6bfb-4a40-b665-f6361a32b36a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:42.702715 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-59b20162-6bfb-4a40-b665-f6361a32b36a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:42.703143 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-59b20162-6bfb-4a40-b665-f6361a32b36a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:42.769881 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-59b20162-6bfb-4a40-b665-f6361a32b36a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:42.778923 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-59b20162-6bfb-4a40-b665-f6361a32b36a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.088895 Jul 11 11:44:42.779549 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1150/2294] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:42 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:44:43.007459 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-03b6ce32-efe5-406f-8bd9-49fb1881ae88 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:43.015769 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-03b6ce32-efe5-406f-8bd9-49fb1881ae88 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.360254 Jul 11 11:44:43.016318 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1145/2295] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:42 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:43.458279 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-4263833c-e900-4669-98a0-33dc8be76659 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:43.458929 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-4263833c-e900-4669-98a0-33dc8be76659 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:43.465028 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4263833c-e900-4669-98a0-33dc8be76659 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:43.465478 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4263833c-e900-4669-98a0-33dc8be76659 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:43.466240 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4263833c-e900-4669-98a0-33dc8be76659 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:43.466674 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4263833c-e900-4669-98a0-33dc8be76659 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:43.592970 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-4263833c-e900-4669-98a0-33dc8be76659 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:43.600801 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-4263833c-e900-4669-98a0-33dc8be76659 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.146409 Jul 11 11:44:43.601375 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1151/2296] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:43 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:43.796303 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-e15caeb9-3e5c-4403-818b-4c9824ce5fb3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:43.796834 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-e15caeb9-3e5c-4403-818b-4c9824ce5fb3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:43.803367 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e15caeb9-3e5c-4403-818b-4c9824ce5fb3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:43.803818 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e15caeb9-3e5c-4403-818b-4c9824ce5fb3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:43.804571 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e15caeb9-3e5c-4403-818b-4c9824ce5fb3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:43.805006 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e15caeb9-3e5c-4403-818b-4c9824ce5fb3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:43.865249 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-e15caeb9-3e5c-4403-818b-4c9824ce5fb3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:43.873405 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-e15caeb9-3e5c-4403-818b-4c9824ce5fb3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.080996 Jul 11 11:44:43.873959 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1146/2297] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:43 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:44:44.033377 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-24248f5f-d6df-4ae3-b730-2f788b1c8815 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:44.033979 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-24248f5f-d6df-4ae3-b730-2f788b1c8815 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:44.041015 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-24248f5f-d6df-4ae3-b730-2f788b1c8815 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:44.041457 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-24248f5f-d6df-4ae3-b730-2f788b1c8815 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:44.042236 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-24248f5f-d6df-4ae3-b730-2f788b1c8815 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:44.042669 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-24248f5f-d6df-4ae3-b730-2f788b1c8815 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:44.169124 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-24248f5f-d6df-4ae3-b730-2f788b1c8815 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:44.177038 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-24248f5f-d6df-4ae3-b730-2f788b1c8815 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.147519 Jul 11 11:44:44.177605 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1152/2298] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:44 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:44.618448 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-f8e36812-ea71-4a68-bf0b-8e77ec47b822 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:44.619088 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-f8e36812-ea71-4a68-bf0b-8e77ec47b822 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:44.625207 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f8e36812-ea71-4a68-bf0b-8e77ec47b822 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:44.625654 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f8e36812-ea71-4a68-bf0b-8e77ec47b822 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:44.626419 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f8e36812-ea71-4a68-bf0b-8e77ec47b822 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:44.626858 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f8e36812-ea71-4a68-bf0b-8e77ec47b822 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:44.753396 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-f8e36812-ea71-4a68-bf0b-8e77ec47b822 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:44.761813 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-f8e36812-ea71-4a68-bf0b-8e77ec47b822 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.147737 Jul 11 11:44:44.762379 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1147/2299] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:44 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:44.890131 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-7bdc1e94-3abc-4f82-bca1-442a89928453 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:44.890669 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-7bdc1e94-3abc-4f82-bca1-442a89928453 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:44.896831 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7bdc1e94-3abc-4f82-bca1-442a89928453 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:44.897279 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7bdc1e94-3abc-4f82-bca1-442a89928453 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:44.898037 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7bdc1e94-3abc-4f82-bca1-442a89928453 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:44.898471 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7bdc1e94-3abc-4f82-bca1-442a89928453 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:44.960908 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-7bdc1e94-3abc-4f82-bca1-442a89928453 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:44.968935 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-7bdc1e94-3abc-4f82-bca1-442a89928453 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.082823 Jul 11 11:44:44.969501 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1153/2300] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:44 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:45.194218 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-24dc9702-7c7f-4f1c-884d-70f18eb2fb0b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:45.194822 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-24dc9702-7c7f-4f1c-884d-70f18eb2fb0b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:45.201543 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-24dc9702-7c7f-4f1c-884d-70f18eb2fb0b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:45.201983 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-24dc9702-7c7f-4f1c-884d-70f18eb2fb0b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:45.202725 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-24dc9702-7c7f-4f1c-884d-70f18eb2fb0b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:45.203152 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-24dc9702-7c7f-4f1c-884d-70f18eb2fb0b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:45.333556 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-24dc9702-7c7f-4f1c-884d-70f18eb2fb0b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:45.341952 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-24dc9702-7c7f-4f1c-884d-70f18eb2fb0b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.151651 Jul 11 11:44:45.342510 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1148/2301] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:45 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:45.779540 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-4ef4b829-1dcf-4790-bc8f-98fb5b27c694 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:45.780152 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-4ef4b829-1dcf-4790-bc8f-98fb5b27c694 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:45.786140 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4ef4b829-1dcf-4790-bc8f-98fb5b27c694 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:45.786587 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4ef4b829-1dcf-4790-bc8f-98fb5b27c694 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:45.787364 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4ef4b829-1dcf-4790-bc8f-98fb5b27c694 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:45.787795 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4ef4b829-1dcf-4790-bc8f-98fb5b27c694 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:45.912477 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-4ef4b829-1dcf-4790-bc8f-98fb5b27c694 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:45.920338 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-4ef4b829-1dcf-4790-bc8f-98fb5b27c694 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.144899 Jul 11 11:44:45.920913 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1154/2302] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:45 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:45.989669 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-4d861744-e8ff-44e3-8d73-af934bc457d7 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:45.990308 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-4d861744-e8ff-44e3-8d73-af934bc457d7 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:45.996514 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4d861744-e8ff-44e3-8d73-af934bc457d7 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:45.996955 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4d861744-e8ff-44e3-8d73-af934bc457d7 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:45.997695 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4d861744-e8ff-44e3-8d73-af934bc457d7 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:45.998127 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4d861744-e8ff-44e3-8d73-af934bc457d7 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:46.058413 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-4d861744-e8ff-44e3-8d73-af934bc457d7 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:46.066422 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-4d861744-e8ff-44e3-8d73-af934bc457d7 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.080517 Jul 11 11:44:46.066992 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1149/2303] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:45 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:46.358916 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-f46e848b-ad2f-4542-9fbb-62e536264112 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:46.359492 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-f46e848b-ad2f-4542-9fbb-62e536264112 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:46.365463 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f46e848b-ad2f-4542-9fbb-62e536264112 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:46.365910 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f46e848b-ad2f-4542-9fbb-62e536264112 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:46.366662 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f46e848b-ad2f-4542-9fbb-62e536264112 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:46.367091 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f46e848b-ad2f-4542-9fbb-62e536264112 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:46.491738 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-f46e848b-ad2f-4542-9fbb-62e536264112 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:46.500055 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-f46e848b-ad2f-4542-9fbb-62e536264112 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.144988 Jul 11 11:44:46.500622 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1155/2304] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:46 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:46.937816 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-fc8fe0d5-a635-4954-acb1-a91a55f2cc93 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:46.938424 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-fc8fe0d5-a635-4954-acb1-a91a55f2cc93 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:46.944460 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fc8fe0d5-a635-4954-acb1-a91a55f2cc93 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:46.944911 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fc8fe0d5-a635-4954-acb1-a91a55f2cc93 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:46.945699 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fc8fe0d5-a635-4954-acb1-a91a55f2cc93 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:46.946134 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fc8fe0d5-a635-4954-acb1-a91a55f2cc93 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:47.073859 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-fc8fe0d5-a635-4954-acb1-a91a55f2cc93 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:47.082191 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-fc8fe0d5-a635-4954-acb1-a91a55f2cc93 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.148215 Jul 11 11:44:47.082761 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1150/2305] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:46 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:47.084714 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-79c0ad7c-478a-405a-83c9-9056d2ffc7f0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:47.085331 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-79c0ad7c-478a-405a-83c9-9056d2ffc7f0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:47.092700 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-79c0ad7c-478a-405a-83c9-9056d2ffc7f0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:47.093145 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-79c0ad7c-478a-405a-83c9-9056d2ffc7f0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:47.094134 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-79c0ad7c-478a-405a-83c9-9056d2ffc7f0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:47.094605 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-79c0ad7c-478a-405a-83c9-9056d2ffc7f0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:47.158358 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-79c0ad7c-478a-405a-83c9-9056d2ffc7f0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:47.166750 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-79c0ad7c-478a-405a-83c9-9056d2ffc7f0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.085970 Jul 11 11:44:47.167335 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1156/2306] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:47 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:44:47.517241 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-cdcf6a83-6237-434e-b87c-11d2b85b9ef1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:47.517854 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-cdcf6a83-6237-434e-b87c-11d2b85b9ef1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:47.524428 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cdcf6a83-6237-434e-b87c-11d2b85b9ef1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:47.524872 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cdcf6a83-6237-434e-b87c-11d2b85b9ef1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:47.525620 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cdcf6a83-6237-434e-b87c-11d2b85b9ef1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:47.526055 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cdcf6a83-6237-434e-b87c-11d2b85b9ef1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:47.541154 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=100 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:44:47.652317 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-cdcf6a83-6237-434e-b87c-11d2b85b9ef1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:47.660182 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-cdcf6a83-6237-434e-b87c-11d2b85b9ef1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.146815 Jul 11 11:44:47.660748 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1151/2307] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:47 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:48.099553 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-13af1193-c65a-4356-9763-0dcb3e01cac0 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:48.100172 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-13af1193-c65a-4356-9763-0dcb3e01cac0 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:48.106618 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-13af1193-c65a-4356-9763-0dcb3e01cac0 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:48.107059 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-13af1193-c65a-4356-9763-0dcb3e01cac0 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:48.107853 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-13af1193-c65a-4356-9763-0dcb3e01cac0 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:48.108287 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-13af1193-c65a-4356-9763-0dcb3e01cac0 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:48.123056 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=100 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:44:48.184076 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-ce5408a3-b0be-4883-b68a-acbb69ca382b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:48.184662 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-ce5408a3-b0be-4883-b68a-acbb69ca382b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:48.191229 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ce5408a3-b0be-4883-b68a-acbb69ca382b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:48.191695 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ce5408a3-b0be-4883-b68a-acbb69ca382b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:48.192448 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ce5408a3-b0be-4883-b68a-acbb69ca382b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:48.192881 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ce5408a3-b0be-4883-b68a-acbb69ca382b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:48.239770 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-13af1193-c65a-4356-9763-0dcb3e01cac0 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:48.247957 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-13af1193-c65a-4356-9763-0dcb3e01cac0 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.152214 Jul 11 11:44:48.248539 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1157/2308] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:48 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:48.254476 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-ce5408a3-b0be-4883-b68a-acbb69ca382b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:48.263028 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-ce5408a3-b0be-4883-b68a-acbb69ca382b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.082938 Jul 11 11:44:48.263634 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1152/2309] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:48 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:44:48.677869 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-4c9712b0-323b-417a-b117-ed8fedd8eedf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:48.678473 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-4c9712b0-323b-417a-b117-ed8fedd8eedf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:48.685150 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4c9712b0-323b-417a-b117-ed8fedd8eedf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:48.685591 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4c9712b0-323b-417a-b117-ed8fedd8eedf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:48.686388 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4c9712b0-323b-417a-b117-ed8fedd8eedf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:48.686819 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4c9712b0-323b-417a-b117-ed8fedd8eedf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:48.810278 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-4c9712b0-323b-417a-b117-ed8fedd8eedf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:48.818149 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-4c9712b0-323b-417a-b117-ed8fedd8eedf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.144084 Jul 11 11:44:48.818712 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1158/2310] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:48 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:49.265162 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-5e464dee-ace0-4e27-8bc8-470f821ca1e4 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:49.265767 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-5e464dee-ace0-4e27-8bc8-470f821ca1e4 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:49.272355 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5e464dee-ace0-4e27-8bc8-470f821ca1e4 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:49.272802 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5e464dee-ace0-4e27-8bc8-470f821ca1e4 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:49.274072 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5e464dee-ace0-4e27-8bc8-470f821ca1e4 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:49.274503 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5e464dee-ace0-4e27-8bc8-470f821ca1e4 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:49.280299 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-7603850c-8d48-42b4-b19c-d11008953f06 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:49.280916 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-7603850c-8d48-42b4-b19c-d11008953f06 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:49.287628 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7603850c-8d48-42b4-b19c-d11008953f06 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:49.288084 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7603850c-8d48-42b4-b19c-d11008953f06 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:49.288863 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7603850c-8d48-42b4-b19c-d11008953f06 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:49.289893 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7603850c-8d48-42b4-b19c-d11008953f06 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:49.361870 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-7603850c-8d48-42b4-b19c-d11008953f06 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:49.369880 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-7603850c-8d48-42b4-b19c-d11008953f06 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.093432 Jul 11 11:44:49.370449 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1159/2311] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:49 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:44:49.416509 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-5e464dee-ace0-4e27-8bc8-470f821ca1e4 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:49.424301 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-5e464dee-ace0-4e27-8bc8-470f821ca1e4 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.163003 Jul 11 11:44:49.424891 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1153/2312] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:49 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:49.835645 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-ddb18787-d915-4a4b-b803-86ed866a2473 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:49.836257 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-ddb18787-d915-4a4b-b803-86ed866a2473 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:49.842204 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ddb18787-d915-4a4b-b803-86ed866a2473 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:49.842645 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ddb18787-d915-4a4b-b803-86ed866a2473 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:49.843422 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ddb18787-d915-4a4b-b803-86ed866a2473 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:49.843855 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ddb18787-d915-4a4b-b803-86ed866a2473 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:49.969099 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-ddb18787-d915-4a4b-b803-86ed866a2473 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:49.976945 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-ddb18787-d915-4a4b-b803-86ed866a2473 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.145156 Jul 11 11:44:49.977513 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1160/2313] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:49 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:50.385760 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-b301e856-e393-4a32-b341-a88fb25d3572 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:50.386366 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-b301e856-e393-4a32-b341-a88fb25d3572 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:50.392829 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b301e856-e393-4a32-b341-a88fb25d3572 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:50.393274 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b301e856-e393-4a32-b341-a88fb25d3572 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:50.394016 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b301e856-e393-4a32-b341-a88fb25d3572 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:50.394444 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b301e856-e393-4a32-b341-a88fb25d3572 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:50.440991 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-ef2f962f-59ac-4c01-a2cc-273cd5005b4a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:50.441601 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-ef2f962f-59ac-4c01-a2cc-273cd5005b4a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:50.448368 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ef2f962f-59ac-4c01-a2cc-273cd5005b4a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:50.448814 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ef2f962f-59ac-4c01-a2cc-273cd5005b4a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:50.449567 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ef2f962f-59ac-4c01-a2cc-273cd5005b4a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:50.450002 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ef2f962f-59ac-4c01-a2cc-273cd5005b4a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:50.454798 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-b301e856-e393-4a32-b341-a88fb25d3572 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:50.462769 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-b301e856-e393-4a32-b341-a88fb25d3572 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.080820 Jul 11 11:44:50.463355 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1154/2314] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:50 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:50.576219 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-ef2f962f-59ac-4c01-a2cc-273cd5005b4a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:50.583985 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-ef2f962f-59ac-4c01-a2cc-273cd5005b4a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.146851 Jul 11 11:44:50.584550 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1161/2315] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:50 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:44:50.993739 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-8eb7ea29-90ca-4ae5-8f77-bc0f5c198fd6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:50.994353 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-8eb7ea29-90ca-4ae5-8f77-bc0f5c198fd6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:51.000554 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8eb7ea29-90ca-4ae5-8f77-bc0f5c198fd6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:51.000997 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8eb7ea29-90ca-4ae5-8f77-bc0f5c198fd6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:51.001750 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8eb7ea29-90ca-4ae5-8f77-bc0f5c198fd6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:51.002182 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8eb7ea29-90ca-4ae5-8f77-bc0f5c198fd6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:51.130178 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-8eb7ea29-90ca-4ae5-8f77-bc0f5c198fd6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:51.138539 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-8eb7ea29-90ca-4ae5-8f77-bc0f5c198fd6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.148630 Jul 11 11:44:51.139102 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1155/2316] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:50 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:51.480113 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-8f1f5b6f-1ab4-475c-ad8d-c91725710838 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:51.480716 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-8f1f5b6f-1ab4-475c-ad8d-c91725710838 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:51.487086 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8f1f5b6f-1ab4-475c-ad8d-c91725710838 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:51.487558 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8f1f5b6f-1ab4-475c-ad8d-c91725710838 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:51.488331 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8f1f5b6f-1ab4-475c-ad8d-c91725710838 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:51.488759 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8f1f5b6f-1ab4-475c-ad8d-c91725710838 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:51.552057 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-8f1f5b6f-1ab4-475c-ad8d-c91725710838 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:51.559933 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-8f1f5b6f-1ab4-475c-ad8d-c91725710838 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.084218 Jul 11 11:44:51.560493 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1162/2317] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:51 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:51.601030 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-0afdb38a-f90a-4cf8-b156-50a93b41dbf8 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:51.601668 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-0afdb38a-f90a-4cf8-b156-50a93b41dbf8 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:51.604669 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_api:SELECT=78 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:44:51.609413 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0afdb38a-f90a-4cf8-b156-50a93b41dbf8 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:51.609850 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0afdb38a-f90a-4cf8-b156-50a93b41dbf8 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:51.610595 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0afdb38a-f90a-4cf8-b156-50a93b41dbf8 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:51.611023 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0afdb38a-f90a-4cf8-b156-50a93b41dbf8 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:51.754004 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-0afdb38a-f90a-4cf8-b156-50a93b41dbf8 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:51.765661 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-0afdb38a-f90a-4cf8-b156-50a93b41dbf8 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.168393 Jul 11 11:44:51.766232 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1156/2318] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:51 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:52.155707 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-62cb3aea-996a-45e2-9629-f51ce699feb2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:52.156320 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-62cb3aea-996a-45e2-9629-f51ce699feb2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:52.158152 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_api:SELECT=82 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:44:52.162815 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-62cb3aea-996a-45e2-9629-f51ce699feb2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:52.163278 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-62cb3aea-996a-45e2-9629-f51ce699feb2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:52.164073 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-62cb3aea-996a-45e2-9629-f51ce699feb2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:52.164501 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-62cb3aea-996a-45e2-9629-f51ce699feb2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:52.293034 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-62cb3aea-996a-45e2-9629-f51ce699feb2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:52.301393 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-62cb3aea-996a-45e2-9629-f51ce699feb2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.149459 Jul 11 11:44:52.301990 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1163/2319] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:52 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:52.577094 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-d814d1cf-033a-442a-be86-762d70b3ffb2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:52.577699 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-d814d1cf-033a-442a-be86-762d70b3ffb2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:52.583694 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d814d1cf-033a-442a-be86-762d70b3ffb2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:52.584141 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d814d1cf-033a-442a-be86-762d70b3ffb2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:52.584917 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d814d1cf-033a-442a-be86-762d70b3ffb2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:52.585351 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d814d1cf-033a-442a-be86-762d70b3ffb2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:52.645499 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-d814d1cf-033a-442a-be86-762d70b3ffb2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:52.653510 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-d814d1cf-033a-442a-be86-762d70b3ffb2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.080298 Jul 11 11:44:52.654055 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1157/2320] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:52 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:52.783136 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-1509a1d9-eb1a-4e83-b187-898ee4fb1fc3 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:52.783768 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-1509a1d9-eb1a-4e83-b187-898ee4fb1fc3 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:52.790805 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1509a1d9-eb1a-4e83-b187-898ee4fb1fc3 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:52.791275 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1509a1d9-eb1a-4e83-b187-898ee4fb1fc3 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:52.792035 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1509a1d9-eb1a-4e83-b187-898ee4fb1fc3 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:52.792461 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1509a1d9-eb1a-4e83-b187-898ee4fb1fc3 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:52.919634 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-1509a1d9-eb1a-4e83-b187-898ee4fb1fc3 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:52.927337 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-1509a1d9-eb1a-4e83-b187-898ee4fb1fc3 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.148015 Jul 11 11:44:52.927901 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1164/2321] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:52 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:53.323206 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-18322b5f-b009-4e80-a05b-2786083ee568 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:53.323827 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-18322b5f-b009-4e80-a05b-2786083ee568 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:53.330311 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-18322b5f-b009-4e80-a05b-2786083ee568 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:53.330755 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-18322b5f-b009-4e80-a05b-2786083ee568 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:53.331524 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-18322b5f-b009-4e80-a05b-2786083ee568 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:53.331955 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-18322b5f-b009-4e80-a05b-2786083ee568 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:53.461739 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-18322b5f-b009-4e80-a05b-2786083ee568 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:53.469959 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-18322b5f-b009-4e80-a05b-2786083ee568 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.150768 Jul 11 11:44:53.470536 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1158/2322] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:53 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:53.670409 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-49e3c618-1ca5-4285-af4f-946175d0a74b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:53.671023 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-49e3c618-1ca5-4285-af4f-946175d0a74b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:53.677014 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-49e3c618-1ca5-4285-af4f-946175d0a74b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:53.677456 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-49e3c618-1ca5-4285-af4f-946175d0a74b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:53.678210 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-49e3c618-1ca5-4285-af4f-946175d0a74b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:53.678643 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-49e3c618-1ca5-4285-af4f-946175d0a74b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:53.741062 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-49e3c618-1ca5-4285-af4f-946175d0a74b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:53.750400 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-49e3c618-1ca5-4285-af4f-946175d0a74b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.083765 Jul 11 11:44:53.750972 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1165/2323] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:53 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:53.944356 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-6f14f701-d564-4f94-a2e3-74d49fd81619 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:53.944901 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-6f14f701-d564-4f94-a2e3-74d49fd81619 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:53.952185 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6f14f701-d564-4f94-a2e3-74d49fd81619 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:53.952645 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6f14f701-d564-4f94-a2e3-74d49fd81619 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:53.953399 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6f14f701-d564-4f94-a2e3-74d49fd81619 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:53.953838 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6f14f701-d564-4f94-a2e3-74d49fd81619 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:54.081330 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-6f14f701-d564-4f94-a2e3-74d49fd81619 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:54.089791 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-6f14f701-d564-4f94-a2e3-74d49fd81619 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.149513 Jul 11 11:44:54.090348 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1159/2324] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:53 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:54.487704 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-1eac3864-8f23-401b-bff7-a836556b7852 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:54.488372 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-1eac3864-8f23-401b-bff7-a836556b7852 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:54.495345 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1eac3864-8f23-401b-bff7-a836556b7852 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:54.495792 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1eac3864-8f23-401b-bff7-a836556b7852 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:54.496544 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1eac3864-8f23-401b-bff7-a836556b7852 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:54.496982 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1eac3864-8f23-401b-bff7-a836556b7852 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:54.622996 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-1eac3864-8f23-401b-bff7-a836556b7852 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:54.630890 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-1eac3864-8f23-401b-bff7-a836556b7852 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.146999 Jul 11 11:44:54.631495 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1166/2325] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:54 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:54.767188 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-bfc723a8-8c56-48bd-bb4b-178c1b08847c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:54.767827 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-bfc723a8-8c56-48bd-bb4b-178c1b08847c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:54.773843 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-bfc723a8-8c56-48bd-bb4b-178c1b08847c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:54.774288 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-bfc723a8-8c56-48bd-bb4b-178c1b08847c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:54.775038 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-bfc723a8-8c56-48bd-bb4b-178c1b08847c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:54.775506 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-bfc723a8-8c56-48bd-bb4b-178c1b08847c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:54.835418 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-bfc723a8-8c56-48bd-bb4b-178c1b08847c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:54.843292 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-bfc723a8-8c56-48bd-bb4b-178c1b08847c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.079829 Jul 11 11:44:54.843859 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1160/2326] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:54 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:55.107189 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-00bab8dc-ae34-48e1-a832-b099d5023d40 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:55.107767 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-00bab8dc-ae34-48e1-a832-b099d5023d40 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:55.113922 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-00bab8dc-ae34-48e1-a832-b099d5023d40 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:55.114371 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-00bab8dc-ae34-48e1-a832-b099d5023d40 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:55.115169 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-00bab8dc-ae34-48e1-a832-b099d5023d40 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:55.115626 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-00bab8dc-ae34-48e1-a832-b099d5023d40 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:55.240346 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-00bab8dc-ae34-48e1-a832-b099d5023d40 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:55.248146 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-00bab8dc-ae34-48e1-a832-b099d5023d40 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.144826 Jul 11 11:44:55.248712 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1167/2327] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:55 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:55.651099 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-5984b210-deb0-47d4-a3a5-a868fcf52261 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:55.651895 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-5984b210-deb0-47d4-a3a5-a868fcf52261 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:55.658534 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5984b210-deb0-47d4-a3a5-a868fcf52261 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:55.658991 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5984b210-deb0-47d4-a3a5-a868fcf52261 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:55.659802 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5984b210-deb0-47d4-a3a5-a868fcf52261 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:55.660243 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5984b210-deb0-47d4-a3a5-a868fcf52261 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:55.796521 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-5984b210-deb0-47d4-a3a5-a868fcf52261 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:55.804993 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-5984b210-deb0-47d4-a3a5-a868fcf52261 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.159528 Jul 11 11:44:55.805575 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1161/2328] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:55 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:55.860693 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-2f7c533f-bfd9-49a7-aea2-6005aa4dcf27 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:55.861306 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-2f7c533f-bfd9-49a7-aea2-6005aa4dcf27 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:55.868415 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2f7c533f-bfd9-49a7-aea2-6005aa4dcf27 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:55.868863 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2f7c533f-bfd9-49a7-aea2-6005aa4dcf27 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:55.869619 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2f7c533f-bfd9-49a7-aea2-6005aa4dcf27 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:55.870055 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2f7c533f-bfd9-49a7-aea2-6005aa4dcf27 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:55.933104 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-2f7c533f-bfd9-49a7-aea2-6005aa4dcf27 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:55.940897 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-2f7c533f-bfd9-49a7-aea2-6005aa4dcf27 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.084001 Jul 11 11:44:55.941464 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1168/2329] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:55 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:56.264922 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-92247d3d-86b0-49eb-9267-16c68c5fe4d8 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:56.265522 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-92247d3d-86b0-49eb-9267-16c68c5fe4d8 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:56.271515 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-92247d3d-86b0-49eb-9267-16c68c5fe4d8 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:56.271957 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-92247d3d-86b0-49eb-9267-16c68c5fe4d8 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:56.272699 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-92247d3d-86b0-49eb-9267-16c68c5fe4d8 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:56.273220 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-92247d3d-86b0-49eb-9267-16c68c5fe4d8 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:56.404690 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-92247d3d-86b0-49eb-9267-16c68c5fe4d8 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:56.412423 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-92247d3d-86b0-49eb-9267-16c68c5fe4d8 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.151317 Jul 11 11:44:56.412978 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1162/2330] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:56 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:56.823505 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-5fb2f252-f375-49e2-b3dc-e816022925f8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:56.824114 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-5fb2f252-f375-49e2-b3dc-e816022925f8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:56.830171 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5fb2f252-f375-49e2-b3dc-e816022925f8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:56.830621 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5fb2f252-f375-49e2-b3dc-e816022925f8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:56.831397 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5fb2f252-f375-49e2-b3dc-e816022925f8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:56.831830 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5fb2f252-f375-49e2-b3dc-e816022925f8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:56.956205 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-5fb2f252-f375-49e2-b3dc-e816022925f8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:56.958989 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-09edf2fe-2d23-48b9-84e6-4e37aa372950 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:56.959707 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-09edf2fe-2d23-48b9-84e6-4e37aa372950 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:56.964156 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-5fb2f252-f375-49e2-b3dc-e816022925f8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.145404 Jul 11 11:44:56.964783 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1169/2331] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:56 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:56.966295 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-09edf2fe-2d23-48b9-84e6-4e37aa372950 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:56.966738 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-09edf2fe-2d23-48b9-84e6-4e37aa372950 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:56.967955 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-09edf2fe-2d23-48b9-84e6-4e37aa372950 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:56.968386 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-09edf2fe-2d23-48b9-84e6-4e37aa372950 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:57.028794 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-09edf2fe-2d23-48b9-84e6-4e37aa372950 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:57.036650 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-09edf2fe-2d23-48b9-84e6-4e37aa372950 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.081659 Jul 11 11:44:57.037229 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1163/2332] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:56 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:57.429696 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-713be82f-6555-4c67-a023-259b80d099ad tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:57.430302 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-713be82f-6555-4c67-a023-259b80d099ad tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:57.436643 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-713be82f-6555-4c67-a023-259b80d099ad tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:57.437088 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-713be82f-6555-4c67-a023-259b80d099ad tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:57.437841 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-713be82f-6555-4c67-a023-259b80d099ad tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:57.438275 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-713be82f-6555-4c67-a023-259b80d099ad tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:57.573028 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-713be82f-6555-4c67-a023-259b80d099ad tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:57.582111 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-713be82f-6555-4c67-a023-259b80d099ad tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.156158 Jul 11 11:44:57.582711 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1170/2333] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:57 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:57.981262 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-908dca3f-9d10-45c5-acc5-8d415c5379a5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:57.981850 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-908dca3f-9d10-45c5-acc5-8d415c5379a5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:57.988454 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-908dca3f-9d10-45c5-acc5-8d415c5379a5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:57.988941 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-908dca3f-9d10-45c5-acc5-8d415c5379a5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:57.989708 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-908dca3f-9d10-45c5-acc5-8d415c5379a5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:57.990142 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-908dca3f-9d10-45c5-acc5-8d415c5379a5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:58.054006 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-99fdc268-fa33-4335-a037-217d117b449e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:58.055244 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-99fdc268-fa33-4335-a037-217d117b449e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:58.061515 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-99fdc268-fa33-4335-a037-217d117b449e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:58.061967 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-99fdc268-fa33-4335-a037-217d117b449e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:58.062740 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-99fdc268-fa33-4335-a037-217d117b449e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:58.063181 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-99fdc268-fa33-4335-a037-217d117b449e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:58.124796 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-908dca3f-9d10-45c5-acc5-8d415c5379a5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:58.128495 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-99fdc268-fa33-4335-a037-217d117b449e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:58.134283 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-908dca3f-9d10-45c5-acc5-8d415c5379a5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.156477 Jul 11 11:44:58.136478 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1164/2334] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:57 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:44:58.139171 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-99fdc268-fa33-4335-a037-217d117b449e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.088996 Jul 11 11:44:58.139940 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1171/2335] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:58 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:44:58.599792 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-ff2a2d59-6d24-4dea-b7da-0f5308629c93 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:58.600393 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-ff2a2d59-6d24-4dea-b7da-0f5308629c93 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:58.606906 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ff2a2d59-6d24-4dea-b7da-0f5308629c93 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:58.607380 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ff2a2d59-6d24-4dea-b7da-0f5308629c93 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:58.608129 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ff2a2d59-6d24-4dea-b7da-0f5308629c93 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:58.608563 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ff2a2d59-6d24-4dea-b7da-0f5308629c93 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:58.732499 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-ff2a2d59-6d24-4dea-b7da-0f5308629c93 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:58.740275 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-ff2a2d59-6d24-4dea-b7da-0f5308629c93 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.144389 Jul 11 11:44:58.740845 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1165/2336] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:58 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:59.151599 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-a79fc6c5-6fdc-49f2-bdaf-d634fd356c70 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:59.152416 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-a79fc6c5-6fdc-49f2-bdaf-d634fd356c70 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:59.155368 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-dc65c1f2-e9d3-4eea-bb6f-b6ebdbed33b1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:59.155981 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-dc65c1f2-e9d3-4eea-bb6f-b6ebdbed33b1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:59.159025 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a79fc6c5-6fdc-49f2-bdaf-d634fd356c70 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:59.159505 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a79fc6c5-6fdc-49f2-bdaf-d634fd356c70 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:59.160502 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a79fc6c5-6fdc-49f2-bdaf-d634fd356c70 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:59.161139 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a79fc6c5-6fdc-49f2-bdaf-d634fd356c70 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:59.162859 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-dc65c1f2-e9d3-4eea-bb6f-b6ebdbed33b1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:59.163370 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-dc65c1f2-e9d3-4eea-bb6f-b6ebdbed33b1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:59.164710 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-dc65c1f2-e9d3-4eea-bb6f-b6ebdbed33b1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:59.165150 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-dc65c1f2-e9d3-4eea-bb6f-b6ebdbed33b1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:59.228167 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-dc65c1f2-e9d3-4eea-bb6f-b6ebdbed33b1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:59.236078 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-dc65c1f2-e9d3-4eea-bb6f-b6ebdbed33b1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.084504 Jul 11 11:44:59.236659 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1166/2337] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:59 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:44:59.398825 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-a79fc6c5-6fdc-49f2-bdaf-d634fd356c70 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:59.406839 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-a79fc6c5-6fdc-49f2-bdaf-d634fd356c70 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.259667 Jul 11 11:44:59.407448 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1172/2338] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:59 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:44:59.757480 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-2bb38857-5f3b-4dbf-87f4-81cea7a91168 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:44:59.758093 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-2bb38857-5f3b-4dbf-87f4-81cea7a91168 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:44:59.764136 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2bb38857-5f3b-4dbf-87f4-81cea7a91168 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:59.764583 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2bb38857-5f3b-4dbf-87f4-81cea7a91168 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:59.765332 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2bb38857-5f3b-4dbf-87f4-81cea7a91168 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:44:59.765762 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2bb38857-5f3b-4dbf-87f4-81cea7a91168 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:44:59.902862 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-2bb38857-5f3b-4dbf-87f4-81cea7a91168 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:44:59.910865 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-2bb38857-5f3b-4dbf-87f4-81cea7a91168 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.157195 Jul 11 11:44:59.911468 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1167/2339] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:44:59 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:00.253561 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-d0e07a79-7c27-4e8d-a672-340a8defd5d4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:00.254170 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-d0e07a79-7c27-4e8d-a672-340a8defd5d4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:00.261411 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d0e07a79-7c27-4e8d-a672-340a8defd5d4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:00.261863 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d0e07a79-7c27-4e8d-a672-340a8defd5d4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:00.262625 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d0e07a79-7c27-4e8d-a672-340a8defd5d4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:00.263100 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d0e07a79-7c27-4e8d-a672-340a8defd5d4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:00.324057 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-d0e07a79-7c27-4e8d-a672-340a8defd5d4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:00.331812 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-d0e07a79-7c27-4e8d-a672-340a8defd5d4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.082115 Jul 11 11:45:00.332373 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1173/2340] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:00 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:00.424430 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-cb74ad3b-fa49-440a-8d55-f524d75d2faf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:00.425048 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-cb74ad3b-fa49-440a-8d55-f524d75d2faf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:00.432084 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cb74ad3b-fa49-440a-8d55-f524d75d2faf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:00.432536 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cb74ad3b-fa49-440a-8d55-f524d75d2faf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:00.433298 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cb74ad3b-fa49-440a-8d55-f524d75d2faf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:00.433735 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cb74ad3b-fa49-440a-8d55-f524d75d2faf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:00.437594 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=100 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:45:00.559816 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-cb74ad3b-fa49-440a-8d55-f524d75d2faf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:00.567622 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-cb74ad3b-fa49-440a-8d55-f524d75d2faf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.146993 Jul 11 11:45:00.568188 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1168/2341] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:00 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:00.928118 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-19acd9df-2d3d-4da1-91c5-23ee77f63426 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:00.928731 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-19acd9df-2d3d-4da1-91c5-23ee77f63426 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:00.935368 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-19acd9df-2d3d-4da1-91c5-23ee77f63426 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:00.935813 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-19acd9df-2d3d-4da1-91c5-23ee77f63426 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:00.936563 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-19acd9df-2d3d-4da1-91c5-23ee77f63426 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:00.936994 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-19acd9df-2d3d-4da1-91c5-23ee77f63426 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:00.940802 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=100 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:45:01.066072 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-19acd9df-2d3d-4da1-91c5-23ee77f63426 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:01.074300 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-19acd9df-2d3d-4da1-91c5-23ee77f63426 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.150005 Jul 11 11:45:01.074875 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1174/2342] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:00 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:01.348125 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-182515e5-5b2a-4323-9883-a7e3860e7c8f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:01.348655 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-182515e5-5b2a-4323-9883-a7e3860e7c8f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:01.355270 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-182515e5-5b2a-4323-9883-a7e3860e7c8f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:01.355730 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-182515e5-5b2a-4323-9883-a7e3860e7c8f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:01.356473 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-182515e5-5b2a-4323-9883-a7e3860e7c8f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:01.356906 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-182515e5-5b2a-4323-9883-a7e3860e7c8f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:01.419621 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-182515e5-5b2a-4323-9883-a7e3860e7c8f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:01.427388 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-182515e5-5b2a-4323-9883-a7e3860e7c8f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.083086 Jul 11 11:45:01.427979 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1169/2343] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:01 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:01.586234 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-9e8c09cb-b65a-4e4b-af3f-b837940ce5d2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:01.586869 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-9e8c09cb-b65a-4e4b-af3f-b837940ce5d2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:01.593323 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9e8c09cb-b65a-4e4b-af3f-b837940ce5d2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:01.593765 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9e8c09cb-b65a-4e4b-af3f-b837940ce5d2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:01.594514 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9e8c09cb-b65a-4e4b-af3f-b837940ce5d2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:01.594941 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9e8c09cb-b65a-4e4b-af3f-b837940ce5d2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:01.722480 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-9e8c09cb-b65a-4e4b-af3f-b837940ce5d2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:01.730467 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-9e8c09cb-b65a-4e4b-af3f-b837940ce5d2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.148621 Jul 11 11:45:01.731036 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1175/2344] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:01 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:02.091096 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-23e2af52-25fc-44d4-9bb9-2b68f69602d6 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:02.091734 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-23e2af52-25fc-44d4-9bb9-2b68f69602d6 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:02.098144 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-23e2af52-25fc-44d4-9bb9-2b68f69602d6 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:02.098589 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-23e2af52-25fc-44d4-9bb9-2b68f69602d6 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:02.099372 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-23e2af52-25fc-44d4-9bb9-2b68f69602d6 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:02.099845 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-23e2af52-25fc-44d4-9bb9-2b68f69602d6 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:02.225544 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-23e2af52-25fc-44d4-9bb9-2b68f69602d6 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:02.233877 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-23e2af52-25fc-44d4-9bb9-2b68f69602d6 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.146602 Jul 11 11:45:02.234445 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1170/2345] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:02 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:02.443159 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-bf0b87b2-7cf9-44ea-8821-794f9e2fcba6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:02.443829 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-bf0b87b2-7cf9-44ea-8821-794f9e2fcba6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:02.450029 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bf0b87b2-7cf9-44ea-8821-794f9e2fcba6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:02.450503 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bf0b87b2-7cf9-44ea-8821-794f9e2fcba6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:02.451267 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bf0b87b2-7cf9-44ea-8821-794f9e2fcba6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:02.451708 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bf0b87b2-7cf9-44ea-8821-794f9e2fcba6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:02.511111 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-bf0b87b2-7cf9-44ea-8821-794f9e2fcba6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:02.518942 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-bf0b87b2-7cf9-44ea-8821-794f9e2fcba6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.079585 Jul 11 11:45:02.519542 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1176/2346] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:02 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:02.746814 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-0e521baa-9e81-4c54-b5e3-1c7f43cb44a4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:02.747481 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-0e521baa-9e81-4c54-b5e3-1c7f43cb44a4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:02.753389 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0e521baa-9e81-4c54-b5e3-1c7f43cb44a4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:02.753839 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0e521baa-9e81-4c54-b5e3-1c7f43cb44a4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:02.754598 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0e521baa-9e81-4c54-b5e3-1c7f43cb44a4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:02.755035 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0e521baa-9e81-4c54-b5e3-1c7f43cb44a4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:02.880606 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-0e521baa-9e81-4c54-b5e3-1c7f43cb44a4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:02.888871 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-0e521baa-9e81-4c54-b5e3-1c7f43cb44a4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.146019 Jul 11 11:45:02.889430 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1171/2347] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:02 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:03.250979 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-5a28ae9b-b106-45bb-8089-aaaeed261dfe tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:03.251621 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-5a28ae9b-b106-45bb-8089-aaaeed261dfe tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:03.258104 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5a28ae9b-b106-45bb-8089-aaaeed261dfe tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:03.258540 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5a28ae9b-b106-45bb-8089-aaaeed261dfe tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:03.259305 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5a28ae9b-b106-45bb-8089-aaaeed261dfe tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:03.259734 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5a28ae9b-b106-45bb-8089-aaaeed261dfe tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:03.386627 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-5a28ae9b-b106-45bb-8089-aaaeed261dfe tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:03.394399 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-5a28ae9b-b106-45bb-8089-aaaeed261dfe tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.147262 Jul 11 11:45:03.394960 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1177/2348] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:03 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:03.536352 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-48f7467d-2986-41d8-9682-0cb617f83b20 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:03.536956 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-48f7467d-2986-41d8-9682-0cb617f83b20 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:03.544249 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-48f7467d-2986-41d8-9682-0cb617f83b20 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:03.544855 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-48f7467d-2986-41d8-9682-0cb617f83b20 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:03.545602 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-48f7467d-2986-41d8-9682-0cb617f83b20 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:03.546068 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-48f7467d-2986-41d8-9682-0cb617f83b20 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:03.612840 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-48f7467d-2986-41d8-9682-0cb617f83b20 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:03.620738 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-48f7467d-2986-41d8-9682-0cb617f83b20 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.088303 Jul 11 11:45:03.621306 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1172/2349] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:03 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:03.906087 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-5f7b8ec5-a6ac-4dc5-821d-47b51b86fd69 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:03.906620 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-5f7b8ec5-a6ac-4dc5-821d-47b51b86fd69 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:03.912628 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5f7b8ec5-a6ac-4dc5-821d-47b51b86fd69 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:03.913076 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5f7b8ec5-a6ac-4dc5-821d-47b51b86fd69 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:03.913834 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5f7b8ec5-a6ac-4dc5-821d-47b51b86fd69 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:03.914267 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5f7b8ec5-a6ac-4dc5-821d-47b51b86fd69 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:04.042145 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-5f7b8ec5-a6ac-4dc5-821d-47b51b86fd69 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:04.050091 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-5f7b8ec5-a6ac-4dc5-821d-47b51b86fd69 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.148132 Jul 11 11:45:04.050675 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1178/2350] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:03 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:04.411643 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-4ef6058a-1d63-4369-98f4-2f8b8e21bf42 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:04.412292 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-4ef6058a-1d63-4369-98f4-2f8b8e21bf42 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:04.418754 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4ef6058a-1d63-4369-98f4-2f8b8e21bf42 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:04.419202 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4ef6058a-1d63-4369-98f4-2f8b8e21bf42 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:04.419988 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4ef6058a-1d63-4369-98f4-2f8b8e21bf42 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:04.420424 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4ef6058a-1d63-4369-98f4-2f8b8e21bf42 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:04.546763 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-4ef6058a-1d63-4369-98f4-2f8b8e21bf42 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:04.554630 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-4ef6058a-1d63-4369-98f4-2f8b8e21bf42 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.146870 Jul 11 11:45:04.555200 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1173/2351] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:04 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:04.637389 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-ef0ef490-7e2e-4d95-9f00-99ec0c9f3662 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:04.638000 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-ef0ef490-7e2e-4d95-9f00-99ec0c9f3662 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:04.644431 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ef0ef490-7e2e-4d95-9f00-99ec0c9f3662 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:04.644881 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ef0ef490-7e2e-4d95-9f00-99ec0c9f3662 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:04.645637 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ef0ef490-7e2e-4d95-9f00-99ec0c9f3662 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:04.646073 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ef0ef490-7e2e-4d95-9f00-99ec0c9f3662 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:04.715775 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-ef0ef490-7e2e-4d95-9f00-99ec0c9f3662 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:04.723717 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-ef0ef490-7e2e-4d95-9f00-99ec0c9f3662 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.090094 Jul 11 11:45:04.724286 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1179/2352] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:04 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:05.067719 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-db337fd1-3116-4f38-a49e-d6f92b4633b1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:05.068328 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-db337fd1-3116-4f38-a49e-d6f92b4633b1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:05.074567 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-db337fd1-3116-4f38-a49e-d6f92b4633b1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:05.075006 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-db337fd1-3116-4f38-a49e-d6f92b4633b1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:05.075783 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-db337fd1-3116-4f38-a49e-d6f92b4633b1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:05.076214 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-db337fd1-3116-4f38-a49e-d6f92b4633b1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:05.204182 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-db337fd1-3116-4f38-a49e-d6f92b4633b1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:05.213030 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-db337fd1-3116-4f38-a49e-d6f92b4633b1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.148448 Jul 11 11:45:05.213599 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1174/2353] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:05 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:05.573548 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-21f83e4b-945a-435c-aa05-a9cabdbcf704 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:05.574157 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-21f83e4b-945a-435c-aa05-a9cabdbcf704 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:05.580241 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-21f83e4b-945a-435c-aa05-a9cabdbcf704 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:05.580688 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-21f83e4b-945a-435c-aa05-a9cabdbcf704 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:05.581495 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-21f83e4b-945a-435c-aa05-a9cabdbcf704 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:05.581938 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-21f83e4b-945a-435c-aa05-a9cabdbcf704 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:05.708939 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-21f83e4b-945a-435c-aa05-a9cabdbcf704 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:05.716928 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-21f83e4b-945a-435c-aa05-a9cabdbcf704 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.148105 Jul 11 11:45:05.717497 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1180/2354] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:05 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:05.741177 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-be888da0-646c-474a-bd0d-06c2879a3943 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:05.741790 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-be888da0-646c-474a-bd0d-06c2879a3943 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:05.748804 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-be888da0-646c-474a-bd0d-06c2879a3943 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:05.749258 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-be888da0-646c-474a-bd0d-06c2879a3943 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:05.750013 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-be888da0-646c-474a-bd0d-06c2879a3943 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:05.750450 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-be888da0-646c-474a-bd0d-06c2879a3943 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:05.814527 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-be888da0-646c-474a-bd0d-06c2879a3943 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:05.823227 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-be888da0-646c-474a-bd0d-06c2879a3943 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.086067 Jul 11 11:45:05.823958 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1175/2355] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:05 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:06.230451 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-e59b87c1-29f2-48fe-87f9-c6ca61baefec tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:06.231058 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-e59b87c1-29f2-48fe-87f9-c6ca61baefec tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:06.237075 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e59b87c1-29f2-48fe-87f9-c6ca61baefec tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:06.237520 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e59b87c1-29f2-48fe-87f9-c6ca61baefec tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:06.238271 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e59b87c1-29f2-48fe-87f9-c6ca61baefec tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:06.238706 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e59b87c1-29f2-48fe-87f9-c6ca61baefec tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:06.366590 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-e59b87c1-29f2-48fe-87f9-c6ca61baefec tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:06.374513 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-e59b87c1-29f2-48fe-87f9-c6ca61baefec tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.148486 Jul 11 11:45:06.375079 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1181/2356] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:06 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:06.733879 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-ebd3270c-7e56-476a-95e4-91b4cdbf2f85 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:06.734483 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-ebd3270c-7e56-476a-95e4-91b4cdbf2f85 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:06.740694 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ebd3270c-7e56-476a-95e4-91b4cdbf2f85 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:06.741135 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ebd3270c-7e56-476a-95e4-91b4cdbf2f85 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:06.741879 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ebd3270c-7e56-476a-95e4-91b4cdbf2f85 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:06.742427 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ebd3270c-7e56-476a-95e4-91b4cdbf2f85 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:06.842532 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-cf614cc8-2b19-4bcb-81cb-1ddce603d906 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:06.843147 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-cf614cc8-2b19-4bcb-81cb-1ddce603d906 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:06.849616 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-cf614cc8-2b19-4bcb-81cb-1ddce603d906 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:06.850068 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-cf614cc8-2b19-4bcb-81cb-1ddce603d906 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:06.850825 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-cf614cc8-2b19-4bcb-81cb-1ddce603d906 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:06.851271 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-cf614cc8-2b19-4bcb-81cb-1ddce603d906 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:06.869987 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-ebd3270c-7e56-476a-95e4-91b4cdbf2f85 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:06.879529 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-ebd3270c-7e56-476a-95e4-91b4cdbf2f85 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.149395 Jul 11 11:45:06.880117 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1176/2357] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:06 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:45:06.918820 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-cf614cc8-2b19-4bcb-81cb-1ddce603d906 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:06.926787 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-cf614cc8-2b19-4bcb-81cb-1ddce603d906 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.088105 Jul 11 11:45:06.927382 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1182/2358] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:06 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:45:07.391765 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-a97dafb3-7508-4fe0-b8cd-db42fdcc3cb0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:07.392306 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-a97dafb3-7508-4fe0-b8cd-db42fdcc3cb0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:07.398293 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a97dafb3-7508-4fe0-b8cd-db42fdcc3cb0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:07.398744 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a97dafb3-7508-4fe0-b8cd-db42fdcc3cb0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:07.399532 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a97dafb3-7508-4fe0-b8cd-db42fdcc3cb0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:07.399974 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a97dafb3-7508-4fe0-b8cd-db42fdcc3cb0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:07.524916 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-a97dafb3-7508-4fe0-b8cd-db42fdcc3cb0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:07.533128 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-a97dafb3-7508-4fe0-b8cd-db42fdcc3cb0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.145289 Jul 11 11:45:07.533699 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1177/2359] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:07 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:07.897023 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-8fabf731-cce4-4509-a8ec-ef245d2f9d24 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:07.897649 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-8fabf731-cce4-4509-a8ec-ef245d2f9d24 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:07.904711 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8fabf731-cce4-4509-a8ec-ef245d2f9d24 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:07.905156 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8fabf731-cce4-4509-a8ec-ef245d2f9d24 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:07.905912 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8fabf731-cce4-4509-a8ec-ef245d2f9d24 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:07.906342 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8fabf731-cce4-4509-a8ec-ef245d2f9d24 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:07.943726 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-eef5582d-e696-4bbb-a707-3347017c9088 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:07.944418 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-eef5582d-e696-4bbb-a707-3347017c9088 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:07.951196 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-eef5582d-e696-4bbb-a707-3347017c9088 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:07.951667 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-eef5582d-e696-4bbb-a707-3347017c9088 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:07.952432 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-eef5582d-e696-4bbb-a707-3347017c9088 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:07.952863 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-eef5582d-e696-4bbb-a707-3347017c9088 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:08.035523 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-eef5582d-e696-4bbb-a707-3347017c9088 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:08.044866 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-eef5582d-e696-4bbb-a707-3347017c9088 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.104904 Jul 11 11:45:08.045466 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1178/2360] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:07 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:45:08.264103 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-8fabf731-cce4-4509-a8ec-ef245d2f9d24 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:08.273530 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-8fabf731-cce4-4509-a8ec-ef245d2f9d24 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.378843 Jul 11 11:45:08.273530 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1183/2361] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:07 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:08.550763 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-2d8015a1-fca8-4baf-b8aa-1e6831909268 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:08.551305 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-2d8015a1-fca8-4baf-b8aa-1e6831909268 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:08.557828 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2d8015a1-fca8-4baf-b8aa-1e6831909268 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:08.558278 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2d8015a1-fca8-4baf-b8aa-1e6831909268 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:08.559025 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2d8015a1-fca8-4baf-b8aa-1e6831909268 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:08.559480 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2d8015a1-fca8-4baf-b8aa-1e6831909268 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:08.684448 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-2d8015a1-fca8-4baf-b8aa-1e6831909268 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:08.692262 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-2d8015a1-fca8-4baf-b8aa-1e6831909268 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.145428 Jul 11 11:45:08.692829 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1179/2362] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:08 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:09.062440 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-2efd2ab3-ee6f-41e7-a3eb-46386acdc6f1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:09.063056 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-2efd2ab3-ee6f-41e7-a3eb-46386acdc6f1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:09.069661 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2efd2ab3-ee6f-41e7-a3eb-46386acdc6f1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:09.070117 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2efd2ab3-ee6f-41e7-a3eb-46386acdc6f1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:09.070881 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2efd2ab3-ee6f-41e7-a3eb-46386acdc6f1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:09.071345 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2efd2ab3-ee6f-41e7-a3eb-46386acdc6f1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:09.131911 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-2efd2ab3-ee6f-41e7-a3eb-46386acdc6f1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:09.139692 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-2efd2ab3-ee6f-41e7-a3eb-46386acdc6f1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.081056 Jul 11 11:45:09.140259 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1184/2363] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:09 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:09.289656 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-8a4ee344-d9d7-4703-b0b0-26ef05e236f9 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:09.290868 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-8a4ee344-d9d7-4703-b0b0-26ef05e236f9 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:09.297310 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8a4ee344-d9d7-4703-b0b0-26ef05e236f9 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:09.297792 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8a4ee344-d9d7-4703-b0b0-26ef05e236f9 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:09.298544 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8a4ee344-d9d7-4703-b0b0-26ef05e236f9 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:09.299176 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8a4ee344-d9d7-4703-b0b0-26ef05e236f9 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:09.428548 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-8a4ee344-d9d7-4703-b0b0-26ef05e236f9 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:09.436425 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-8a4ee344-d9d7-4703-b0b0-26ef05e236f9 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.150727 Jul 11 11:45:09.436989 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1180/2364] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:09 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:09.709980 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-766af6d5-bb49-4762-81ca-2120b77fff65 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:09.710604 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-766af6d5-bb49-4762-81ca-2120b77fff65 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:09.717246 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-766af6d5-bb49-4762-81ca-2120b77fff65 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:09.717700 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-766af6d5-bb49-4762-81ca-2120b77fff65 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:09.718464 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-766af6d5-bb49-4762-81ca-2120b77fff65 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:09.718907 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-766af6d5-bb49-4762-81ca-2120b77fff65 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:09.845276 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-766af6d5-bb49-4762-81ca-2120b77fff65 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:09.853370 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-766af6d5-bb49-4762-81ca-2120b77fff65 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.147067 Jul 11 11:45:09.854211 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1185/2365] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:09 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:10.156464 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-3a4e9834-4b28-486b-a20f-d465b835dcff tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:10.157082 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-3a4e9834-4b28-486b-a20f-d465b835dcff tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:10.163279 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3a4e9834-4b28-486b-a20f-d465b835dcff tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:10.163738 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3a4e9834-4b28-486b-a20f-d465b835dcff tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:10.164495 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3a4e9834-4b28-486b-a20f-d465b835dcff tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:10.164925 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3a4e9834-4b28-486b-a20f-d465b835dcff tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:10.229438 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-3a4e9834-4b28-486b-a20f-d465b835dcff tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:10.237477 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-3a4e9834-4b28-486b-a20f-d465b835dcff tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.084826 Jul 11 11:45:10.238058 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1181/2366] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:10 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:10.452955 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-e2581c98-4301-4bf0-9707-1efc5d410c9f tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:10.453565 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-e2581c98-4301-4bf0-9707-1efc5d410c9f tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:10.460023 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e2581c98-4301-4bf0-9707-1efc5d410c9f tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:10.460469 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e2581c98-4301-4bf0-9707-1efc5d410c9f tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:10.461218 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e2581c98-4301-4bf0-9707-1efc5d410c9f tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:10.461931 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e2581c98-4301-4bf0-9707-1efc5d410c9f tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:10.588750 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-e2581c98-4301-4bf0-9707-1efc5d410c9f tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:10.596920 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-e2581c98-4301-4bf0-9707-1efc5d410c9f tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.147583 Jul 11 11:45:10.597494 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1186/2367] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:10 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:10.875787 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-388e6ef8-57fd-4edc-9240-b9d2c553bbdb tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:10.876666 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-388e6ef8-57fd-4edc-9240-b9d2c553bbdb tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:10.882846 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-388e6ef8-57fd-4edc-9240-b9d2c553bbdb tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:10.883319 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-388e6ef8-57fd-4edc-9240-b9d2c553bbdb tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:10.884738 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-388e6ef8-57fd-4edc-9240-b9d2c553bbdb tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:10.885176 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-388e6ef8-57fd-4edc-9240-b9d2c553bbdb tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:11.024587 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-388e6ef8-57fd-4edc-9240-b9d2c553bbdb tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:11.034958 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-388e6ef8-57fd-4edc-9240-b9d2c553bbdb tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.165465 Jul 11 11:45:11.035842 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1182/2368] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:10 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:11.254886 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-61eea950-d301-4f2f-8c67-15970bb293dd tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:11.255518 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-61eea950-d301-4f2f-8c67-15970bb293dd tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:11.261499 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-61eea950-d301-4f2f-8c67-15970bb293dd tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:11.261948 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-61eea950-d301-4f2f-8c67-15970bb293dd tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:11.262704 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-61eea950-d301-4f2f-8c67-15970bb293dd tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:11.263318 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-61eea950-d301-4f2f-8c67-15970bb293dd tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:11.332735 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-61eea950-d301-4f2f-8c67-15970bb293dd tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:11.341254 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-61eea950-d301-4f2f-8c67-15970bb293dd tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.090118 Jul 11 11:45:11.341840 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1187/2369] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:11 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:11.614067 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-5d4e02c1-f6ec-4fab-9498-d2a51e432acc tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:11.614592 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-5d4e02c1-f6ec-4fab-9498-d2a51e432acc tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:11.620691 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5d4e02c1-f6ec-4fab-9498-d2a51e432acc tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:11.621136 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5d4e02c1-f6ec-4fab-9498-d2a51e432acc tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:11.621885 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5d4e02c1-f6ec-4fab-9498-d2a51e432acc tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:11.622313 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5d4e02c1-f6ec-4fab-9498-d2a51e432acc tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:11.757960 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-5d4e02c1-f6ec-4fab-9498-d2a51e432acc tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:11.765801 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-5d4e02c1-f6ec-4fab-9498-d2a51e432acc tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.155657 Jul 11 11:45:11.766365 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1183/2370] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:11 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:45:12.053589 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-020708f6-4d56-455f-8f15-1337efdb04ae tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:12.054193 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-020708f6-4d56-455f-8f15-1337efdb04ae tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:12.060886 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-020708f6-4d56-455f-8f15-1337efdb04ae tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:12.061328 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-020708f6-4d56-455f-8f15-1337efdb04ae tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:12.062078 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-020708f6-4d56-455f-8f15-1337efdb04ae tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:12.062509 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-020708f6-4d56-455f-8f15-1337efdb04ae tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:12.191806 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-020708f6-4d56-455f-8f15-1337efdb04ae tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:12.200633 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-020708f6-4d56-455f-8f15-1337efdb04ae tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.150962 Jul 11 11:45:12.201206 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1188/2371] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:12 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:12.357780 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-019bc995-43d6-43fd-99b3-172a5eb89234 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:12.358418 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-019bc995-43d6-43fd-99b3-172a5eb89234 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:12.364951 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-019bc995-43d6-43fd-99b3-172a5eb89234 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:12.365391 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-019bc995-43d6-43fd-99b3-172a5eb89234 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:12.366139 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-019bc995-43d6-43fd-99b3-172a5eb89234 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:12.366569 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-019bc995-43d6-43fd-99b3-172a5eb89234 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:12.429484 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-019bc995-43d6-43fd-99b3-172a5eb89234 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:12.432164 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=100 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:45:12.438362 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-019bc995-43d6-43fd-99b3-172a5eb89234 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.084454 Jul 11 11:45:12.438920 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1184/2372] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:12 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:12.783190 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-f9b1bba1-0f3e-41e2-9dbd-72b705fa9511 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:12.783827 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-f9b1bba1-0f3e-41e2-9dbd-72b705fa9511 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:12.789789 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f9b1bba1-0f3e-41e2-9dbd-72b705fa9511 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:12.790739 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f9b1bba1-0f3e-41e2-9dbd-72b705fa9511 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:12.791506 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f9b1bba1-0f3e-41e2-9dbd-72b705fa9511 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:12.791933 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f9b1bba1-0f3e-41e2-9dbd-72b705fa9511 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:12.914555 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-f9b1bba1-0f3e-41e2-9dbd-72b705fa9511 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:12.922789 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-f9b1bba1-0f3e-41e2-9dbd-72b705fa9511 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.143422 Jul 11 11:45:12.923374 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1189/2373] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:12 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:13.218139 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-73eea821-570c-4d70-9401-c737f632e594 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:13.218755 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-73eea821-570c-4d70-9401-c737f632e594 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:13.224808 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-73eea821-570c-4d70-9401-c737f632e594 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:13.225283 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-73eea821-570c-4d70-9401-c737f632e594 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:13.226040 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-73eea821-570c-4d70-9401-c737f632e594 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:13.226481 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-73eea821-570c-4d70-9401-c737f632e594 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:13.351570 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-73eea821-570c-4d70-9401-c737f632e594 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:13.360073 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-73eea821-570c-4d70-9401-c737f632e594 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.146121 Jul 11 11:45:13.360659 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1185/2374] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:13 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:13.464129 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-716079a4-c1a7-466e-9b6c-9ffa406450bb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:13.464744 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-716079a4-c1a7-466e-9b6c-9ffa406450bb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:13.471350 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-716079a4-c1a7-466e-9b6c-9ffa406450bb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:13.481734 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-716079a4-c1a7-466e-9b6c-9ffa406450bb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:13.481734 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-716079a4-c1a7-466e-9b6c-9ffa406450bb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:13.481734 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-716079a4-c1a7-466e-9b6c-9ffa406450bb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:13.533691 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-716079a4-c1a7-466e-9b6c-9ffa406450bb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:13.535883 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=100 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:45:13.542218 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-716079a4-c1a7-466e-9b6c-9ffa406450bb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.082624 Jul 11 11:45:13.542795 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1190/2375] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:13 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:13.939800 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-78c5439d-09dc-4b57-9aff-6a776914fd38 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:13.940404 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-78c5439d-09dc-4b57-9aff-6a776914fd38 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:13.947930 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-78c5439d-09dc-4b57-9aff-6a776914fd38 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:13.948369 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-78c5439d-09dc-4b57-9aff-6a776914fd38 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:13.949112 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-78c5439d-09dc-4b57-9aff-6a776914fd38 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:13.949537 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-78c5439d-09dc-4b57-9aff-6a776914fd38 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:14.076231 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-78c5439d-09dc-4b57-9aff-6a776914fd38 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:14.084157 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-78c5439d-09dc-4b57-9aff-6a776914fd38 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.148256 Jul 11 11:45:14.084755 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1186/2376] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:13 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:14.378199 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-45512293-3cb2-4597-ae83-a2a261094d15 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:14.378803 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-45512293-3cb2-4597-ae83-a2a261094d15 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:14.384843 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-45512293-3cb2-4597-ae83-a2a261094d15 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:14.385300 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-45512293-3cb2-4597-ae83-a2a261094d15 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:14.386059 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-45512293-3cb2-4597-ae83-a2a261094d15 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:14.386490 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-45512293-3cb2-4597-ae83-a2a261094d15 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:14.515963 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-45512293-3cb2-4597-ae83-a2a261094d15 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:14.523813 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-45512293-3cb2-4597-ae83-a2a261094d15 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.149765 Jul 11 11:45:14.526344 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1191/2377] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:14 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:14.559196 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-648f2bf7-97bd-4701-8506-d1bad043c205 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:14.559833 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-648f2bf7-97bd-4701-8506-d1bad043c205 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:14.565865 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-648f2bf7-97bd-4701-8506-d1bad043c205 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:14.567176 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-648f2bf7-97bd-4701-8506-d1bad043c205 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:14.567176 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-648f2bf7-97bd-4701-8506-d1bad043c205 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:14.567542 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-648f2bf7-97bd-4701-8506-d1bad043c205 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:14.631105 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-648f2bf7-97bd-4701-8506-d1bad043c205 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:14.639005 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-648f2bf7-97bd-4701-8506-d1bad043c205 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.083755 Jul 11 11:45:14.639609 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1187/2378] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:14 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:15.100855 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-fb0c3f7d-bc71-463c-b89b-c3187095cb3c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:15.101464 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-fb0c3f7d-bc71-463c-b89b-c3187095cb3c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:15.107640 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fb0c3f7d-bc71-463c-b89b-c3187095cb3c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:15.108089 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fb0c3f7d-bc71-463c-b89b-c3187095cb3c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:15.108841 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fb0c3f7d-bc71-463c-b89b-c3187095cb3c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:15.109276 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fb0c3f7d-bc71-463c-b89b-c3187095cb3c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:15.233876 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-fb0c3f7d-bc71-463c-b89b-c3187095cb3c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:15.241709 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-fb0c3f7d-bc71-463c-b89b-c3187095cb3c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.144661 Jul 11 11:45:15.242270 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1192/2379] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:15 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:15.542451 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-6d39e920-726b-4638-bc49-751feef06345 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:15.543062 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-6d39e920-726b-4638-bc49-751feef06345 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:15.549545 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6d39e920-726b-4638-bc49-751feef06345 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:15.550002 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6d39e920-726b-4638-bc49-751feef06345 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:15.550760 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6d39e920-726b-4638-bc49-751feef06345 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:15.551201 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6d39e920-726b-4638-bc49-751feef06345 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:15.656230 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-b33bd968-f3d0-455a-9042-e3153dd07220 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:15.656841 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-b33bd968-f3d0-455a-9042-e3153dd07220 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:15.662964 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b33bd968-f3d0-455a-9042-e3153dd07220 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:15.663437 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b33bd968-f3d0-455a-9042-e3153dd07220 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:15.664187 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b33bd968-f3d0-455a-9042-e3153dd07220 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:15.664623 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b33bd968-f3d0-455a-9042-e3153dd07220 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:15.679485 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-6d39e920-726b-4638-bc49-751feef06345 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:15.687502 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-6d39e920-726b-4638-bc49-751feef06345 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.149580 Jul 11 11:45:15.688078 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1188/2380] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:15 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:15.725469 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-b33bd968-f3d0-455a-9042-e3153dd07220 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:15.733433 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-b33bd968-f3d0-455a-9042-e3153dd07220 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.081022 Jul 11 11:45:15.733996 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1193/2381] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:15 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:45:16.259742 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-6565b73c-bc8f-488c-a005-cc56c41b75cd tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:16.260357 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-6565b73c-bc8f-488c-a005-cc56c41b75cd tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:16.272015 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6565b73c-bc8f-488c-a005-cc56c41b75cd tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:16.272015 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6565b73c-bc8f-488c-a005-cc56c41b75cd tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:16.272015 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6565b73c-bc8f-488c-a005-cc56c41b75cd tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:16.272015 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6565b73c-bc8f-488c-a005-cc56c41b75cd tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:16.404998 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-6565b73c-bc8f-488c-a005-cc56c41b75cd tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:16.412848 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-6565b73c-bc8f-488c-a005-cc56c41b75cd tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.157599 Jul 11 11:45:16.413417 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1189/2382] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:16 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:16.705426 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-04e33a34-38d9-4dd5-b01d-3d4fefbe42a4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:16.706042 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-04e33a34-38d9-4dd5-b01d-3d4fefbe42a4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:16.712458 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-04e33a34-38d9-4dd5-b01d-3d4fefbe42a4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:16.712902 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-04e33a34-38d9-4dd5-b01d-3d4fefbe42a4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:16.713648 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-04e33a34-38d9-4dd5-b01d-3d4fefbe42a4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:16.714075 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-04e33a34-38d9-4dd5-b01d-3d4fefbe42a4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:16.750248 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-d65caa43-2e5a-4ae4-a0fd-9463728f54ae tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:16.750881 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-d65caa43-2e5a-4ae4-a0fd-9463728f54ae tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:16.756896 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d65caa43-2e5a-4ae4-a0fd-9463728f54ae tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:16.758192 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d65caa43-2e5a-4ae4-a0fd-9463728f54ae tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:16.758483 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d65caa43-2e5a-4ae4-a0fd-9463728f54ae tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:16.758933 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d65caa43-2e5a-4ae4-a0fd-9463728f54ae tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:16.827067 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-d65caa43-2e5a-4ae4-a0fd-9463728f54ae tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:16.836348 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-d65caa43-2e5a-4ae4-a0fd-9463728f54ae tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.089674 Jul 11 11:45:16.837576 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1190/2383] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:16 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:45:16.851096 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-04e33a34-38d9-4dd5-b01d-3d4fefbe42a4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:16.859795 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-04e33a34-38d9-4dd5-b01d-3d4fefbe42a4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.158165 Jul 11 11:45:16.861395 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1194/2384] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:16 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:17.429236 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-5f2f9485-97a5-4c3e-8bb5-e4fd4387508c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:17.429839 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-5f2f9485-97a5-4c3e-8bb5-e4fd4387508c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:17.437123 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5f2f9485-97a5-4c3e-8bb5-e4fd4387508c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:17.437582 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5f2f9485-97a5-4c3e-8bb5-e4fd4387508c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:17.438310 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5f2f9485-97a5-4c3e-8bb5-e4fd4387508c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:17.438767 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5f2f9485-97a5-4c3e-8bb5-e4fd4387508c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:17.565821 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-5f2f9485-97a5-4c3e-8bb5-e4fd4387508c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:17.573873 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-5f2f9485-97a5-4c3e-8bb5-e4fd4387508c tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.148456 Jul 11 11:45:17.574431 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1191/2385] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:17 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:17.854534 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-818d6f10-dcc9-4140-ad8e-febd37415bca tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:17.855149 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-818d6f10-dcc9-4140-ad8e-febd37415bca tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:17.861638 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-818d6f10-dcc9-4140-ad8e-febd37415bca tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:17.862087 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-818d6f10-dcc9-4140-ad8e-febd37415bca tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:17.862915 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-818d6f10-dcc9-4140-ad8e-febd37415bca tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:17.863405 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-818d6f10-dcc9-4140-ad8e-febd37415bca tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:17.877237 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-86c00cb4-9770-40ec-b0ca-c01915f5eeb1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:17.879572 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-86c00cb4-9770-40ec-b0ca-c01915f5eeb1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:17.884330 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-86c00cb4-9770-40ec-b0ca-c01915f5eeb1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:17.884788 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-86c00cb4-9770-40ec-b0ca-c01915f5eeb1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:17.885525 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-86c00cb4-9770-40ec-b0ca-c01915f5eeb1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:17.886007 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-86c00cb4-9770-40ec-b0ca-c01915f5eeb1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:17.934984 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-818d6f10-dcc9-4140-ad8e-febd37415bca tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:17.943078 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-818d6f10-dcc9-4140-ad8e-febd37415bca tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.093000 Jul 11 11:45:17.943688 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1195/2386] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:17 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:18.016887 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-86c00cb4-9770-40ec-b0ca-c01915f5eeb1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:18.025423 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-86c00cb4-9770-40ec-b0ca-c01915f5eeb1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.152000 Jul 11 11:45:18.025996 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1192/2387] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:17 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:45:18.590814 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-1691c219-0322-40ab-9d16-c7dd2cdd2731 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:18.591374 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-1691c219-0322-40ab-9d16-c7dd2cdd2731 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:18.597375 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1691c219-0322-40ab-9d16-c7dd2cdd2731 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:18.597853 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1691c219-0322-40ab-9d16-c7dd2cdd2731 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:18.598604 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1691c219-0322-40ab-9d16-c7dd2cdd2731 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:18.599038 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1691c219-0322-40ab-9d16-c7dd2cdd2731 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:18.728112 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-1691c219-0322-40ab-9d16-c7dd2cdd2731 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:18.735976 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-1691c219-0322-40ab-9d16-c7dd2cdd2731 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.149099 Jul 11 11:45:18.736547 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1196/2388] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:18 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:18.960817 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-456476dc-f968-4003-ba50-e075825fadf3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:18.961454 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-456476dc-f968-4003-ba50-e075825fadf3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:18.967884 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-456476dc-f968-4003-ba50-e075825fadf3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:18.968350 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-456476dc-f968-4003-ba50-e075825fadf3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:18.969132 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-456476dc-f968-4003-ba50-e075825fadf3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:18.969560 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-456476dc-f968-4003-ba50-e075825fadf3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:19.033779 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-456476dc-f968-4003-ba50-e075825fadf3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:19.042206 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-f2492673-24f9-424e-bbd8-27857b0a7c29 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:19.042725 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-456476dc-f968-4003-ba50-e075825fadf3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.085178 Jul 11 11:45:19.046114 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-f2492673-24f9-424e-bbd8-27857b0a7c29 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:19.046265 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1193/2389] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:18 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:19.049657 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f2492673-24f9-424e-bbd8-27857b0a7c29 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:19.050204 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f2492673-24f9-424e-bbd8-27857b0a7c29 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:19.051036 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f2492673-24f9-424e-bbd8-27857b0a7c29 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:19.051564 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f2492673-24f9-424e-bbd8-27857b0a7c29 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:19.432617 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-f2492673-24f9-424e-bbd8-27857b0a7c29 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:19.432617 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-f2492673-24f9-424e-bbd8-27857b0a7c29 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.158158 Jul 11 11:45:19.432617 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1197/2390] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:19 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:19.753875 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-430caddf-3b0d-4820-b4c5-1ca73a383a98 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:19.754412 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-430caddf-3b0d-4820-b4c5-1ca73a383a98 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:19.761141 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-430caddf-3b0d-4820-b4c5-1ca73a383a98 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:19.761589 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-430caddf-3b0d-4820-b4c5-1ca73a383a98 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:19.762343 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-430caddf-3b0d-4820-b4c5-1ca73a383a98 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:19.762782 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-430caddf-3b0d-4820-b4c5-1ca73a383a98 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:19.888998 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-430caddf-3b0d-4820-b4c5-1ca73a383a98 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:19.896873 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-430caddf-3b0d-4820-b4c5-1ca73a383a98 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.147230 Jul 11 11:45:19.897441 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1194/2391] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:19 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:20.059804 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-a2e0df8e-56a7-4182-8a21-abc466eae66a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:20.060359 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-a2e0df8e-56a7-4182-8a21-abc466eae66a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:20.066767 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a2e0df8e-56a7-4182-8a21-abc466eae66a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:20.067275 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a2e0df8e-56a7-4182-8a21-abc466eae66a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:20.068063 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a2e0df8e-56a7-4182-8a21-abc466eae66a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:20.068507 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a2e0df8e-56a7-4182-8a21-abc466eae66a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:20.129484 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-a2e0df8e-56a7-4182-8a21-abc466eae66a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:20.137304 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-a2e0df8e-56a7-4182-8a21-abc466eae66a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.082035 Jul 11 11:45:20.137872 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1198/2392] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:20 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:20.217968 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-8a1e37fa-bd8a-48c0-a63f-2e248ce318a9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:20.218576 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-8a1e37fa-bd8a-48c0-a63f-2e248ce318a9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:20.224988 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8a1e37fa-bd8a-48c0-a63f-2e248ce318a9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:20.225428 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8a1e37fa-bd8a-48c0-a63f-2e248ce318a9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:20.226173 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8a1e37fa-bd8a-48c0-a63f-2e248ce318a9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:20.226600 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8a1e37fa-bd8a-48c0-a63f-2e248ce318a9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:20.354778 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-8a1e37fa-bd8a-48c0-a63f-2e248ce318a9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:20.362593 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-8a1e37fa-bd8a-48c0-a63f-2e248ce318a9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.148381 Jul 11 11:45:20.363162 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1195/2393] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:20 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:20.913816 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-5102f337-a503-4a90-8a03-ed6e56b4ad0f tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:20.914431 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-5102f337-a503-4a90-8a03-ed6e56b4ad0f tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:20.921148 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5102f337-a503-4a90-8a03-ed6e56b4ad0f tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:20.921594 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5102f337-a503-4a90-8a03-ed6e56b4ad0f tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:20.922346 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5102f337-a503-4a90-8a03-ed6e56b4ad0f tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:20.922775 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5102f337-a503-4a90-8a03-ed6e56b4ad0f tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:21.049672 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-5102f337-a503-4a90-8a03-ed6e56b4ad0f tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:21.058262 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-5102f337-a503-4a90-8a03-ed6e56b4ad0f tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.148344 Jul 11 11:45:21.058832 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1199/2394] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:20 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:21.153843 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-517a7186-e421-42ac-b6cc-e6a2d53ab03c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:21.154390 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-517a7186-e421-42ac-b6cc-e6a2d53ab03c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:21.160451 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-517a7186-e421-42ac-b6cc-e6a2d53ab03c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:21.160897 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-517a7186-e421-42ac-b6cc-e6a2d53ab03c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:21.161656 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-517a7186-e421-42ac-b6cc-e6a2d53ab03c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:21.162091 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-517a7186-e421-42ac-b6cc-e6a2d53ab03c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:21.224629 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-517a7186-e421-42ac-b6cc-e6a2d53ab03c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:21.232916 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-517a7186-e421-42ac-b6cc-e6a2d53ab03c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.082973 Jul 11 11:45:21.233478 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1196/2395] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:21 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:21.380179 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-e93459f8-4235-4152-875d-c02e3ed221cd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:21.380790 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-e93459f8-4235-4152-875d-c02e3ed221cd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:21.387311 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e93459f8-4235-4152-875d-c02e3ed221cd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:21.387765 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e93459f8-4235-4152-875d-c02e3ed221cd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:21.388519 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e93459f8-4235-4152-875d-c02e3ed221cd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:21.388952 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e93459f8-4235-4152-875d-c02e3ed221cd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:21.513835 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-e93459f8-4235-4152-875d-c02e3ed221cd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:21.525248 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-e93459f8-4235-4152-875d-c02e3ed221cd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.148112 Jul 11 11:45:21.525860 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1200/2396] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:21 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:22.076301 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-9df6202b-3fa5-490d-b12f-28ef23b05c32 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:22.076919 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-9df6202b-3fa5-490d-b12f-28ef23b05c32 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:22.078816 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_api:SELECT=82 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:45:22.083603 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9df6202b-3fa5-490d-b12f-28ef23b05c32 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:22.084054 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9df6202b-3fa5-490d-b12f-28ef23b05c32 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:22.084811 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9df6202b-3fa5-490d-b12f-28ef23b05c32 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:22.085248 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9df6202b-3fa5-490d-b12f-28ef23b05c32 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:22.220921 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-9df6202b-3fa5-490d-b12f-28ef23b05c32 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:22.230047 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-9df6202b-3fa5-490d-b12f-28ef23b05c32 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.157815 Jul 11 11:45:22.231238 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1197/2397] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:22 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:22.249905 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-954d78ea-5ae2-4721-93d8-0f14ee479de1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:22.250550 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-954d78ea-5ae2-4721-93d8-0f14ee479de1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:22.252634 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_api:SELECT=76 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:45:22.257244 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-954d78ea-5ae2-4721-93d8-0f14ee479de1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:22.257693 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-954d78ea-5ae2-4721-93d8-0f14ee479de1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:22.261227 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-954d78ea-5ae2-4721-93d8-0f14ee479de1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:22.261227 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-954d78ea-5ae2-4721-93d8-0f14ee479de1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:22.319219 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-954d78ea-5ae2-4721-93d8-0f14ee479de1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:22.327789 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-954d78ea-5ae2-4721-93d8-0f14ee479de1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.081632 Jul 11 11:45:22.328304 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1201/2398] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:22 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:22.541901 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-eb7b9b8b-190e-4fda-8271-eff5bede8149 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:22.542504 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-eb7b9b8b-190e-4fda-8271-eff5bede8149 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:22.548471 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-eb7b9b8b-190e-4fda-8271-eff5bede8149 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:22.548913 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-eb7b9b8b-190e-4fda-8271-eff5bede8149 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:22.549657 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-eb7b9b8b-190e-4fda-8271-eff5bede8149 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:22.550084 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-eb7b9b8b-190e-4fda-8271-eff5bede8149 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:22.683389 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-eb7b9b8b-190e-4fda-8271-eff5bede8149 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:22.691185 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-eb7b9b8b-190e-4fda-8271-eff5bede8149 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.153599 Jul 11 11:45:22.691849 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1198/2399] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:22 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:23.247520 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-43933fc9-60ba-4e9f-9b57-ab2e56f6bfab tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:23.248130 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-43933fc9-60ba-4e9f-9b57-ab2e56f6bfab tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:23.254543 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-43933fc9-60ba-4e9f-9b57-ab2e56f6bfab tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:23.254984 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-43933fc9-60ba-4e9f-9b57-ab2e56f6bfab tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:23.255765 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-43933fc9-60ba-4e9f-9b57-ab2e56f6bfab tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:23.256196 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-43933fc9-60ba-4e9f-9b57-ab2e56f6bfab tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:23.344512 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-3c307d3a-9f8e-4ad1-a060-ffff52f39f15 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:23.345130 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-3c307d3a-9f8e-4ad1-a060-ffff52f39f15 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:23.352937 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3c307d3a-9f8e-4ad1-a060-ffff52f39f15 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:23.353394 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3c307d3a-9f8e-4ad1-a060-ffff52f39f15 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:23.354166 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3c307d3a-9f8e-4ad1-a060-ffff52f39f15 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:23.354601 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3c307d3a-9f8e-4ad1-a060-ffff52f39f15 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:23.395555 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-43933fc9-60ba-4e9f-9b57-ab2e56f6bfab tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:23.403607 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-43933fc9-60ba-4e9f-9b57-ab2e56f6bfab tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.160457 Jul 11 11:45:23.404440 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1202/2400] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:23 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:23.425797 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-3c307d3a-9f8e-4ad1-a060-ffff52f39f15 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:23.434411 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-3c307d3a-9f8e-4ad1-a060-ffff52f39f15 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.093703 Jul 11 11:45:23.435004 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1199/2401] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:23 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:45:23.708607 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-116922b2-537e-409d-bc6f-d44a7b38b6be tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:23.709219 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-116922b2-537e-409d-bc6f-d44a7b38b6be tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:23.715812 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-116922b2-537e-409d-bc6f-d44a7b38b6be tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:23.716255 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-116922b2-537e-409d-bc6f-d44a7b38b6be tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:23.717002 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-116922b2-537e-409d-bc6f-d44a7b38b6be tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:23.717433 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-116922b2-537e-409d-bc6f-d44a7b38b6be tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:23.842184 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-116922b2-537e-409d-bc6f-d44a7b38b6be tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:23.849960 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-116922b2-537e-409d-bc6f-d44a7b38b6be tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.145148 Jul 11 11:45:23.850528 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1203/2402] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:23 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:24.422252 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-12d0d3c2-c1b7-4039-a86b-5cd48669e621 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:24.422860 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-12d0d3c2-c1b7-4039-a86b-5cd48669e621 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:24.429412 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-12d0d3c2-c1b7-4039-a86b-5cd48669e621 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:24.430660 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-12d0d3c2-c1b7-4039-a86b-5cd48669e621 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:24.430660 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-12d0d3c2-c1b7-4039-a86b-5cd48669e621 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:24.431174 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-12d0d3c2-c1b7-4039-a86b-5cd48669e621 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:24.451493 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-2c61b151-bb89-4547-970e-167d329df0be tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:24.452158 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-2c61b151-bb89-4547-970e-167d329df0be tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:24.458708 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2c61b151-bb89-4547-970e-167d329df0be tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:24.459155 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2c61b151-bb89-4547-970e-167d329df0be tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:24.459944 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2c61b151-bb89-4547-970e-167d329df0be tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:24.460383 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2c61b151-bb89-4547-970e-167d329df0be tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:24.523681 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-2c61b151-bb89-4547-970e-167d329df0be tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:24.532229 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-2c61b151-bb89-4547-970e-167d329df0be tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.084823 Jul 11 11:45:24.533005 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1204/2403] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:24 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:45:24.560789 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-12d0d3c2-c1b7-4039-a86b-5cd48669e621 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:24.568750 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-12d0d3c2-c1b7-4039-a86b-5cd48669e621 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.150426 Jul 11 11:45:24.569327 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1200/2404] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:24 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:24.866684 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-2736cb47-165b-4c57-ab74-6d00e38e1c1b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:24.867222 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-2736cb47-165b-4c57-ab74-6d00e38e1c1b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:24.873877 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2736cb47-165b-4c57-ab74-6d00e38e1c1b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:24.874328 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2736cb47-165b-4c57-ab74-6d00e38e1c1b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:24.875088 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2736cb47-165b-4c57-ab74-6d00e38e1c1b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:24.875552 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2736cb47-165b-4c57-ab74-6d00e38e1c1b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:25.003027 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-2736cb47-165b-4c57-ab74-6d00e38e1c1b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:25.010940 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-2736cb47-165b-4c57-ab74-6d00e38e1c1b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.148177 Jul 11 11:45:25.011595 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1205/2405] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:24 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:25.548428 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-38b20a4f-4482-4e13-ab5c-0dcdf70fb604 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:25.549087 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-38b20a4f-4482-4e13-ab5c-0dcdf70fb604 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:25.555545 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-38b20a4f-4482-4e13-ab5c-0dcdf70fb604 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:25.556002 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-38b20a4f-4482-4e13-ab5c-0dcdf70fb604 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:25.556747 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-38b20a4f-4482-4e13-ab5c-0dcdf70fb604 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:25.557178 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-38b20a4f-4482-4e13-ab5c-0dcdf70fb604 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:25.571522 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=100 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:45:25.585832 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-a2eb720d-8acf-4f4c-b5fe-e97ce9665b69 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:25.586495 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-a2eb720d-8acf-4f4c-b5fe-e97ce9665b69 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:25.593745 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a2eb720d-8acf-4f4c-b5fe-e97ce9665b69 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:25.594198 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a2eb720d-8acf-4f4c-b5fe-e97ce9665b69 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:25.594964 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a2eb720d-8acf-4f4c-b5fe-e97ce9665b69 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:25.595433 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a2eb720d-8acf-4f4c-b5fe-e97ce9665b69 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:25.620453 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-38b20a4f-4482-4e13-ab5c-0dcdf70fb604 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:25.628367 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-38b20a4f-4482-4e13-ab5c-0dcdf70fb604 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.083799 Jul 11 11:45:25.628940 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1201/2406] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:25 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:25.735432 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-a2eb720d-8acf-4f4c-b5fe-e97ce9665b69 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:25.743235 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-a2eb720d-8acf-4f4c-b5fe-e97ce9665b69 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.161236 Jul 11 11:45:25.743832 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1206/2407] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:25 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:45:26.030064 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-0ada8732-59df-4c9b-a6c5-29d3c998c9ab tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:26.030706 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-0ada8732-59df-4c9b-a6c5-29d3c998c9ab tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:26.037217 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0ada8732-59df-4c9b-a6c5-29d3c998c9ab tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:26.037664 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0ada8732-59df-4c9b-a6c5-29d3c998c9ab tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:26.038425 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0ada8732-59df-4c9b-a6c5-29d3c998c9ab tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:26.038860 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0ada8732-59df-4c9b-a6c5-29d3c998c9ab tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:26.166819 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-0ada8732-59df-4c9b-a6c5-29d3c998c9ab tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:26.174728 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-0ada8732-59df-4c9b-a6c5-29d3c998c9ab tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.150065 Jul 11 11:45:26.175317 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1202/2408] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:26 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:26.645958 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-42d7c137-d712-4e87-b9f4-12c06c4d43ce tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:26.647007 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-42d7c137-d712-4e87-b9f4-12c06c4d43ce tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:26.655125 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-42d7c137-d712-4e87-b9f4-12c06c4d43ce tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:26.657345 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-42d7c137-d712-4e87-b9f4-12c06c4d43ce tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:26.657345 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-42d7c137-d712-4e87-b9f4-12c06c4d43ce tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:26.657345 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-42d7c137-d712-4e87-b9f4-12c06c4d43ce tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:26.671314 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=100 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:45:26.718017 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-42d7c137-d712-4e87-b9f4-12c06c4d43ce tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:26.725725 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-42d7c137-d712-4e87-b9f4-12c06c4d43ce tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.084197 Jul 11 11:45:26.726290 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1207/2409] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:26 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:26.760280 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-cf12a2f7-304a-4b23-a6a0-e807bb372581 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:26.761531 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-cf12a2f7-304a-4b23-a6a0-e807bb372581 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:26.768110 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cf12a2f7-304a-4b23-a6a0-e807bb372581 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:26.768551 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cf12a2f7-304a-4b23-a6a0-e807bb372581 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:26.769293 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cf12a2f7-304a-4b23-a6a0-e807bb372581 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:26.769721 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cf12a2f7-304a-4b23-a6a0-e807bb372581 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:26.897689 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-cf12a2f7-304a-4b23-a6a0-e807bb372581 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:26.905540 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-cf12a2f7-304a-4b23-a6a0-e807bb372581 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.149189 Jul 11 11:45:26.906096 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1203/2410] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:26 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:27.191841 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-59d455f4-ebc4-4204-8655-a3325e4ebd12 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:27.192456 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-59d455f4-ebc4-4204-8655-a3325e4ebd12 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:27.198738 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-59d455f4-ebc4-4204-8655-a3325e4ebd12 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:27.199186 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-59d455f4-ebc4-4204-8655-a3325e4ebd12 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:27.199970 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-59d455f4-ebc4-4204-8655-a3325e4ebd12 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:27.200406 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-59d455f4-ebc4-4204-8655-a3325e4ebd12 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:27.333684 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-59d455f4-ebc4-4204-8655-a3325e4ebd12 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:27.336489 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-59d455f4-ebc4-4204-8655-a3325e4ebd12 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.148473 Jul 11 11:45:27.337064 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1208/2411] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:27 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:27.742689 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-09df8fba-f41a-4166-b757-8010a3f79f02 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:27.743329 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-09df8fba-f41a-4166-b757-8010a3f79f02 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:27.750442 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-09df8fba-f41a-4166-b757-8010a3f79f02 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:27.750898 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-09df8fba-f41a-4166-b757-8010a3f79f02 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:27.751702 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-09df8fba-f41a-4166-b757-8010a3f79f02 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:27.752146 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-09df8fba-f41a-4166-b757-8010a3f79f02 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:27.816369 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-09df8fba-f41a-4166-b757-8010a3f79f02 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:27.824542 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-09df8fba-f41a-4166-b757-8010a3f79f02 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.085685 Jul 11 11:45:27.825107 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1204/2412] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:27 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:27.922274 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-1390c44b-d36c-41ff-b6c7-0a1dfb173ac3 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:27.922876 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-1390c44b-d36c-41ff-b6c7-0a1dfb173ac3 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:27.934244 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1390c44b-d36c-41ff-b6c7-0a1dfb173ac3 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:27.935037 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1390c44b-d36c-41ff-b6c7-0a1dfb173ac3 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:27.936422 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1390c44b-d36c-41ff-b6c7-0a1dfb173ac3 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:27.937176 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1390c44b-d36c-41ff-b6c7-0a1dfb173ac3 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:28.064832 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-1390c44b-d36c-41ff-b6c7-0a1dfb173ac3 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:28.073594 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-1390c44b-d36c-41ff-b6c7-0a1dfb173ac3 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.154275 Jul 11 11:45:28.074177 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1209/2413] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:27 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:28.353907 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-03149ae6-3d15-43b5-80f6-ebca52d9b909 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:28.354513 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-03149ae6-3d15-43b5-80f6-ebca52d9b909 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:28.360566 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-03149ae6-3d15-43b5-80f6-ebca52d9b909 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:28.361015 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-03149ae6-3d15-43b5-80f6-ebca52d9b909 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:28.361765 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-03149ae6-3d15-43b5-80f6-ebca52d9b909 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:28.362195 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-03149ae6-3d15-43b5-80f6-ebca52d9b909 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:28.491061 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-03149ae6-3d15-43b5-80f6-ebca52d9b909 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:28.499155 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-03149ae6-3d15-43b5-80f6-ebca52d9b909 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.149048 Jul 11 11:45:28.499764 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1205/2414] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:28 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:28.841953 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-fdc53e95-e5ea-4fcd-810f-aa9bfc649022 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:28.842568 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-fdc53e95-e5ea-4fcd-810f-aa9bfc649022 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:28.848650 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fdc53e95-e5ea-4fcd-810f-aa9bfc649022 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:28.849103 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fdc53e95-e5ea-4fcd-810f-aa9bfc649022 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:28.849861 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fdc53e95-e5ea-4fcd-810f-aa9bfc649022 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:28.850300 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fdc53e95-e5ea-4fcd-810f-aa9bfc649022 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:28.914905 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-fdc53e95-e5ea-4fcd-810f-aa9bfc649022 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:28.923482 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-fdc53e95-e5ea-4fcd-810f-aa9bfc649022 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.085790 Jul 11 11:45:28.924125 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1210/2415] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:28 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:29.090720 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-a6ea2fb9-4626-45d6-b484-d5e0be23631b tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:29.091501 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-a6ea2fb9-4626-45d6-b484-d5e0be23631b tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:29.097860 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a6ea2fb9-4626-45d6-b484-d5e0be23631b tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:29.098251 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a6ea2fb9-4626-45d6-b484-d5e0be23631b tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:29.099012 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a6ea2fb9-4626-45d6-b484-d5e0be23631b tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:29.099485 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a6ea2fb9-4626-45d6-b484-d5e0be23631b tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:29.242379 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-a6ea2fb9-4626-45d6-b484-d5e0be23631b tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:29.242379 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-a6ea2fb9-4626-45d6-b484-d5e0be23631b tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.150693 Jul 11 11:45:29.242379 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1206/2416] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:29 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:29.516233 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-013b78b2-66a4-4b04-a9c0-cd03bb4cb92e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:29.516836 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-013b78b2-66a4-4b04-a9c0-cd03bb4cb92e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:29.523283 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-013b78b2-66a4-4b04-a9c0-cd03bb4cb92e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:29.523728 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-013b78b2-66a4-4b04-a9c0-cd03bb4cb92e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:29.524472 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-013b78b2-66a4-4b04-a9c0-cd03bb4cb92e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:29.524897 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-013b78b2-66a4-4b04-a9c0-cd03bb4cb92e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:29.654427 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-013b78b2-66a4-4b04-a9c0-cd03bb4cb92e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:29.662277 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-013b78b2-66a4-4b04-a9c0-cd03bb4cb92e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.149877 Jul 11 11:45:29.662839 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1211/2417] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:29 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:29.940479 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-16dfeaa1-6510-4571-baff-68a11b5fc72d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:29.941090 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-16dfeaa1-6510-4571-baff-68a11b5fc72d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:29.947131 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-16dfeaa1-6510-4571-baff-68a11b5fc72d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:29.948396 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-16dfeaa1-6510-4571-baff-68a11b5fc72d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:29.949151 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-16dfeaa1-6510-4571-baff-68a11b5fc72d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:29.949587 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-16dfeaa1-6510-4571-baff-68a11b5fc72d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:30.019397 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-16dfeaa1-6510-4571-baff-68a11b5fc72d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:30.028206 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-16dfeaa1-6510-4571-baff-68a11b5fc72d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.091458 Jul 11 11:45:30.037574 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1207/2418] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:29 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:30.257370 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-443a9cb6-548a-418b-a29d-11d3fc31e36e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:30.257986 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-443a9cb6-548a-418b-a29d-11d3fc31e36e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:30.264594 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-443a9cb6-548a-418b-a29d-11d3fc31e36e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:30.265046 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-443a9cb6-548a-418b-a29d-11d3fc31e36e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:30.265807 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-443a9cb6-548a-418b-a29d-11d3fc31e36e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:30.266243 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-443a9cb6-548a-418b-a29d-11d3fc31e36e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:30.390074 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-443a9cb6-548a-418b-a29d-11d3fc31e36e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:30.397757 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-443a9cb6-548a-418b-a29d-11d3fc31e36e tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.144289 Jul 11 11:45:30.398319 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1212/2419] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:30 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:30.679965 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-f6223edb-ae03-4d53-b736-d70d3194400e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:30.680569 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-f6223edb-ae03-4d53-b736-d70d3194400e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:30.687438 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f6223edb-ae03-4d53-b736-d70d3194400e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:30.687882 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f6223edb-ae03-4d53-b736-d70d3194400e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:30.688626 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f6223edb-ae03-4d53-b736-d70d3194400e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:30.689054 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f6223edb-ae03-4d53-b736-d70d3194400e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:30.818739 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-f6223edb-ae03-4d53-b736-d70d3194400e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:30.826817 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-f6223edb-ae03-4d53-b736-d70d3194400e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.150622 Jul 11 11:45:30.827411 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1208/2420] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:30 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:31.045777 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-085eb9dc-0eba-4e0f-94a2-2d7e261d78fc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:31.046311 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-085eb9dc-0eba-4e0f-94a2-2d7e261d78fc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:31.052862 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-085eb9dc-0eba-4e0f-94a2-2d7e261d78fc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:31.053304 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-085eb9dc-0eba-4e0f-94a2-2d7e261d78fc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:31.054072 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-085eb9dc-0eba-4e0f-94a2-2d7e261d78fc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:31.054504 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-085eb9dc-0eba-4e0f-94a2-2d7e261d78fc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:31.118905 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-085eb9dc-0eba-4e0f-94a2-2d7e261d78fc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:31.127303 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-085eb9dc-0eba-4e0f-94a2-2d7e261d78fc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.085833 Jul 11 11:45:31.127871 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1213/2421] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:31 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:31.415112 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-a11f19dd-0ae0-40c1-bbed-961f0109d55d tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:31.415762 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-a11f19dd-0ae0-40c1-bbed-961f0109d55d tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:31.422477 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a11f19dd-0ae0-40c1-bbed-961f0109d55d tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:31.422918 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a11f19dd-0ae0-40c1-bbed-961f0109d55d tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:31.423689 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a11f19dd-0ae0-40c1-bbed-961f0109d55d tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:31.424117 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a11f19dd-0ae0-40c1-bbed-961f0109d55d tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:31.549249 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-a11f19dd-0ae0-40c1-bbed-961f0109d55d tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:31.556977 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-a11f19dd-0ae0-40c1-bbed-961f0109d55d tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.145645 Jul 11 11:45:31.558130 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1209/2422] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:31 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:31.845450 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-351134f6-5209-4521-85c9-ca70ee85ea57 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:31.846062 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-351134f6-5209-4521-85c9-ca70ee85ea57 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:31.852090 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-351134f6-5209-4521-85c9-ca70ee85ea57 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:31.852540 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-351134f6-5209-4521-85c9-ca70ee85ea57 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:31.853295 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-351134f6-5209-4521-85c9-ca70ee85ea57 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:31.853728 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-351134f6-5209-4521-85c9-ca70ee85ea57 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:31.978663 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-351134f6-5209-4521-85c9-ca70ee85ea57 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:31.991639 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-351134f6-5209-4521-85c9-ca70ee85ea57 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.149956 Jul 11 11:45:31.992228 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1214/2423] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:31 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:32.144780 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-b37150d5-b234-487f-a605-ea6c12d1bf72 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:32.145307 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-b37150d5-b234-487f-a605-ea6c12d1bf72 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:32.152369 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b37150d5-b234-487f-a605-ea6c12d1bf72 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:32.152809 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b37150d5-b234-487f-a605-ea6c12d1bf72 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:32.153554 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b37150d5-b234-487f-a605-ea6c12d1bf72 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:32.153985 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b37150d5-b234-487f-a605-ea6c12d1bf72 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:32.215267 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-b37150d5-b234-487f-a605-ea6c12d1bf72 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:32.223183 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-b37150d5-b234-487f-a605-ea6c12d1bf72 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.082370 Jul 11 11:45:32.223782 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1210/2424] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:32 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:32.574464 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-d59ed0a5-474b-4baf-b702-9e73f2c49c62 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:32.575067 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-d59ed0a5-474b-4baf-b702-9e73f2c49c62 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:32.581650 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d59ed0a5-474b-4baf-b702-9e73f2c49c62 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:32.582093 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d59ed0a5-474b-4baf-b702-9e73f2c49c62 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:32.582837 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d59ed0a5-474b-4baf-b702-9e73f2c49c62 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:32.583352 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d59ed0a5-474b-4baf-b702-9e73f2c49c62 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:32.707984 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-d59ed0a5-474b-4baf-b702-9e73f2c49c62 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:32.716202 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-d59ed0a5-474b-4baf-b702-9e73f2c49c62 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.145807 Jul 11 11:45:32.716761 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1215/2425] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:32 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:33.009072 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-d0a108a1-08a3-4bb2-836b-729a8a5482ac tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:33.009684 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-d0a108a1-08a3-4bb2-836b-729a8a5482ac tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:33.015841 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d0a108a1-08a3-4bb2-836b-729a8a5482ac tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:33.016288 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d0a108a1-08a3-4bb2-836b-729a8a5482ac tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:33.018718 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d0a108a1-08a3-4bb2-836b-729a8a5482ac tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:33.020484 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d0a108a1-08a3-4bb2-836b-729a8a5482ac tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:33.150019 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-d0a108a1-08a3-4bb2-836b-729a8a5482ac tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:33.158747 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-d0a108a1-08a3-4bb2-836b-729a8a5482ac tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.153600 Jul 11 11:45:33.159336 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1211/2426] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:33 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:33.240484 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-7a63aa53-e9db-4fb7-95ec-e9b3c3f546bc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:33.241130 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-7a63aa53-e9db-4fb7-95ec-e9b3c3f546bc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:33.247611 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7a63aa53-e9db-4fb7-95ec-e9b3c3f546bc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:33.248059 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7a63aa53-e9db-4fb7-95ec-e9b3c3f546bc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:33.248808 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7a63aa53-e9db-4fb7-95ec-e9b3c3f546bc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:33.249241 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7a63aa53-e9db-4fb7-95ec-e9b3c3f546bc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:33.312497 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-7a63aa53-e9db-4fb7-95ec-e9b3c3f546bc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:33.320297 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-7a63aa53-e9db-4fb7-95ec-e9b3c3f546bc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.083632 Jul 11 11:45:33.320863 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1216/2427] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:33 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:33.733460 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-3d9d2279-553c-4a46-8ba5-d4b70e26b4d5 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:33.734102 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-3d9d2279-553c-4a46-8ba5-d4b70e26b4d5 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:33.740156 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3d9d2279-553c-4a46-8ba5-d4b70e26b4d5 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:33.740606 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3d9d2279-553c-4a46-8ba5-d4b70e26b4d5 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:33.741360 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3d9d2279-553c-4a46-8ba5-d4b70e26b4d5 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:33.741795 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3d9d2279-553c-4a46-8ba5-d4b70e26b4d5 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:33.868675 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-3d9d2279-553c-4a46-8ba5-d4b70e26b4d5 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:33.877083 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-3d9d2279-553c-4a46-8ba5-d4b70e26b4d5 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.147968 Jul 11 11:45:33.877640 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1212/2428] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:33 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:34.176542 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-a461f5ae-129f-4ac7-a631-116783a4a2ef tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:34.177244 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-a461f5ae-129f-4ac7-a631-116783a4a2ef tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:34.183785 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a461f5ae-129f-4ac7-a631-116783a4a2ef tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:34.184232 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a461f5ae-129f-4ac7-a631-116783a4a2ef tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:34.185045 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a461f5ae-129f-4ac7-a631-116783a4a2ef tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:34.185422 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a461f5ae-129f-4ac7-a631-116783a4a2ef tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:34.314570 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-a461f5ae-129f-4ac7-a631-116783a4a2ef tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:34.322732 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-a461f5ae-129f-4ac7-a631-116783a4a2ef tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.149830 Jul 11 11:45:34.323319 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1217/2429] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:34 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:34.337768 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-4e022965-473a-4dd8-b04a-be6ce7b45abc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:34.338312 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-4e022965-473a-4dd8-b04a-be6ce7b45abc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:34.345298 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4e022965-473a-4dd8-b04a-be6ce7b45abc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:34.345737 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4e022965-473a-4dd8-b04a-be6ce7b45abc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:34.346483 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4e022965-473a-4dd8-b04a-be6ce7b45abc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:34.346913 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4e022965-473a-4dd8-b04a-be6ce7b45abc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:34.411740 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-4e022965-473a-4dd8-b04a-be6ce7b45abc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:34.419965 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-4e022965-473a-4dd8-b04a-be6ce7b45abc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.086039 Jul 11 11:45:34.420526 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1213/2430] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:34 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:34.893902 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-08d7f4e6-509a-41a6-a78e-4e2ed6a8d6da tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:34.894518 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-08d7f4e6-509a-41a6-a78e-4e2ed6a8d6da tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:34.900575 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-08d7f4e6-509a-41a6-a78e-4e2ed6a8d6da tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:34.901029 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-08d7f4e6-509a-41a6-a78e-4e2ed6a8d6da tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:34.901821 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-08d7f4e6-509a-41a6-a78e-4e2ed6a8d6da tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:34.902257 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-08d7f4e6-509a-41a6-a78e-4e2ed6a8d6da tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:35.042221 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-08d7f4e6-509a-41a6-a78e-4e2ed6a8d6da tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:35.050646 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-08d7f4e6-509a-41a6-a78e-4e2ed6a8d6da tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.160604 Jul 11 11:45:35.051225 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1218/2431] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:34 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:35.339905 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-a517bd79-db8e-4e2a-b61f-6d3a759ff06e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:35.340521 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-a517bd79-db8e-4e2a-b61f-6d3a759ff06e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:35.351485 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a517bd79-db8e-4e2a-b61f-6d3a759ff06e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:35.351918 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a517bd79-db8e-4e2a-b61f-6d3a759ff06e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:35.352720 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a517bd79-db8e-4e2a-b61f-6d3a759ff06e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:35.353155 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a517bd79-db8e-4e2a-b61f-6d3a759ff06e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:35.437491 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-f2e09b20-7193-4c9b-8491-5b50619a33cf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:35.438158 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-f2e09b20-7193-4c9b-8491-5b50619a33cf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:35.444691 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f2e09b20-7193-4c9b-8491-5b50619a33cf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:35.445157 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f2e09b20-7193-4c9b-8491-5b50619a33cf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:35.445920 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f2e09b20-7193-4c9b-8491-5b50619a33cf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:35.446346 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f2e09b20-7193-4c9b-8491-5b50619a33cf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:35.483342 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-a517bd79-db8e-4e2a-b61f-6d3a759ff06e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:35.491343 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-a517bd79-db8e-4e2a-b61f-6d3a759ff06e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.155259 Jul 11 11:45:35.501773 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1214/2432] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:35 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:35.513352 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-f2e09b20-7193-4c9b-8491-5b50619a33cf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:35.521207 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-f2e09b20-7193-4c9b-8491-5b50619a33cf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.088113 Jul 11 11:45:35.521776 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1219/2433] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:35 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:45:36.068277 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-09b381e4-1c6a-43fe-b737-8ad90a4c1f15 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:36.068920 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-09b381e4-1c6a-43fe-b737-8ad90a4c1f15 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:36.075553 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-09b381e4-1c6a-43fe-b737-8ad90a4c1f15 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:36.076006 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-09b381e4-1c6a-43fe-b737-8ad90a4c1f15 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:36.076769 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-09b381e4-1c6a-43fe-b737-8ad90a4c1f15 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:36.077207 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-09b381e4-1c6a-43fe-b737-8ad90a4c1f15 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:36.206872 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-09b381e4-1c6a-43fe-b737-8ad90a4c1f15 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:36.215266 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-09b381e4-1c6a-43fe-b737-8ad90a4c1f15 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.150850 Jul 11 11:45:36.215843 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1215/2434] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:36 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:36.508958 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-c748c1ec-0880-4b16-96b5-b62e68330927 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:36.509562 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-c748c1ec-0880-4b16-96b5-b62e68330927 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:36.516675 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c748c1ec-0880-4b16-96b5-b62e68330927 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:36.517120 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c748c1ec-0880-4b16-96b5-b62e68330927 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:36.517866 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c748c1ec-0880-4b16-96b5-b62e68330927 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:36.518295 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c748c1ec-0880-4b16-96b5-b62e68330927 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:36.537731 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-eebb8325-d2b8-4f3f-835a-b4d1af9186cb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:36.538387 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-eebb8325-d2b8-4f3f-835a-b4d1af9186cb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:36.545412 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-eebb8325-d2b8-4f3f-835a-b4d1af9186cb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:36.545866 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-eebb8325-d2b8-4f3f-835a-b4d1af9186cb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:36.546628 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-eebb8325-d2b8-4f3f-835a-b4d1af9186cb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:36.547068 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-eebb8325-d2b8-4f3f-835a-b4d1af9186cb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:36.612408 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-eebb8325-d2b8-4f3f-835a-b4d1af9186cb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:36.620321 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-eebb8325-d2b8-4f3f-835a-b4d1af9186cb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.086315 Jul 11 11:45:36.620863 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1216/2435] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:36 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:45:36.648077 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-c748c1ec-0880-4b16-96b5-b62e68330927 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:36.656506 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-c748c1ec-0880-4b16-96b5-b62e68330927 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.151423 Jul 11 11:45:36.657085 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1220/2436] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:36 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:37.232336 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-791fc06b-d64e-41c2-b8ea-1bcd998050b4 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:37.232944 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-791fc06b-d64e-41c2-b8ea-1bcd998050b4 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:37.238906 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-791fc06b-d64e-41c2-b8ea-1bcd998050b4 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:37.239387 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-791fc06b-d64e-41c2-b8ea-1bcd998050b4 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:37.240136 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-791fc06b-d64e-41c2-b8ea-1bcd998050b4 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:37.240567 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-791fc06b-d64e-41c2-b8ea-1bcd998050b4 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:37.365029 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-791fc06b-d64e-41c2-b8ea-1bcd998050b4 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:37.373403 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-791fc06b-d64e-41c2-b8ea-1bcd998050b4 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.144899 Jul 11 11:45:37.373966 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1217/2437] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:37 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:37.637796 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-a517a89a-e902-410a-9da5-a234aa5b7000 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:37.642594 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-a517a89a-e902-410a-9da5-a234aa5b7000 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:37.644904 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a517a89a-e902-410a-9da5-a234aa5b7000 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:37.645351 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a517a89a-e902-410a-9da5-a234aa5b7000 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:37.646109 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a517a89a-e902-410a-9da5-a234aa5b7000 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:37.646544 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a517a89a-e902-410a-9da5-a234aa5b7000 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:37.674080 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-609f2924-7065-4116-b31d-b4565dea8a3d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:37.674685 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-609f2924-7065-4116-b31d-b4565dea8a3d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:37.680831 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-609f2924-7065-4116-b31d-b4565dea8a3d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:37.681272 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-609f2924-7065-4116-b31d-b4565dea8a3d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:37.682053 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-609f2924-7065-4116-b31d-b4565dea8a3d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:37.682485 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-609f2924-7065-4116-b31d-b4565dea8a3d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:37.685086 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=100 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:45:37.708524 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-a517a89a-e902-410a-9da5-a234aa5b7000 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:37.716992 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-a517a89a-e902-410a-9da5-a234aa5b7000 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.083002 Jul 11 11:45:37.717645 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1221/2438] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:37 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:37.810020 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-609f2924-7065-4116-b31d-b4565dea8a3d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:37.818116 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-609f2924-7065-4116-b31d-b4565dea8a3d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.147762 Jul 11 11:45:37.818692 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1218/2439] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:37 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:45:38.390448 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-3e233f31-30f8-452a-a057-0eed3aef68f0 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:38.390978 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-3e233f31-30f8-452a-a057-0eed3aef68f0 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:38.397003 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3e233f31-30f8-452a-a057-0eed3aef68f0 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:38.397439 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3e233f31-30f8-452a-a057-0eed3aef68f0 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:38.398179 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3e233f31-30f8-452a-a057-0eed3aef68f0 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:38.398607 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3e233f31-30f8-452a-a057-0eed3aef68f0 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:38.527735 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-3e233f31-30f8-452a-a057-0eed3aef68f0 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:38.535495 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-3e233f31-30f8-452a-a057-0eed3aef68f0 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.148891 Jul 11 11:45:38.536060 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1222/2440] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:38 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:38.733794 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-2b026cc0-acb9-4d85-84c9-c0a38743cc91 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:38.734428 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-2b026cc0-acb9-4d85-84c9-c0a38743cc91 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:38.740858 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2b026cc0-acb9-4d85-84c9-c0a38743cc91 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:38.741301 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2b026cc0-acb9-4d85-84c9-c0a38743cc91 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:38.742076 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2b026cc0-acb9-4d85-84c9-c0a38743cc91 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:38.742508 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2b026cc0-acb9-4d85-84c9-c0a38743cc91 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:38.805914 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-2b026cc0-acb9-4d85-84c9-c0a38743cc91 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:38.814323 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-2b026cc0-acb9-4d85-84c9-c0a38743cc91 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.084374 Jul 11 11:45:38.815072 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1219/2441] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:38 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:38.835110 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-b1ede598-a0e1-4f0e-8b58-b70ece623aeb tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:38.835791 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-b1ede598-a0e1-4f0e-8b58-b70ece623aeb tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:38.842682 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b1ede598-a0e1-4f0e-8b58-b70ece623aeb tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:38.843125 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b1ede598-a0e1-4f0e-8b58-b70ece623aeb tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:38.843904 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b1ede598-a0e1-4f0e-8b58-b70ece623aeb tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:38.844339 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b1ede598-a0e1-4f0e-8b58-b70ece623aeb tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:38.969528 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-b1ede598-a0e1-4f0e-8b58-b70ece623aeb tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:38.977413 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-b1ede598-a0e1-4f0e-8b58-b70ece623aeb tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.146140 Jul 11 11:45:38.985523 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1223/2442] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:38 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:39.552505 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-df9a4e5e-9229-48fa-ad10-2f62b2b8cbe1 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:39.553114 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-df9a4e5e-9229-48fa-ad10-2f62b2b8cbe1 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:39.559815 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-df9a4e5e-9229-48fa-ad10-2f62b2b8cbe1 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:39.560203 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-df9a4e5e-9229-48fa-ad10-2f62b2b8cbe1 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:39.560947 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-df9a4e5e-9229-48fa-ad10-2f62b2b8cbe1 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:39.561373 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-df9a4e5e-9229-48fa-ad10-2f62b2b8cbe1 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:39.693843 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-df9a4e5e-9229-48fa-ad10-2f62b2b8cbe1 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:39.710170 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-df9a4e5e-9229-48fa-ad10-2f62b2b8cbe1 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.161052 Jul 11 11:45:39.711212 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1220/2443] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:39 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:39.831896 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-324e9c61-d7eb-42f9-8479-8852ae87052e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:39.832431 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-324e9c61-d7eb-42f9-8479-8852ae87052e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:39.838458 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-324e9c61-d7eb-42f9-8479-8852ae87052e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:39.839753 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-324e9c61-d7eb-42f9-8479-8852ae87052e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:39.840288 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-324e9c61-d7eb-42f9-8479-8852ae87052e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:39.840720 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-324e9c61-d7eb-42f9-8479-8852ae87052e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:39.844985 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=100 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:45:39.902865 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-324e9c61-d7eb-42f9-8479-8852ae87052e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:39.910838 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-324e9c61-d7eb-42f9-8479-8852ae87052e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.082875 Jul 11 11:45:39.911503 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1224/2444] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:39 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:40.001624 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-8e9b44fd-3639-42d3-b949-5d8b8351cc79 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:40.002486 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-8e9b44fd-3639-42d3-b949-5d8b8351cc79 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:40.008754 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8e9b44fd-3639-42d3-b949-5d8b8351cc79 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:40.009220 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8e9b44fd-3639-42d3-b949-5d8b8351cc79 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:40.009953 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8e9b44fd-3639-42d3-b949-5d8b8351cc79 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:40.010386 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8e9b44fd-3639-42d3-b949-5d8b8351cc79 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:40.144473 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-8e9b44fd-3639-42d3-b949-5d8b8351cc79 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:40.152465 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-8e9b44fd-3639-42d3-b949-5d8b8351cc79 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.154779 Jul 11 11:45:40.153040 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1221/2445] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:39 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:40.727793 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-e59a0a7a-02e4-496b-9627-5e98a0e41e6d tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:40.728406 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-e59a0a7a-02e4-496b-9627-5e98a0e41e6d tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:40.735045 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e59a0a7a-02e4-496b-9627-5e98a0e41e6d tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:40.735502 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e59a0a7a-02e4-496b-9627-5e98a0e41e6d tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:40.736263 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e59a0a7a-02e4-496b-9627-5e98a0e41e6d tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:40.736706 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e59a0a7a-02e4-496b-9627-5e98a0e41e6d tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:40.866307 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-e59a0a7a-02e4-496b-9627-5e98a0e41e6d tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:40.874171 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-e59a0a7a-02e4-496b-9627-5e98a0e41e6d tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.150214 Jul 11 11:45:40.874740 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1225/2446] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:40 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:40.927560 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-79704bc5-e169-4aa4-98bf-bd771f2e9df9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:40.928164 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-79704bc5-e169-4aa4-98bf-bd771f2e9df9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:40.934250 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-79704bc5-e169-4aa4-98bf-bd771f2e9df9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:40.934693 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-79704bc5-e169-4aa4-98bf-bd771f2e9df9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:40.935545 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-79704bc5-e169-4aa4-98bf-bd771f2e9df9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:40.935983 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-79704bc5-e169-4aa4-98bf-bd771f2e9df9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:40.999936 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-79704bc5-e169-4aa4-98bf-bd771f2e9df9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:41.008089 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-79704bc5-e169-4aa4-98bf-bd771f2e9df9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.084330 Jul 11 11:45:41.008679 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1222/2447] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:40 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:41.170052 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-6caf7375-1c40-4f85-8cd1-9445c4708835 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:41.170661 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-6caf7375-1c40-4f85-8cd1-9445c4708835 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:41.176701 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6caf7375-1c40-4f85-8cd1-9445c4708835 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:41.177146 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6caf7375-1c40-4f85-8cd1-9445c4708835 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:41.177893 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6caf7375-1c40-4f85-8cd1-9445c4708835 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:41.178326 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6caf7375-1c40-4f85-8cd1-9445c4708835 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:41.304008 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-6caf7375-1c40-4f85-8cd1-9445c4708835 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:41.312995 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-6caf7375-1c40-4f85-8cd1-9445c4708835 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.147238 Jul 11 11:45:41.313572 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1226/2448] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:41 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:41.891933 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-0cd0c230-9ea3-4a7c-8e66-7061cf131fca tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:41.892539 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-0cd0c230-9ea3-4a7c-8e66-7061cf131fca tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:41.898905 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0cd0c230-9ea3-4a7c-8e66-7061cf131fca tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:41.899408 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0cd0c230-9ea3-4a7c-8e66-7061cf131fca tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:41.900171 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0cd0c230-9ea3-4a7c-8e66-7061cf131fca tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:41.900713 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0cd0c230-9ea3-4a7c-8e66-7061cf131fca tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:42.030296 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-7dd47415-a2af-4931-b270-4568e8b36bd0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:42.031391 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-7dd47415-a2af-4931-b270-4568e8b36bd0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:42.043883 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7dd47415-a2af-4931-b270-4568e8b36bd0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:42.043883 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7dd47415-a2af-4931-b270-4568e8b36bd0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:42.044918 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7dd47415-a2af-4931-b270-4568e8b36bd0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:42.045637 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7dd47415-a2af-4931-b270-4568e8b36bd0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:42.046051 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-0cd0c230-9ea3-4a7c-8e66-7061cf131fca tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:42.055746 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-0cd0c230-9ea3-4a7c-8e66-7061cf131fca tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.167555 Jul 11 11:45:42.059293 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1223/2449] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:41 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:42.111413 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-7dd47415-a2af-4931-b270-4568e8b36bd0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:42.119167 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-7dd47415-a2af-4931-b270-4568e8b36bd0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.096881 Jul 11 11:45:42.119761 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1227/2450] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:42 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:42.329614 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-b6536b2c-477d-45a1-8d53-e6057a43f3d1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:42.330252 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-b6536b2c-477d-45a1-8d53-e6057a43f3d1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:42.336895 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b6536b2c-477d-45a1-8d53-e6057a43f3d1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:42.337361 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b6536b2c-477d-45a1-8d53-e6057a43f3d1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:42.338084 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b6536b2c-477d-45a1-8d53-e6057a43f3d1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:42.338511 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b6536b2c-477d-45a1-8d53-e6057a43f3d1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:42.465879 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-b6536b2c-477d-45a1-8d53-e6057a43f3d1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:42.473731 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-b6536b2c-477d-45a1-8d53-e6057a43f3d1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.148006 Jul 11 11:45:42.474302 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1224/2451] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:42 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:43.077499 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-32b43232-1ec8-49ff-a5c2-4b54dfd4e378 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:43.078113 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-32b43232-1ec8-49ff-a5c2-4b54dfd4e378 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:43.084698 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-32b43232-1ec8-49ff-a5c2-4b54dfd4e378 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:43.085147 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-32b43232-1ec8-49ff-a5c2-4b54dfd4e378 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:43.085901 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-32b43232-1ec8-49ff-a5c2-4b54dfd4e378 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:43.086335 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-32b43232-1ec8-49ff-a5c2-4b54dfd4e378 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:43.137385 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-d744df12-21fb-43a7-b780-0ade2f84917a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:43.137994 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-d744df12-21fb-43a7-b780-0ade2f84917a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:43.144510 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d744df12-21fb-43a7-b780-0ade2f84917a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:43.144957 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d744df12-21fb-43a7-b780-0ade2f84917a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:43.145720 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d744df12-21fb-43a7-b780-0ade2f84917a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:43.146158 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d744df12-21fb-43a7-b780-0ade2f84917a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:43.210878 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-d744df12-21fb-43a7-b780-0ade2f84917a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:43.218865 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-32b43232-1ec8-49ff-a5c2-4b54dfd4e378 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:43.219694 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-d744df12-21fb-43a7-b780-0ade2f84917a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.086705 Jul 11 11:45:43.220279 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1225/2452] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:43 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:45:43.226694 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-32b43232-1ec8-49ff-a5c2-4b54dfd4e378 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.153577 Jul 11 11:45:43.227262 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1228/2453] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:43 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:43.489927 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-461a1ab5-2b29-4e5e-942f-3f126f8fcb47 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:43.490581 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-461a1ab5-2b29-4e5e-942f-3f126f8fcb47 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:43.496639 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-461a1ab5-2b29-4e5e-942f-3f126f8fcb47 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:43.497077 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-461a1ab5-2b29-4e5e-942f-3f126f8fcb47 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:43.497830 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-461a1ab5-2b29-4e5e-942f-3f126f8fcb47 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:43.498262 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-461a1ab5-2b29-4e5e-942f-3f126f8fcb47 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:43.625396 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-461a1ab5-2b29-4e5e-942f-3f126f8fcb47 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:43.633145 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-461a1ab5-2b29-4e5e-942f-3f126f8fcb47 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.147142 Jul 11 11:45:43.633708 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1226/2454] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:43 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:44.236569 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-1cac268f-b5b7-40f0-9976-265d091e6be7 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:44.237167 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-1cac268f-b5b7-40f0-9976-265d091e6be7 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:44.243692 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1cac268f-b5b7-40f0-9976-265d091e6be7 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:44.244139 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1cac268f-b5b7-40f0-9976-265d091e6be7 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:44.244267 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-f074b28a-feee-4a59-8a91-9a17bed21d48 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:44.244793 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-f074b28a-feee-4a59-8a91-9a17bed21d48 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:44.244915 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1cac268f-b5b7-40f0-9976-265d091e6be7 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:44.245324 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1cac268f-b5b7-40f0-9976-265d091e6be7 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:44.251172 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f074b28a-feee-4a59-8a91-9a17bed21d48 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:44.251644 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f074b28a-feee-4a59-8a91-9a17bed21d48 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:44.252388 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f074b28a-feee-4a59-8a91-9a17bed21d48 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:44.252818 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f074b28a-feee-4a59-8a91-9a17bed21d48 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:44.307119 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-1cac268f-b5b7-40f0-9976-265d091e6be7 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:44.316010 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-1cac268f-b5b7-40f0-9976-265d091e6be7 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.083276 Jul 11 11:45:44.316787 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1229/2455] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:44 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:44.382185 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-f074b28a-feee-4a59-8a91-9a17bed21d48 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:44.390035 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-f074b28a-feee-4a59-8a91-9a17bed21d48 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.149643 Jul 11 11:45:44.390599 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1227/2456] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:44 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:44.650033 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-88837baf-cf06-4fa4-8f0e-467c2496cd1b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:44.650558 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-88837baf-cf06-4fa4-8f0e-467c2496cd1b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:44.656993 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-88837baf-cf06-4fa4-8f0e-467c2496cd1b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:44.657436 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-88837baf-cf06-4fa4-8f0e-467c2496cd1b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:44.658184 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-88837baf-cf06-4fa4-8f0e-467c2496cd1b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:44.658609 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-88837baf-cf06-4fa4-8f0e-467c2496cd1b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:44.786737 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-88837baf-cf06-4fa4-8f0e-467c2496cd1b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:44.795053 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-88837baf-cf06-4fa4-8f0e-467c2496cd1b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.149041 Jul 11 11:45:44.795636 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1230/2457] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:44 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:45.333233 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-8112acfb-f550-4f94-94e0-0388f01d6bbf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:45.333764 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-8112acfb-f550-4f94-94e0-0388f01d6bbf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:45.340693 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8112acfb-f550-4f94-94e0-0388f01d6bbf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:45.341145 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8112acfb-f550-4f94-94e0-0388f01d6bbf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:45.341905 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8112acfb-f550-4f94-94e0-0388f01d6bbf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:45.342346 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8112acfb-f550-4f94-94e0-0388f01d6bbf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:45.405720 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-8112acfb-f550-4f94-94e0-0388f01d6bbf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:45.410810 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-c88cc999-17fc-43ed-84f3-c8c07cac68c0 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:45.411451 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-c88cc999-17fc-43ed-84f3-c8c07cac68c0 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:45.413666 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-8112acfb-f550-4f94-94e0-0388f01d6bbf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.084311 Jul 11 11:45:45.414237 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1228/2458] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:45 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:45.418187 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c88cc999-17fc-43ed-84f3-c8c07cac68c0 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:45.418631 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c88cc999-17fc-43ed-84f3-c8c07cac68c0 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:45.419426 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c88cc999-17fc-43ed-84f3-c8c07cac68c0 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:45.419864 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c88cc999-17fc-43ed-84f3-c8c07cac68c0 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:45.550927 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-c88cc999-17fc-43ed-84f3-c8c07cac68c0 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:45.559457 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-c88cc999-17fc-43ed-84f3-c8c07cac68c0 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.152396 Jul 11 11:45:45.560032 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1231/2459] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:45 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:45.812318 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-3846d39f-f054-4d8f-92dd-09fdd79da82a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:45.812931 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-3846d39f-f054-4d8f-92dd-09fdd79da82a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:45.819577 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3846d39f-f054-4d8f-92dd-09fdd79da82a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:45.820031 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3846d39f-f054-4d8f-92dd-09fdd79da82a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:45.820793 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3846d39f-f054-4d8f-92dd-09fdd79da82a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:45.821228 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3846d39f-f054-4d8f-92dd-09fdd79da82a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:45.947231 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-3846d39f-f054-4d8f-92dd-09fdd79da82a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:45.955413 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-3846d39f-f054-4d8f-92dd-09fdd79da82a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.147130 Jul 11 11:45:45.955981 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1229/2460] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:45 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:46.431168 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-3ce92611-7235-4681-9646-babd7c9922d4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:46.431819 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-3ce92611-7235-4681-9646-babd7c9922d4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:46.438345 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3ce92611-7235-4681-9646-babd7c9922d4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:46.438796 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3ce92611-7235-4681-9646-babd7c9922d4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:46.439593 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3ce92611-7235-4681-9646-babd7c9922d4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:46.440028 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3ce92611-7235-4681-9646-babd7c9922d4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:46.500559 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-3ce92611-7235-4681-9646-babd7c9922d4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:46.508647 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-3ce92611-7235-4681-9646-babd7c9922d4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.081378 Jul 11 11:45:46.509220 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1232/2461] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:46 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:46.576994 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-e711521a-92cc-4053-b6ea-bf28a210d450 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:46.577636 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-e711521a-92cc-4053-b6ea-bf28a210d450 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:46.583652 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e711521a-92cc-4053-b6ea-bf28a210d450 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:46.584099 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e711521a-92cc-4053-b6ea-bf28a210d450 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:46.584854 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e711521a-92cc-4053-b6ea-bf28a210d450 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:46.585289 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e711521a-92cc-4053-b6ea-bf28a210d450 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:46.711464 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-e711521a-92cc-4053-b6ea-bf28a210d450 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:46.719238 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-e711521a-92cc-4053-b6ea-bf28a210d450 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.146782 Jul 11 11:45:46.719828 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1230/2462] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:46 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:46.973264 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-65fdc9b5-c9e6-454f-bfd7-9d3940089da3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:46.973828 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-65fdc9b5-c9e6-454f-bfd7-9d3940089da3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:46.980522 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-65fdc9b5-c9e6-454f-bfd7-9d3940089da3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:46.980973 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-65fdc9b5-c9e6-454f-bfd7-9d3940089da3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:46.981728 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-65fdc9b5-c9e6-454f-bfd7-9d3940089da3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:46.982164 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-65fdc9b5-c9e6-454f-bfd7-9d3940089da3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:47.113216 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-65fdc9b5-c9e6-454f-bfd7-9d3940089da3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:47.121135 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-65fdc9b5-c9e6-454f-bfd7-9d3940089da3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.151828 Jul 11 11:45:47.121709 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1233/2463] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:46 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:47.525882 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-4298d3a5-8716-4022-9958-7791416c6270 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:47.526498 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-4298d3a5-8716-4022-9958-7791416c6270 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:47.533060 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4298d3a5-8716-4022-9958-7791416c6270 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:47.533514 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4298d3a5-8716-4022-9958-7791416c6270 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:47.534275 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4298d3a5-8716-4022-9958-7791416c6270 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:47.534713 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4298d3a5-8716-4022-9958-7791416c6270 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:47.598395 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-4298d3a5-8716-4022-9958-7791416c6270 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:47.606301 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-4298d3a5-8716-4022-9958-7791416c6270 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.084291 Jul 11 11:45:47.606875 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1231/2464] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:47 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:47.736005 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-560e674d-c3f5-4454-b2fd-22a2fa1cbc1a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:47.736615 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-560e674d-c3f5-4454-b2fd-22a2fa1cbc1a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:47.743088 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-560e674d-c3f5-4454-b2fd-22a2fa1cbc1a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:47.743575 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-560e674d-c3f5-4454-b2fd-22a2fa1cbc1a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:47.744318 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-560e674d-c3f5-4454-b2fd-22a2fa1cbc1a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:47.744745 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-560e674d-c3f5-4454-b2fd-22a2fa1cbc1a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:47.874027 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-560e674d-c3f5-4454-b2fd-22a2fa1cbc1a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:47.881879 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-560e674d-c3f5-4454-b2fd-22a2fa1cbc1a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.149711 Jul 11 11:45:47.882451 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1234/2465] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:47 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:48.138790 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-ceecaadf-611f-49d8-9bef-07d478068797 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:48.139348 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-ceecaadf-611f-49d8-9bef-07d478068797 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:48.145280 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ceecaadf-611f-49d8-9bef-07d478068797 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:48.145725 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ceecaadf-611f-49d8-9bef-07d478068797 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:48.146498 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ceecaadf-611f-49d8-9bef-07d478068797 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:48.146927 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ceecaadf-611f-49d8-9bef-07d478068797 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:48.274999 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-ceecaadf-611f-49d8-9bef-07d478068797 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:48.282968 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-ceecaadf-611f-49d8-9bef-07d478068797 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.148570 Jul 11 11:45:48.283567 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1232/2466] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:48 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:48.623241 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-e277fea9-1fa9-4f18-a183-197b094c88b9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:48.623864 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-e277fea9-1fa9-4f18-a183-197b094c88b9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:48.629867 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e277fea9-1fa9-4f18-a183-197b094c88b9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:48.630311 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e277fea9-1fa9-4f18-a183-197b094c88b9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:48.631056 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e277fea9-1fa9-4f18-a183-197b094c88b9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:48.631507 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e277fea9-1fa9-4f18-a183-197b094c88b9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:48.692712 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-e277fea9-1fa9-4f18-a183-197b094c88b9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:48.700703 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-e277fea9-1fa9-4f18-a183-197b094c88b9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.081459 Jul 11 11:45:48.701272 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1235/2467] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:48 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:48.899281 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-ab785237-006a-4687-8975-e63e241b6d99 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:48.899828 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-ab785237-006a-4687-8975-e63e241b6d99 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:48.906942 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ab785237-006a-4687-8975-e63e241b6d99 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:48.907423 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ab785237-006a-4687-8975-e63e241b6d99 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:48.908172 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ab785237-006a-4687-8975-e63e241b6d99 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:48.908601 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ab785237-006a-4687-8975-e63e241b6d99 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:49.034794 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-ab785237-006a-4687-8975-e63e241b6d99 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:49.042657 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-ab785237-006a-4687-8975-e63e241b6d99 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.147292 Jul 11 11:45:49.043220 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1233/2468] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:48 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:45:49.300704 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-bcf5f806-45cf-4585-b271-4292e01419e9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:49.301316 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-bcf5f806-45cf-4585-b271-4292e01419e9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:49.308489 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bcf5f806-45cf-4585-b271-4292e01419e9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:49.308941 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bcf5f806-45cf-4585-b271-4292e01419e9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:49.309696 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bcf5f806-45cf-4585-b271-4292e01419e9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:49.310135 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bcf5f806-45cf-4585-b271-4292e01419e9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:49.443619 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-bcf5f806-45cf-4585-b271-4292e01419e9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:49.451910 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-bcf5f806-45cf-4585-b271-4292e01419e9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.155043 Jul 11 11:45:49.452484 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1236/2469] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:49 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:49.717365 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-45aeb906-fd6d-4008-b2d5-82299e566d75 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:49.717972 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-45aeb906-fd6d-4008-b2d5-82299e566d75 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:49.723992 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-45aeb906-fd6d-4008-b2d5-82299e566d75 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:49.724445 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-45aeb906-fd6d-4008-b2d5-82299e566d75 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:49.725198 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-45aeb906-fd6d-4008-b2d5-82299e566d75 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:49.725633 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-45aeb906-fd6d-4008-b2d5-82299e566d75 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:49.788205 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-45aeb906-fd6d-4008-b2d5-82299e566d75 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:49.790332 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=100 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:45:49.797215 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-45aeb906-fd6d-4008-b2d5-82299e566d75 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.084177 Jul 11 11:45:49.797779 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1234/2470] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:49 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:50.059692 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-04c3abf5-d95e-4952-86a2-c98c88d47bb8 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:50.060224 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-04c3abf5-d95e-4952-86a2-c98c88d47bb8 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:50.066196 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-04c3abf5-d95e-4952-86a2-c98c88d47bb8 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:50.066644 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-04c3abf5-d95e-4952-86a2-c98c88d47bb8 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:50.067430 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-04c3abf5-d95e-4952-86a2-c98c88d47bb8 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:50.067866 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-04c3abf5-d95e-4952-86a2-c98c88d47bb8 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:50.201982 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-04c3abf5-d95e-4952-86a2-c98c88d47bb8 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:50.209802 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-04c3abf5-d95e-4952-86a2-c98c88d47bb8 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.154088 Jul 11 11:45:50.219761 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1237/2471] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:50 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:50.469597 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-0857ff47-fca7-4435-9995-fc7ba8609721 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:50.470210 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-0857ff47-fca7-4435-9995-fc7ba8609721 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:50.476864 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0857ff47-fca7-4435-9995-fc7ba8609721 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:50.477317 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0857ff47-fca7-4435-9995-fc7ba8609721 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:50.478076 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0857ff47-fca7-4435-9995-fc7ba8609721 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:50.478510 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0857ff47-fca7-4435-9995-fc7ba8609721 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:50.604666 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-0857ff47-fca7-4435-9995-fc7ba8609721 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:50.612502 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-0857ff47-fca7-4435-9995-fc7ba8609721 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.147202 Jul 11 11:45:50.613068 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1235/2472] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:50 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:50.820789 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-0b29f962-157c-4325-a1c4-b32b64fe844e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:50.821351 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-0b29f962-157c-4325-a1c4-b32b64fe844e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:50.827965 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0b29f962-157c-4325-a1c4-b32b64fe844e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:50.828405 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0b29f962-157c-4325-a1c4-b32b64fe844e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:50.829146 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0b29f962-157c-4325-a1c4-b32b64fe844e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:50.829601 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0b29f962-157c-4325-a1c4-b32b64fe844e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:50.889840 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-0b29f962-157c-4325-a1c4-b32b64fe844e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:50.897524 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-0b29f962-157c-4325-a1c4-b32b64fe844e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.080728 Jul 11 11:45:50.898085 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1238/2473] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:50 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:51.226309 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-03c0d741-6995-4e82-8e6d-2014acfdca98 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:51.226914 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-03c0d741-6995-4e82-8e6d-2014acfdca98 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:51.233553 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-03c0d741-6995-4e82-8e6d-2014acfdca98 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:51.233997 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-03c0d741-6995-4e82-8e6d-2014acfdca98 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:51.234749 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-03c0d741-6995-4e82-8e6d-2014acfdca98 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:51.235180 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-03c0d741-6995-4e82-8e6d-2014acfdca98 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:51.363607 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-03c0d741-6995-4e82-8e6d-2014acfdca98 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:51.371422 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-03c0d741-6995-4e82-8e6d-2014acfdca98 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.148891 Jul 11 11:45:51.371983 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1236/2474] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:51 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:51.629876 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-65ac6838-9278-426c-bddf-6b7c3d0e1690 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:51.630407 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-65ac6838-9278-426c-bddf-6b7c3d0e1690 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:51.636964 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-65ac6838-9278-426c-bddf-6b7c3d0e1690 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:51.637410 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-65ac6838-9278-426c-bddf-6b7c3d0e1690 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:51.638168 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-65ac6838-9278-426c-bddf-6b7c3d0e1690 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:51.638602 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-65ac6838-9278-426c-bddf-6b7c3d0e1690 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:51.768073 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-65ac6838-9278-426c-bddf-6b7c3d0e1690 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:51.775965 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-65ac6838-9278-426c-bddf-6b7c3d0e1690 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.150012 Jul 11 11:45:51.777137 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1239/2475] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:51 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:51.914720 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-e439310d-b362-4cd8-b30e-9c6cf376ab96 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:51.915358 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-e439310d-b362-4cd8-b30e-9c6cf376ab96 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:51.921814 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e439310d-b362-4cd8-b30e-9c6cf376ab96 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:51.922261 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e439310d-b362-4cd8-b30e-9c6cf376ab96 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:51.923016 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e439310d-b362-4cd8-b30e-9c6cf376ab96 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:51.923480 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e439310d-b362-4cd8-b30e-9c6cf376ab96 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:51.989440 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-e439310d-b362-4cd8-b30e-9c6cf376ab96 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:51.997893 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-e439310d-b362-4cd8-b30e-9c6cf376ab96 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.086990 Jul 11 11:45:51.998480 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1237/2476] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:51 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:52.388187 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-c43c3430-647a-4ef2-99ec-59161afbe6c2 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:52.388797 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-c43c3430-647a-4ef2-99ec-59161afbe6c2 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:52.391097 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_api:SELECT=78 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:45:52.395836 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c43c3430-647a-4ef2-99ec-59161afbe6c2 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:52.396284 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c43c3430-647a-4ef2-99ec-59161afbe6c2 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:52.397038 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c43c3430-647a-4ef2-99ec-59161afbe6c2 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:52.397471 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c43c3430-647a-4ef2-99ec-59161afbe6c2 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:52.527060 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-c43c3430-647a-4ef2-99ec-59161afbe6c2 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:52.529233 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=100 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:45:52.535457 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-c43c3430-647a-4ef2-99ec-59161afbe6c2 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.151057 Jul 11 11:45:52.536025 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1240/2477] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:52 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:52.793419 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-0c149cb5-b9e7-479e-aefd-433dd4a98f86 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:52.794021 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-0c149cb5-b9e7-479e-aefd-433dd4a98f86 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:52.795928 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_api:SELECT=82 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:45:52.800915 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0c149cb5-b9e7-479e-aefd-433dd4a98f86 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:52.819921 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0c149cb5-b9e7-479e-aefd-433dd4a98f86 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:52.819921 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0c149cb5-b9e7-479e-aefd-433dd4a98f86 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:52.819921 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0c149cb5-b9e7-479e-aefd-433dd4a98f86 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:52.928039 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-0c149cb5-b9e7-479e-aefd-433dd4a98f86 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:52.936625 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-0c149cb5-b9e7-479e-aefd-433dd4a98f86 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.147078 Jul 11 11:45:52.937321 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1238/2478] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:52 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:53.015623 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-c81aeb7b-454e-46b3-82ff-a92a3b06b96e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:53.016229 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-c81aeb7b-454e-46b3-82ff-a92a3b06b96e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:53.022423 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c81aeb7b-454e-46b3-82ff-a92a3b06b96e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:53.022862 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c81aeb7b-454e-46b3-82ff-a92a3b06b96e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:53.023634 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c81aeb7b-454e-46b3-82ff-a92a3b06b96e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:53.024061 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c81aeb7b-454e-46b3-82ff-a92a3b06b96e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:53.085982 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-c81aeb7b-454e-46b3-82ff-a92a3b06b96e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:53.094032 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-c81aeb7b-454e-46b3-82ff-a92a3b06b96e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.083036 Jul 11 11:45:53.094594 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1241/2479] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:53 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:53.552521 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-bc8248da-f157-456a-ab94-eb0dcb786774 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:53.553158 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-bc8248da-f157-456a-ab94-eb0dcb786774 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:53.559713 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-bc8248da-f157-456a-ab94-eb0dcb786774 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:53.560158 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-bc8248da-f157-456a-ab94-eb0dcb786774 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:53.560909 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-bc8248da-f157-456a-ab94-eb0dcb786774 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:53.561340 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-bc8248da-f157-456a-ab94-eb0dcb786774 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:53.687389 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-bc8248da-f157-456a-ab94-eb0dcb786774 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:53.695096 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-bc8248da-f157-456a-ab94-eb0dcb786774 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.146417 Jul 11 11:45:53.695712 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1239/2480] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:53 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:53.954530 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-c4a1a78b-9d3a-44d2-9f09-e17acad395a9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:53.955141 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-c4a1a78b-9d3a-44d2-9f09-e17acad395a9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:53.961747 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c4a1a78b-9d3a-44d2-9f09-e17acad395a9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:53.962200 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c4a1a78b-9d3a-44d2-9f09-e17acad395a9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:53.962960 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c4a1a78b-9d3a-44d2-9f09-e17acad395a9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:53.963432 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c4a1a78b-9d3a-44d2-9f09-e17acad395a9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:54.099805 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-c4a1a78b-9d3a-44d2-9f09-e17acad395a9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:54.108655 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-c4a1a78b-9d3a-44d2-9f09-e17acad395a9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.157768 Jul 11 11:45:54.109162 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1242/2481] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:53 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:54.110897 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-0d3abc00-8f2a-44d6-bec6-8b742bfe48b6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:54.111540 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-0d3abc00-8f2a-44d6-bec6-8b742bfe48b6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:54.118019 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0d3abc00-8f2a-44d6-bec6-8b742bfe48b6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:54.119236 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0d3abc00-8f2a-44d6-bec6-8b742bfe48b6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:54.119236 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0d3abc00-8f2a-44d6-bec6-8b742bfe48b6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:54.119662 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0d3abc00-8f2a-44d6-bec6-8b742bfe48b6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:54.188354 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-0d3abc00-8f2a-44d6-bec6-8b742bfe48b6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:54.196379 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-0d3abc00-8f2a-44d6-bec6-8b742bfe48b6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.089242 Jul 11 11:45:54.196971 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1240/2482] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:54 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:45:54.712116 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-598293cc-6a6f-4a04-ae2f-3579dad89bc3 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:54.712739 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-598293cc-6a6f-4a04-ae2f-3579dad89bc3 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:54.721510 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-598293cc-6a6f-4a04-ae2f-3579dad89bc3 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:54.721995 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-598293cc-6a6f-4a04-ae2f-3579dad89bc3 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:54.722777 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-598293cc-6a6f-4a04-ae2f-3579dad89bc3 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:54.723217 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-598293cc-6a6f-4a04-ae2f-3579dad89bc3 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:54.855716 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-598293cc-6a6f-4a04-ae2f-3579dad89bc3 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:54.863707 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-598293cc-6a6f-4a04-ae2f-3579dad89bc3 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.155496 Jul 11 11:45:54.864279 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1243/2483] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:54 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:55.125514 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-b1a98a47-cdea-4092-9c34-b7480206146d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:55.126133 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-b1a98a47-cdea-4092-9c34-b7480206146d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:55.132595 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b1a98a47-cdea-4092-9c34-b7480206146d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:55.133043 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b1a98a47-cdea-4092-9c34-b7480206146d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:55.133793 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b1a98a47-cdea-4092-9c34-b7480206146d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:55.134227 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b1a98a47-cdea-4092-9c34-b7480206146d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:55.213826 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-71538dd1-d60e-4f11-84e8-95f11bc32ca5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:55.214447 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-71538dd1-d60e-4f11-84e8-95f11bc32ca5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:55.220954 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-71538dd1-d60e-4f11-84e8-95f11bc32ca5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:55.221395 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-71538dd1-d60e-4f11-84e8-95f11bc32ca5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:55.222151 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-71538dd1-d60e-4f11-84e8-95f11bc32ca5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:55.222581 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-71538dd1-d60e-4f11-84e8-95f11bc32ca5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:55.259713 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-b1a98a47-cdea-4092-9c34-b7480206146d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:55.268310 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-b1a98a47-cdea-4092-9c34-b7480206146d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.146607 Jul 11 11:45:55.268890 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1241/2484] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:55 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:55.283809 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-71538dd1-d60e-4f11-84e8-95f11bc32ca5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:55.291651 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-71538dd1-d60e-4f11-84e8-95f11bc32ca5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.081633 Jul 11 11:45:55.292803 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1244/2485] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:55 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:45:55.882109 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-cf8c0deb-a51e-4f9b-a5ad-5f37c957857a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:55.882742 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-cf8c0deb-a51e-4f9b-a5ad-5f37c957857a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:55.889177 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cf8c0deb-a51e-4f9b-a5ad-5f37c957857a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:55.889619 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cf8c0deb-a51e-4f9b-a5ad-5f37c957857a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:55.890366 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cf8c0deb-a51e-4f9b-a5ad-5f37c957857a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:55.890793 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cf8c0deb-a51e-4f9b-a5ad-5f37c957857a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:56.017413 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-cf8c0deb-a51e-4f9b-a5ad-5f37c957857a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:56.025178 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-cf8c0deb-a51e-4f9b-a5ad-5f37c957857a tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.147505 Jul 11 11:45:56.025751 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1242/2486] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:55 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:56.285534 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-0a4486fb-2217-4083-a07d-a24dba7f38b6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:56.286176 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-0a4486fb-2217-4083-a07d-a24dba7f38b6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:56.293410 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0a4486fb-2217-4083-a07d-a24dba7f38b6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:56.293859 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0a4486fb-2217-4083-a07d-a24dba7f38b6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:56.294617 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0a4486fb-2217-4083-a07d-a24dba7f38b6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:56.295335 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0a4486fb-2217-4083-a07d-a24dba7f38b6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:56.310056 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-2e06b245-6eff-4483-a93c-69fb5633907c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:56.310669 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-2e06b245-6eff-4483-a93c-69fb5633907c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:56.317229 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2e06b245-6eff-4483-a93c-69fb5633907c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:56.317675 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2e06b245-6eff-4483-a93c-69fb5633907c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:56.318430 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2e06b245-6eff-4483-a93c-69fb5633907c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:56.318881 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2e06b245-6eff-4483-a93c-69fb5633907c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:56.383853 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-2e06b245-6eff-4483-a93c-69fb5633907c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:56.392007 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-2e06b245-6eff-4483-a93c-69fb5633907c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.086381 Jul 11 11:45:56.392592 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1243/2487] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:56 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:45:56.431691 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-0a4486fb-2217-4083-a07d-a24dba7f38b6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:56.439620 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-0a4486fb-2217-4083-a07d-a24dba7f38b6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.157866 Jul 11 11:45:56.440189 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1245/2488] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:56 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:57.042672 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-fa40d3cb-88d5-4f80-9f2e-75c67f4046ef tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:57.043292 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-fa40d3cb-88d5-4f80-9f2e-75c67f4046ef tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:57.049360 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fa40d3cb-88d5-4f80-9f2e-75c67f4046ef tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:57.049802 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fa40d3cb-88d5-4f80-9f2e-75c67f4046ef tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:57.050553 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fa40d3cb-88d5-4f80-9f2e-75c67f4046ef tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:57.050982 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fa40d3cb-88d5-4f80-9f2e-75c67f4046ef tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:57.185805 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-fa40d3cb-88d5-4f80-9f2e-75c67f4046ef tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:57.193587 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-fa40d3cb-88d5-4f80-9f2e-75c67f4046ef tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.155329 Jul 11 11:45:57.194158 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1244/2489] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:57 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:57.409397 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-a681b13a-0052-4dbf-82c9-20c4a39d7451 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:57.409978 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-a681b13a-0052-4dbf-82c9-20c4a39d7451 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:57.416903 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a681b13a-0052-4dbf-82c9-20c4a39d7451 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:57.417623 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a681b13a-0052-4dbf-82c9-20c4a39d7451 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:57.418816 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a681b13a-0052-4dbf-82c9-20c4a39d7451 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:57.419268 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a681b13a-0052-4dbf-82c9-20c4a39d7451 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:57.457021 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-4bdea82d-bb9a-4903-86de-6dce7bcb0874 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:57.457726 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-4bdea82d-bb9a-4903-86de-6dce7bcb0874 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:57.464720 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4bdea82d-bb9a-4903-86de-6dce7bcb0874 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:57.465241 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4bdea82d-bb9a-4903-86de-6dce7bcb0874 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:57.466068 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4bdea82d-bb9a-4903-86de-6dce7bcb0874 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:57.466568 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4bdea82d-bb9a-4903-86de-6dce7bcb0874 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:57.480724 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-a681b13a-0052-4dbf-82c9-20c4a39d7451 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:57.488532 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-a681b13a-0052-4dbf-82c9-20c4a39d7451 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.083339 Jul 11 11:45:57.489323 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1246/2490] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:57 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:57.594303 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-4bdea82d-bb9a-4903-86de-6dce7bcb0874 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:57.602245 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-4bdea82d-bb9a-4903-86de-6dce7bcb0874 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.148976 Jul 11 11:45:57.602820 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1245/2491] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:57 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:45:58.210811 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-e4d3064f-52fe-4d9f-abd6-37b8b0450a13 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:58.211484 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-e4d3064f-52fe-4d9f-abd6-37b8b0450a13 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:58.217986 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e4d3064f-52fe-4d9f-abd6-37b8b0450a13 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:58.218710 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e4d3064f-52fe-4d9f-abd6-37b8b0450a13 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:58.219467 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e4d3064f-52fe-4d9f-abd6-37b8b0450a13 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:58.224800 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e4d3064f-52fe-4d9f-abd6-37b8b0450a13 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:58.349982 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-e4d3064f-52fe-4d9f-abd6-37b8b0450a13 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:58.357840 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-e4d3064f-52fe-4d9f-abd6-37b8b0450a13 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.150846 Jul 11 11:45:58.358409 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1247/2492] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:58 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:58.505768 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-d989ecf0-c58c-42be-a7b7-1d1840bd6d5c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:58.506404 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-d989ecf0-c58c-42be-a7b7-1d1840bd6d5c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:58.513384 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d989ecf0-c58c-42be-a7b7-1d1840bd6d5c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:58.513825 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d989ecf0-c58c-42be-a7b7-1d1840bd6d5c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:58.514569 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d989ecf0-c58c-42be-a7b7-1d1840bd6d5c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:58.514997 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d989ecf0-c58c-42be-a7b7-1d1840bd6d5c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:58.578457 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-d989ecf0-c58c-42be-a7b7-1d1840bd6d5c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:58.586251 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-d989ecf0-c58c-42be-a7b7-1d1840bd6d5c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.084284 Jul 11 11:45:58.586815 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1246/2493] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:58 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:58.619088 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-4b1a11d2-1c70-4106-8608-5b3752865129 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:58.619676 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-4b1a11d2-1c70-4106-8608-5b3752865129 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:58.626108 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4b1a11d2-1c70-4106-8608-5b3752865129 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:58.626557 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4b1a11d2-1c70-4106-8608-5b3752865129 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:58.627387 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4b1a11d2-1c70-4106-8608-5b3752865129 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:58.627824 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4b1a11d2-1c70-4106-8608-5b3752865129 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:58.755143 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-4b1a11d2-1c70-4106-8608-5b3752865129 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:58.763810 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-4b1a11d2-1c70-4106-8608-5b3752865129 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.148637 Jul 11 11:45:58.764379 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1248/2494] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:58 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:59.374002 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-0424a7f1-7238-4a80-ae76-383385a98fa9 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:59.374539 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-0424a7f1-7238-4a80-ae76-383385a98fa9 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:59.380541 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0424a7f1-7238-4a80-ae76-383385a98fa9 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:59.380988 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0424a7f1-7238-4a80-ae76-383385a98fa9 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:59.381738 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0424a7f1-7238-4a80-ae76-383385a98fa9 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:59.382171 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0424a7f1-7238-4a80-ae76-383385a98fa9 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:59.507602 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-0424a7f1-7238-4a80-ae76-383385a98fa9 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:59.516503 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-0424a7f1-7238-4a80-ae76-383385a98fa9 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.146408 Jul 11 11:45:59.517068 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1247/2495] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:59 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:59.603485 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-50057b8d-46f1-44e9-97e6-be50dd716681 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:59.604190 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-50057b8d-46f1-44e9-97e6-be50dd716681 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:59.610182 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-50057b8d-46f1-44e9-97e6-be50dd716681 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:59.610625 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-50057b8d-46f1-44e9-97e6-be50dd716681 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:59.611413 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-50057b8d-46f1-44e9-97e6-be50dd716681 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:59.611850 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-50057b8d-46f1-44e9-97e6-be50dd716681 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:59.671235 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-50057b8d-46f1-44e9-97e6-be50dd716681 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:59.679111 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-50057b8d-46f1-44e9-97e6-be50dd716681 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.079462 Jul 11 11:45:59.679723 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1249/2496] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:59 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:45:59.780156 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-17c3f498-cc00-4dd6-b75c-eb954bbe1868 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:45:59.780759 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-17c3f498-cc00-4dd6-b75c-eb954bbe1868 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:45:59.786654 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-17c3f498-cc00-4dd6-b75c-eb954bbe1868 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:59.787094 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-17c3f498-cc00-4dd6-b75c-eb954bbe1868 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:59.787878 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-17c3f498-cc00-4dd6-b75c-eb954bbe1868 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:45:59.788307 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-17c3f498-cc00-4dd6-b75c-eb954bbe1868 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:45:59.915576 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-17c3f498-cc00-4dd6-b75c-eb954bbe1868 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:45:59.923954 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-17c3f498-cc00-4dd6-b75c-eb954bbe1868 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.147514 Jul 11 11:45:59.924483 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1248/2497] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:45:59 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:00.533538 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-c7ca8025-548c-4297-ae37-0a46c52db2d5 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:00.534072 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-c7ca8025-548c-4297-ae37-0a46c52db2d5 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:00.540122 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c7ca8025-548c-4297-ae37-0a46c52db2d5 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:00.540565 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c7ca8025-548c-4297-ae37-0a46c52db2d5 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:00.541350 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c7ca8025-548c-4297-ae37-0a46c52db2d5 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:00.542423 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c7ca8025-548c-4297-ae37-0a46c52db2d5 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:00.670419 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-c7ca8025-548c-4297-ae37-0a46c52db2d5 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:00.678515 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-c7ca8025-548c-4297-ae37-0a46c52db2d5 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.148993 Jul 11 11:46:00.679116 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1250/2498] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:00 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:46:00.696232 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-ec24eb42-b0c9-42b0-9255-9da1d67bd459 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:00.696845 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-ec24eb42-b0c9-42b0-9255-9da1d67bd459 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:00.704048 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ec24eb42-b0c9-42b0-9255-9da1d67bd459 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:00.704535 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ec24eb42-b0c9-42b0-9255-9da1d67bd459 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:00.705290 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ec24eb42-b0c9-42b0-9255-9da1d67bd459 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:00.705727 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ec24eb42-b0c9-42b0-9255-9da1d67bd459 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:00.770360 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-ec24eb42-b0c9-42b0-9255-9da1d67bd459 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:00.778872 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-ec24eb42-b0c9-42b0-9255-9da1d67bd459 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.086369 Jul 11 11:46:00.779472 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1249/2499] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:00 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:00.941199 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-24091934-cecb-4869-92b8-88f3ff1cc911 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:00.941807 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-24091934-cecb-4869-92b8-88f3ff1cc911 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:00.948625 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-24091934-cecb-4869-92b8-88f3ff1cc911 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:00.949073 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-24091934-cecb-4869-92b8-88f3ff1cc911 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:00.949832 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-24091934-cecb-4869-92b8-88f3ff1cc911 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:00.950264 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-24091934-cecb-4869-92b8-88f3ff1cc911 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:01.114688 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-24091934-cecb-4869-92b8-88f3ff1cc911 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:01.123049 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-24091934-cecb-4869-92b8-88f3ff1cc911 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.185633 Jul 11 11:46:01.123651 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1251/2500] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:00 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:01.694866 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-2e6fad5a-c504-4fd3-9f57-2454707ca5fd tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:01.695559 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-2e6fad5a-c504-4fd3-9f57-2454707ca5fd tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:01.702846 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2e6fad5a-c504-4fd3-9f57-2454707ca5fd tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:01.703483 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2e6fad5a-c504-4fd3-9f57-2454707ca5fd tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:01.704062 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2e6fad5a-c504-4fd3-9f57-2454707ca5fd tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:01.704497 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2e6fad5a-c504-4fd3-9f57-2454707ca5fd tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:01.795802 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-1b74feab-3ac4-43b4-9882-9f31d9cd805e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:01.796408 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-1b74feab-3ac4-43b4-9882-9f31d9cd805e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:01.802865 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1b74feab-3ac4-43b4-9882-9f31d9cd805e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:01.803336 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1b74feab-3ac4-43b4-9882-9f31d9cd805e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:01.804091 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1b74feab-3ac4-43b4-9882-9f31d9cd805e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:01.804519 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1b74feab-3ac4-43b4-9882-9f31d9cd805e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:01.831554 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-2e6fad5a-c504-4fd3-9f57-2454707ca5fd tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:01.839618 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-2e6fad5a-c504-4fd3-9f57-2454707ca5fd tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.148539 Jul 11 11:46:01.840195 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1250/2501] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:01 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:01.865909 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-1b74feab-3ac4-43b4-9882-9f31d9cd805e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:01.874262 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-1b74feab-3ac4-43b4-9882-9f31d9cd805e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.082237 Jul 11 11:46:01.874822 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1252/2502] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:01 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:46:02.140023 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-f4f4216a-cd57-4d8e-9988-9ef43d7cf6bc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:02.140629 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-f4f4216a-cd57-4d8e-9988-9ef43d7cf6bc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:02.146656 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f4f4216a-cd57-4d8e-9988-9ef43d7cf6bc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:02.147098 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f4f4216a-cd57-4d8e-9988-9ef43d7cf6bc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:02.147875 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f4f4216a-cd57-4d8e-9988-9ef43d7cf6bc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:02.148307 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f4f4216a-cd57-4d8e-9988-9ef43d7cf6bc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:02.165387 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=100 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:46:02.276660 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-f4f4216a-cd57-4d8e-9988-9ef43d7cf6bc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:02.285445 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-f4f4216a-cd57-4d8e-9988-9ef43d7cf6bc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.149330 Jul 11 11:46:02.286020 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1251/2503] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:02 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:02.856752 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-db145adb-eb33-4c2e-8fb9-3e3e8cd67b71 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:02.857345 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-db145adb-eb33-4c2e-8fb9-3e3e8cd67b71 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:02.863955 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-db145adb-eb33-4c2e-8fb9-3e3e8cd67b71 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:02.864400 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-db145adb-eb33-4c2e-8fb9-3e3e8cd67b71 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:02.865150 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-db145adb-eb33-4c2e-8fb9-3e3e8cd67b71 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:02.865581 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-db145adb-eb33-4c2e-8fb9-3e3e8cd67b71 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:02.891949 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-55a5409a-853f-4e8a-96db-f6b5db3335d9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:02.892562 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-55a5409a-853f-4e8a-96db-f6b5db3335d9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:02.899021 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-55a5409a-853f-4e8a-96db-f6b5db3335d9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:02.899504 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-55a5409a-853f-4e8a-96db-f6b5db3335d9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:02.900270 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-55a5409a-853f-4e8a-96db-f6b5db3335d9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:02.900707 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-55a5409a-853f-4e8a-96db-f6b5db3335d9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:02.968404 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-55a5409a-853f-4e8a-96db-f6b5db3335d9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:02.976369 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-55a5409a-853f-4e8a-96db-f6b5db3335d9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.088206 Jul 11 11:46:02.976952 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1252/2504] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:02 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:46:02.995917 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-db145adb-eb33-4c2e-8fb9-3e3e8cd67b71 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:03.003680 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-db145adb-eb33-4c2e-8fb9-3e3e8cd67b71 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.150920 Jul 11 11:46:03.004252 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1253/2505] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:02 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:03.302218 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-5ab429aa-d7f4-4d72-baa4-360e5e593388 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:03.302831 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-5ab429aa-d7f4-4d72-baa4-360e5e593388 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:03.309588 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5ab429aa-d7f4-4d72-baa4-360e5e593388 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:03.310038 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5ab429aa-d7f4-4d72-baa4-360e5e593388 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:03.310796 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5ab429aa-d7f4-4d72-baa4-360e5e593388 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:03.311241 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5ab429aa-d7f4-4d72-baa4-360e5e593388 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:03.442255 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-5ab429aa-d7f4-4d72-baa4-360e5e593388 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:03.450966 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-5ab429aa-d7f4-4d72-baa4-360e5e593388 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.152579 Jul 11 11:46:03.451569 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1253/2506] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:03 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:03.993389 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-b575737f-cce5-4390-ae0d-509bd2cf9a7c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:03.994093 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-b575737f-cce5-4390-ae0d-509bd2cf9a7c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:04.000663 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b575737f-cce5-4390-ae0d-509bd2cf9a7c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:04.001116 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b575737f-cce5-4390-ae0d-509bd2cf9a7c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:04.001870 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b575737f-cce5-4390-ae0d-509bd2cf9a7c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:04.002378 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b575737f-cce5-4390-ae0d-509bd2cf9a7c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:04.021255 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-b0790a4c-5573-41d2-9121-880f33cf77f3 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:04.021864 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-b0790a4c-5573-41d2-9121-880f33cf77f3 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:04.028986 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b0790a4c-5573-41d2-9121-880f33cf77f3 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:04.029438 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b0790a4c-5573-41d2-9121-880f33cf77f3 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:04.030190 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b0790a4c-5573-41d2-9121-880f33cf77f3 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:04.030633 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b0790a4c-5573-41d2-9121-880f33cf77f3 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:04.064403 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-b575737f-cce5-4390-ae0d-509bd2cf9a7c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:04.073144 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-b575737f-cce5-4390-ae0d-509bd2cf9a7c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.083250 Jul 11 11:46:04.079071 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1254/2507] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:03 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:04.176654 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-b0790a4c-5573-41d2-9121-880f33cf77f3 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:04.184639 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-b0790a4c-5573-41d2-9121-880f33cf77f3 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.167257 Jul 11 11:46:04.185265 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1254/2508] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:04 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:46:04.469079 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-c6192bce-0708-4a40-a883-d28356dcd71c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:04.469689 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-c6192bce-0708-4a40-a883-d28356dcd71c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:04.475622 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c6192bce-0708-4a40-a883-d28356dcd71c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:04.479788 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c6192bce-0708-4a40-a883-d28356dcd71c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:04.479788 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c6192bce-0708-4a40-a883-d28356dcd71c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:04.479788 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c6192bce-0708-4a40-a883-d28356dcd71c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:04.607207 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-c6192bce-0708-4a40-a883-d28356dcd71c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:04.615146 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-c6192bce-0708-4a40-a883-d28356dcd71c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.150036 Jul 11 11:46:04.619032 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1255/2509] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:04 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:46:05.089895 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-2058561d-96c5-425d-a561-e31715771fde tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:05.090503 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-2058561d-96c5-425d-a561-e31715771fde tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:05.096947 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2058561d-96c5-425d-a561-e31715771fde tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:05.097389 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2058561d-96c5-425d-a561-e31715771fde tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:05.098131 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2058561d-96c5-425d-a561-e31715771fde tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:05.098569 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2058561d-96c5-425d-a561-e31715771fde tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:05.160383 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-2058561d-96c5-425d-a561-e31715771fde tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:05.168741 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-2058561d-96c5-425d-a561-e31715771fde tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.082723 Jul 11 11:46:05.169313 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1255/2510] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:05 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:05.202063 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-d48c41d3-d9f3-43ef-b97b-38da14a8c9c8 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:05.202664 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-d48c41d3-d9f3-43ef-b97b-38da14a8c9c8 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:05.209134 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d48c41d3-d9f3-43ef-b97b-38da14a8c9c8 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:05.209792 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d48c41d3-d9f3-43ef-b97b-38da14a8c9c8 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:05.210312 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d48c41d3-d9f3-43ef-b97b-38da14a8c9c8 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:05.211137 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d48c41d3-d9f3-43ef-b97b-38da14a8c9c8 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:05.338605 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-d48c41d3-d9f3-43ef-b97b-38da14a8c9c8 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:05.346395 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-d48c41d3-d9f3-43ef-b97b-38da14a8c9c8 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.148118 Jul 11 11:46:05.346959 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1256/2511] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:05 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:05.631924 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-1a1ab26b-102d-4db5-bf11-fff74b19f12b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:05.632450 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-1a1ab26b-102d-4db5-bf11-fff74b19f12b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:05.638846 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1a1ab26b-102d-4db5-bf11-fff74b19f12b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:05.639385 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1a1ab26b-102d-4db5-bf11-fff74b19f12b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:05.640148 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1a1ab26b-102d-4db5-bf11-fff74b19f12b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:05.640578 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1a1ab26b-102d-4db5-bf11-fff74b19f12b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:05.769414 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-1a1ab26b-102d-4db5-bf11-fff74b19f12b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:05.777858 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-1a1ab26b-102d-4db5-bf11-fff74b19f12b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.149987 Jul 11 11:46:05.778425 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1256/2512] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:05 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:06.186052 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-67ceeaf2-6968-4c12-8e17-e46233b4a34e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:06.186689 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-67ceeaf2-6968-4c12-8e17-e46233b4a34e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:06.192796 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-67ceeaf2-6968-4c12-8e17-e46233b4a34e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:06.193244 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-67ceeaf2-6968-4c12-8e17-e46233b4a34e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:06.193995 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-67ceeaf2-6968-4c12-8e17-e46233b4a34e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:06.194432 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-67ceeaf2-6968-4c12-8e17-e46233b4a34e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:06.215842 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=100 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:46:06.266166 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-67ceeaf2-6968-4c12-8e17-e46233b4a34e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:06.274494 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-67ceeaf2-6968-4c12-8e17-e46233b4a34e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.092740 Jul 11 11:46:06.275078 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1257/2513] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:06 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:06.364071 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-555143f5-4f91-42dc-91cf-89c020e9cc27 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:06.364672 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-555143f5-4f91-42dc-91cf-89c020e9cc27 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:06.371805 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-555143f5-4f91-42dc-91cf-89c020e9cc27 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:06.372245 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-555143f5-4f91-42dc-91cf-89c020e9cc27 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:06.372991 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-555143f5-4f91-42dc-91cf-89c020e9cc27 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:06.373421 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-555143f5-4f91-42dc-91cf-89c020e9cc27 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:06.504922 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-555143f5-4f91-42dc-91cf-89c020e9cc27 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:06.513789 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-555143f5-4f91-42dc-91cf-89c020e9cc27 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.153742 Jul 11 11:46:06.514297 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1257/2514] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:06 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:06.796252 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-dc51d8dc-809d-4a89-880f-91255a1bcb4d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:06.796778 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-dc51d8dc-809d-4a89-880f-91255a1bcb4d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:06.803171 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-dc51d8dc-809d-4a89-880f-91255a1bcb4d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:06.803645 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-dc51d8dc-809d-4a89-880f-91255a1bcb4d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:06.804396 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-dc51d8dc-809d-4a89-880f-91255a1bcb4d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:06.804830 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-dc51d8dc-809d-4a89-880f-91255a1bcb4d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:06.933427 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-dc51d8dc-809d-4a89-880f-91255a1bcb4d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:06.941942 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-dc51d8dc-809d-4a89-880f-91255a1bcb4d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.149622 Jul 11 11:46:06.942490 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1258/2515] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:06 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:07.292157 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-a63c731f-c6a1-4fbf-8609-592b98d2afff tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:07.292772 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-a63c731f-c6a1-4fbf-8609-592b98d2afff tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:07.298767 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a63c731f-c6a1-4fbf-8609-592b98d2afff tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:07.299304 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a63c731f-c6a1-4fbf-8609-592b98d2afff tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:07.300314 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a63c731f-c6a1-4fbf-8609-592b98d2afff tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:07.300784 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a63c731f-c6a1-4fbf-8609-592b98d2afff tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:07.361797 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-a63c731f-c6a1-4fbf-8609-592b98d2afff tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:07.370651 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-a63c731f-c6a1-4fbf-8609-592b98d2afff tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.082849 Jul 11 11:46:07.371275 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1258/2516] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:07 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:07.530110 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-9f6ed3ea-fb3c-4196-91e1-643f0ce82e6d tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:07.530701 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-9f6ed3ea-fb3c-4196-91e1-643f0ce82e6d tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:07.537128 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9f6ed3ea-fb3c-4196-91e1-643f0ce82e6d tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:07.537570 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9f6ed3ea-fb3c-4196-91e1-643f0ce82e6d tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:07.538311 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9f6ed3ea-fb3c-4196-91e1-643f0ce82e6d tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:07.538756 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9f6ed3ea-fb3c-4196-91e1-643f0ce82e6d tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:07.667599 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-9f6ed3ea-fb3c-4196-91e1-643f0ce82e6d tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:07.675539 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-9f6ed3ea-fb3c-4196-91e1-643f0ce82e6d tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.149164 Jul 11 11:46:07.676102 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1259/2517] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:07 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:07.959871 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-f93d398a-dd71-4ffd-885b-90568a1c8035 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:07.960479 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-f93d398a-dd71-4ffd-885b-90568a1c8035 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:07.966655 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f93d398a-dd71-4ffd-885b-90568a1c8035 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:07.967098 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f93d398a-dd71-4ffd-885b-90568a1c8035 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:07.967880 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f93d398a-dd71-4ffd-885b-90568a1c8035 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:07.968312 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f93d398a-dd71-4ffd-885b-90568a1c8035 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:08.094480 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-f93d398a-dd71-4ffd-885b-90568a1c8035 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:08.102344 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-f93d398a-dd71-4ffd-885b-90568a1c8035 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.146335 Jul 11 11:46:08.102904 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1259/2518] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:07 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:08.387092 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-bdfd6b1d-6b0a-4cb2-ab46-3877d29ed441 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:08.387724 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-bdfd6b1d-6b0a-4cb2-ab46-3877d29ed441 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:08.395773 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bdfd6b1d-6b0a-4cb2-ab46-3877d29ed441 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:08.396216 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bdfd6b1d-6b0a-4cb2-ab46-3877d29ed441 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:08.396966 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bdfd6b1d-6b0a-4cb2-ab46-3877d29ed441 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:08.397396 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bdfd6b1d-6b0a-4cb2-ab46-3877d29ed441 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:08.458174 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-bdfd6b1d-6b0a-4cb2-ab46-3877d29ed441 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:08.466576 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-bdfd6b1d-6b0a-4cb2-ab46-3877d29ed441 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.083869 Jul 11 11:46:08.467139 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1260/2519] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:08 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:08.691677 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-d3d92c4c-d506-4bf3-b9e6-552f4c76c7f7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:08.692268 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-d3d92c4c-d506-4bf3-b9e6-552f4c76c7f7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:08.699005 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d3d92c4c-d506-4bf3-b9e6-552f4c76c7f7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:08.699485 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d3d92c4c-d506-4bf3-b9e6-552f4c76c7f7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:08.700233 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d3d92c4c-d506-4bf3-b9e6-552f4c76c7f7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:08.700664 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d3d92c4c-d506-4bf3-b9e6-552f4c76c7f7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:08.830148 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-d3d92c4c-d506-4bf3-b9e6-552f4c76c7f7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:08.837986 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-d3d92c4c-d506-4bf3-b9e6-552f4c76c7f7 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.150120 Jul 11 11:46:08.839135 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1260/2520] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:08 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:09.120460 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-39cdfd78-cc5a-4fb9-a119-fd1129ea036d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:09.121070 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-39cdfd78-cc5a-4fb9-a119-fd1129ea036d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:09.127700 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-39cdfd78-cc5a-4fb9-a119-fd1129ea036d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:09.128141 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-39cdfd78-cc5a-4fb9-a119-fd1129ea036d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:09.128888 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-39cdfd78-cc5a-4fb9-a119-fd1129ea036d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:09.129313 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-39cdfd78-cc5a-4fb9-a119-fd1129ea036d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:09.261368 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-39cdfd78-cc5a-4fb9-a119-fd1129ea036d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:09.269217 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-39cdfd78-cc5a-4fb9-a119-fd1129ea036d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.152577 Jul 11 11:46:09.269938 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1261/2521] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:09 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:09.483544 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-f27f96ca-ff7e-40c0-ba42-8e7fd92ccc36 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:09.484153 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-f27f96ca-ff7e-40c0-ba42-8e7fd92ccc36 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:09.490171 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f27f96ca-ff7e-40c0-ba42-8e7fd92ccc36 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:09.490620 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f27f96ca-ff7e-40c0-ba42-8e7fd92ccc36 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:09.491404 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f27f96ca-ff7e-40c0-ba42-8e7fd92ccc36 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:09.491841 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f27f96ca-ff7e-40c0-ba42-8e7fd92ccc36 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:09.705462 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-f27f96ca-ff7e-40c0-ba42-8e7fd92ccc36 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:09.713936 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-f27f96ca-ff7e-40c0-ba42-8e7fd92ccc36 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.233875 Jul 11 11:46:09.714496 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1261/2522] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:09 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:09.855461 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-86f7f343-da0a-48a4-a5ba-e9ca830f3c73 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:09.855989 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-86f7f343-da0a-48a4-a5ba-e9ca830f3c73 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:09.861918 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-86f7f343-da0a-48a4-a5ba-e9ca830f3c73 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:09.862378 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-86f7f343-da0a-48a4-a5ba-e9ca830f3c73 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:09.864065 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-86f7f343-da0a-48a4-a5ba-e9ca830f3c73 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:09.864065 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-86f7f343-da0a-48a4-a5ba-e9ca830f3c73 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:09.990756 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-86f7f343-da0a-48a4-a5ba-e9ca830f3c73 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:09.999306 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-86f7f343-da0a-48a4-a5ba-e9ca830f3c73 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.147756 Jul 11 11:46:09.999871 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1262/2523] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:09 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:10.286478 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-88480178-a404-4f7d-afb0-8a4a616c3bda tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:10.287079 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-88480178-a404-4f7d-afb0-8a4a616c3bda tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:10.293774 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-88480178-a404-4f7d-afb0-8a4a616c3bda tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:10.294217 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-88480178-a404-4f7d-afb0-8a4a616c3bda tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:10.294958 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-88480178-a404-4f7d-afb0-8a4a616c3bda tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:10.295418 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-88480178-a404-4f7d-afb0-8a4a616c3bda tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:10.420886 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-88480178-a404-4f7d-afb0-8a4a616c3bda tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:10.428854 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-88480178-a404-4f7d-afb0-8a4a616c3bda tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.146232 Jul 11 11:46:10.429415 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1262/2524] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:10 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:10.730489 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-6e55c809-dda8-4cdd-b85c-08353eccd621 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:10.731079 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-6e55c809-dda8-4cdd-b85c-08353eccd621 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:10.737624 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6e55c809-dda8-4cdd-b85c-08353eccd621 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:10.738070 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6e55c809-dda8-4cdd-b85c-08353eccd621 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:10.738829 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6e55c809-dda8-4cdd-b85c-08353eccd621 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:10.739305 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6e55c809-dda8-4cdd-b85c-08353eccd621 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:10.801468 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-6e55c809-dda8-4cdd-b85c-08353eccd621 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:10.809208 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-6e55c809-dda8-4cdd-b85c-08353eccd621 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.083202 Jul 11 11:46:10.809767 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1263/2525] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:10 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:11.016643 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-22925d0d-f6b9-4d47-b25f-d0dd2241d632 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:11.017185 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-22925d0d-f6b9-4d47-b25f-d0dd2241d632 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:11.023594 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-22925d0d-f6b9-4d47-b25f-d0dd2241d632 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:11.024042 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-22925d0d-f6b9-4d47-b25f-d0dd2241d632 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:11.024823 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-22925d0d-f6b9-4d47-b25f-d0dd2241d632 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:11.025258 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-22925d0d-f6b9-4d47-b25f-d0dd2241d632 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:11.153330 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-22925d0d-f6b9-4d47-b25f-d0dd2241d632 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:11.161053 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-22925d0d-f6b9-4d47-b25f-d0dd2241d632 tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.148288 Jul 11 11:46:11.161604 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1263/2526] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:11 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:11.446479 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-04c8e93e-b98f-4317-a304-efa60fbc7022 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:11.447096 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-04c8e93e-b98f-4317-a304-efa60fbc7022 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:11.453423 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-04c8e93e-b98f-4317-a304-efa60fbc7022 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:11.453871 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-04c8e93e-b98f-4317-a304-efa60fbc7022 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:11.454625 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-04c8e93e-b98f-4317-a304-efa60fbc7022 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:11.455060 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-04c8e93e-b98f-4317-a304-efa60fbc7022 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:11.585558 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-04c8e93e-b98f-4317-a304-efa60fbc7022 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:11.593999 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-04c8e93e-b98f-4317-a304-efa60fbc7022 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.151326 Jul 11 11:46:11.594575 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1264/2527] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:11 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:11.826895 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-974ad5e3-bd25-4c32-b3f6-c8db2507cc6a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:11.827473 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-974ad5e3-bd25-4c32-b3f6-c8db2507cc6a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:11.833476 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-974ad5e3-bd25-4c32-b3f6-c8db2507cc6a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:11.833928 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-974ad5e3-bd25-4c32-b3f6-c8db2507cc6a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:11.834687 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-974ad5e3-bd25-4c32-b3f6-c8db2507cc6a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:11.835127 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-974ad5e3-bd25-4c32-b3f6-c8db2507cc6a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:11.895650 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-974ad5e3-bd25-4c32-b3f6-c8db2507cc6a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:11.904404 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-974ad5e3-bd25-4c32-b3f6-c8db2507cc6a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.081960 Jul 11 11:46:11.904987 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1264/2528] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:11 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:12.178685 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-96cfe00d-a26b-4533-89b5-c5ee6eeb54bf tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:12.179329 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-96cfe00d-a26b-4533-89b5-c5ee6eeb54bf tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:12.186273 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-96cfe00d-a26b-4533-89b5-c5ee6eeb54bf tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:12.186713 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-96cfe00d-a26b-4533-89b5-c5ee6eeb54bf tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:12.187500 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-96cfe00d-a26b-4533-89b5-c5ee6eeb54bf tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:12.187981 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-96cfe00d-a26b-4533-89b5-c5ee6eeb54bf tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:12.336364 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-96cfe00d-a26b-4533-89b5-c5ee6eeb54bf tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:12.344327 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-96cfe00d-a26b-4533-89b5-c5ee6eeb54bf tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.169595 Jul 11 11:46:12.344896 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1265/2529] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:12 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:12.612277 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-b13b7e84-3e01-4396-94d5-f8aa75b21050 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:12.612823 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-b13b7e84-3e01-4396-94d5-f8aa75b21050 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:12.620042 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b13b7e84-3e01-4396-94d5-f8aa75b21050 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:12.620500 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b13b7e84-3e01-4396-94d5-f8aa75b21050 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:12.621263 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b13b7e84-3e01-4396-94d5-f8aa75b21050 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:12.621705 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b13b7e84-3e01-4396-94d5-f8aa75b21050 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:12.752859 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-b13b7e84-3e01-4396-94d5-f8aa75b21050 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:12.757621 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-b13b7e84-3e01-4396-94d5-f8aa75b21050 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.149405 Jul 11 11:46:12.758187 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1265/2530] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:12 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:12.921859 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-5b6fcf32-bf94-482c-b062-a889c1193dcb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:12.922470 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-5b6fcf32-bf94-482c-b062-a889c1193dcb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:12.928512 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5b6fcf32-bf94-482c-b062-a889c1193dcb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:12.928962 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5b6fcf32-bf94-482c-b062-a889c1193dcb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:12.929717 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5b6fcf32-bf94-482c-b062-a889c1193dcb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:12.930148 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5b6fcf32-bf94-482c-b062-a889c1193dcb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:12.990124 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-5b6fcf32-bf94-482c-b062-a889c1193dcb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:12.997886 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-5b6fcf32-bf94-482c-b062-a889c1193dcb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.079876 Jul 11 11:46:12.998446 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1266/2531] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:12 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:13.361259 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-1479991b-814a-447c-9713-28592f7d1d3b tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:13.361828 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-1479991b-814a-447c-9713-28592f7d1d3b tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] [instance: 21831efc-9278-477a-b760-33d7830c9423] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:13.367839 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1479991b-814a-447c-9713-28592f7d1d3b tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:13.368285 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1479991b-814a-447c-9713-28592f7d1d3b tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:13.369038 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1479991b-814a-447c-9713-28592f7d1d3b tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:13.370048 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1479991b-814a-447c-9713-28592f7d1d3b tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:13.535750 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-1479991b-814a-447c-9713-28592f7d1d3b tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8f21537fc14c6fabeec0252205e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679163b973694df7a7d0fb1184f31f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:13.535750 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-1479991b-814a-447c-9713-28592f7d1d3b tempest-VolumesSnapshotTestJSON-64626957 tempest-VolumesSnapshotTestJSON-64626957-project] 10.222.0.26 "GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423" status: 200 len: 1560 microversion: 2.1 time: 0.149260 Jul 11 11:46:13.535750 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1266/2532] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:13 2022] GET /compute/v2.1/servers/21831efc-9278-477a-b760-33d7830c9423 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:13.774036 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-b5959fbb-0721-4538-8955-3038108035c2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:13.774687 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-b5959fbb-0721-4538-8955-3038108035c2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:13.781198 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b5959fbb-0721-4538-8955-3038108035c2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:13.781650 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b5959fbb-0721-4538-8955-3038108035c2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:13.782407 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b5959fbb-0721-4538-8955-3038108035c2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:13.782842 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b5959fbb-0721-4538-8955-3038108035c2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:13.911117 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-b5959fbb-0721-4538-8955-3038108035c2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:13.919174 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-b5959fbb-0721-4538-8955-3038108035c2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.148999 Jul 11 11:46:13.919874 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1267/2533] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:13 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:14.113810 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-ebc61c20-105a-4019-b1d3-23e22ddc7b34 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:14.114432 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-ebc61c20-105a-4019-b1d3-23e22ddc7b34 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:14.121169 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ebc61c20-105a-4019-b1d3-23e22ddc7b34 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:14.126951 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ebc61c20-105a-4019-b1d3-23e22ddc7b34 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:14.126951 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ebc61c20-105a-4019-b1d3-23e22ddc7b34 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:14.126951 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ebc61c20-105a-4019-b1d3-23e22ddc7b34 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:14.193117 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-ebc61c20-105a-4019-b1d3-23e22ddc7b34 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:14.201650 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-ebc61c20-105a-4019-b1d3-23e22ddc7b34 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.191649 Jul 11 11:46:14.202212 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1267/2534] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:14 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:15.000446 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-c4415212-6af3-46f4-b6b7-88664a2912b7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:15.001063 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-c4415212-6af3-46f4-b6b7-88664a2912b7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:15.007047 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c4415212-6af3-46f4-b6b7-88664a2912b7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:15.007526 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c4415212-6af3-46f4-b6b7-88664a2912b7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:15.008287 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c4415212-6af3-46f4-b6b7-88664a2912b7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:15.008725 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c4415212-6af3-46f4-b6b7-88664a2912b7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:15.030987 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 11:46:15.031172 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Mon Jul 11 11:46:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 11:46:15.144672 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-c4415212-6af3-46f4-b6b7-88664a2912b7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:15.153071 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-c4415212-6af3-46f4-b6b7-88664a2912b7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.219861 Jul 11 11:46:15.153644 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1268/2535] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:14 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:15.219028 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-8de11ad4-221e-4aa7-bea6-b327acbf2a39 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:15.219627 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-8de11ad4-221e-4aa7-bea6-b327acbf2a39 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:15.226074 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8de11ad4-221e-4aa7-bea6-b327acbf2a39 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:15.226521 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8de11ad4-221e-4aa7-bea6-b327acbf2a39 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:15.227292 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8de11ad4-221e-4aa7-bea6-b327acbf2a39 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:15.227728 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8de11ad4-221e-4aa7-bea6-b327acbf2a39 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:15.230673 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=100 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:46:15.342263 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-8de11ad4-221e-4aa7-bea6-b327acbf2a39 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:15.350104 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-8de11ad4-221e-4aa7-bea6-b327acbf2a39 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.135081 Jul 11 11:46:15.350769 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1268/2536] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:15 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:16.171892 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-ccaa9b53-ab12-4388-b304-01d1d4b57f98 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:16.172513 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-ccaa9b53-ab12-4388-b304-01d1d4b57f98 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:16.178996 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ccaa9b53-ab12-4388-b304-01d1d4b57f98 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:16.179483 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ccaa9b53-ab12-4388-b304-01d1d4b57f98 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:16.180269 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ccaa9b53-ab12-4388-b304-01d1d4b57f98 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:16.180691 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ccaa9b53-ab12-4388-b304-01d1d4b57f98 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:16.361209 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-ccaa9b53-ab12-4388-b304-01d1d4b57f98 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:16.366860 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-5cd08c1f-8b53-4ac8-995f-8175a1a9c7d2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:16.367535 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-5cd08c1f-8b53-4ac8-995f-8175a1a9c7d2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:16.369722 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-ccaa9b53-ab12-4388-b304-01d1d4b57f98 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.202811 Jul 11 11:46:16.370303 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1269/2537] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:16 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:16.374326 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5cd08c1f-8b53-4ac8-995f-8175a1a9c7d2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:16.374777 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5cd08c1f-8b53-4ac8-995f-8175a1a9c7d2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:16.375565 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5cd08c1f-8b53-4ac8-995f-8175a1a9c7d2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:16.375999 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5cd08c1f-8b53-4ac8-995f-8175a1a9c7d2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:16.437861 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-5cd08c1f-8b53-4ac8-995f-8175a1a9c7d2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:16.445600 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-5cd08c1f-8b53-4ac8-995f-8175a1a9c7d2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.082494 Jul 11 11:46:16.446150 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1269/2538] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:16 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:46:17.386786 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-1209a079-9dbf-4e09-9ede-93a23e18b3ee tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:17.387345 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-1209a079-9dbf-4e09-9ede-93a23e18b3ee tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:17.393740 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1209a079-9dbf-4e09-9ede-93a23e18b3ee tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:17.394181 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1209a079-9dbf-4e09-9ede-93a23e18b3ee tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:17.394923 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1209a079-9dbf-4e09-9ede-93a23e18b3ee tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:17.395375 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1209a079-9dbf-4e09-9ede-93a23e18b3ee tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:17.463690 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-40c57450-bfb5-4bd7-848f-5e682d96c5e8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:17.464463 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-40c57450-bfb5-4bd7-848f-5e682d96c5e8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:17.474856 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-40c57450-bfb5-4bd7-848f-5e682d96c5e8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:17.475343 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-40c57450-bfb5-4bd7-848f-5e682d96c5e8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:17.476119 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-40c57450-bfb5-4bd7-848f-5e682d96c5e8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:17.476559 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-40c57450-bfb5-4bd7-848f-5e682d96c5e8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:17.526620 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-1209a079-9dbf-4e09-9ede-93a23e18b3ee tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:17.534834 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-1209a079-9dbf-4e09-9ede-93a23e18b3ee tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.151859 Jul 11 11:46:17.535616 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1270/2539] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:17 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:17.750585 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-40c57450-bfb5-4bd7-848f-5e682d96c5e8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:17.760213 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-40c57450-bfb5-4bd7-848f-5e682d96c5e8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.301003 Jul 11 11:46:17.760778 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1270/2540] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:17 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:46:18.552669 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-f43e49db-37b3-4365-be85-86a26cb95333 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:18.553295 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-f43e49db-37b3-4365-be85-86a26cb95333 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:18.560393 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f43e49db-37b3-4365-be85-86a26cb95333 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:18.560832 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f43e49db-37b3-4365-be85-86a26cb95333 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:18.561578 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f43e49db-37b3-4365-be85-86a26cb95333 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:18.562001 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f43e49db-37b3-4365-be85-86a26cb95333 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:18.690763 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-f43e49db-37b3-4365-be85-86a26cb95333 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:18.698939 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-f43e49db-37b3-4365-be85-86a26cb95333 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.150251 Jul 11 11:46:18.699525 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1271/2541] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:18 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:18.777254 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-3f126952-8c7a-4fbc-8523-76b8dd804629 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:18.777855 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-3f126952-8c7a-4fbc-8523-76b8dd804629 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:18.784279 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3f126952-8c7a-4fbc-8523-76b8dd804629 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:18.784724 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3f126952-8c7a-4fbc-8523-76b8dd804629 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:18.785467 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3f126952-8c7a-4fbc-8523-76b8dd804629 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:18.785896 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3f126952-8c7a-4fbc-8523-76b8dd804629 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:18.847940 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-3f126952-8c7a-4fbc-8523-76b8dd804629 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:18.856399 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-3f126952-8c7a-4fbc-8523-76b8dd804629 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.083037 Jul 11 11:46:18.857165 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1271/2542] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:18 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:19.715076 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-443d2f84-276d-4da6-b078-0d42c650cd7a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:19.715725 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-443d2f84-276d-4da6-b078-0d42c650cd7a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:19.722198 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-443d2f84-276d-4da6-b078-0d42c650cd7a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:19.722647 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-443d2f84-276d-4da6-b078-0d42c650cd7a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:19.723473 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-443d2f84-276d-4da6-b078-0d42c650cd7a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:19.723887 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-443d2f84-276d-4da6-b078-0d42c650cd7a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:19.850010 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-443d2f84-276d-4da6-b078-0d42c650cd7a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:19.858435 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-443d2f84-276d-4da6-b078-0d42c650cd7a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.147127 Jul 11 11:46:19.859021 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1272/2543] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:19 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:19.873559 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-af75b70a-d397-478c-94af-026368636973 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:19.874304 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-af75b70a-d397-478c-94af-026368636973 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:19.880669 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-af75b70a-d397-478c-94af-026368636973 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:19.881119 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-af75b70a-d397-478c-94af-026368636973 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:19.881870 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-af75b70a-d397-478c-94af-026368636973 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:19.882301 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-af75b70a-d397-478c-94af-026368636973 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:19.943552 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-af75b70a-d397-478c-94af-026368636973 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:19.952043 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-af75b70a-d397-478c-94af-026368636973 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.082822 Jul 11 11:46:19.952627 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1272/2544] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:19 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:20.876009 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-df189d8f-305c-428b-b17a-5520e6a9b511 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:20.876617 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-df189d8f-305c-428b-b17a-5520e6a9b511 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:20.883015 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-df189d8f-305c-428b-b17a-5520e6a9b511 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:20.883497 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-df189d8f-305c-428b-b17a-5520e6a9b511 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:20.884248 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-df189d8f-305c-428b-b17a-5520e6a9b511 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:20.885211 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-df189d8f-305c-428b-b17a-5520e6a9b511 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:20.969486 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-0c131238-5693-4a6a-a170-7b34c097a36a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:20.970096 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-0c131238-5693-4a6a-a170-7b34c097a36a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:20.976647 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0c131238-5693-4a6a-a170-7b34c097a36a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:20.977097 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0c131238-5693-4a6a-a170-7b34c097a36a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:20.977855 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0c131238-5693-4a6a-a170-7b34c097a36a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:20.978290 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0c131238-5693-4a6a-a170-7b34c097a36a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:21.012207 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-df189d8f-305c-428b-b17a-5520e6a9b511 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:21.020173 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-df189d8f-305c-428b-b17a-5520e6a9b511 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.148040 Jul 11 11:46:21.020752 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1273/2545] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:20 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:21.038880 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-0c131238-5693-4a6a-a170-7b34c097a36a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:21.046844 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-0c131238-5693-4a6a-a170-7b34c097a36a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.081200 Jul 11 11:46:21.047433 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1273/2546] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:20 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:22.038029 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-6106a908-0c49-4925-b350-57e8f2d3e7b9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:22.038647 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-6106a908-0c49-4925-b350-57e8f2d3e7b9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:22.045701 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6106a908-0c49-4925-b350-57e8f2d3e7b9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:22.046142 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6106a908-0c49-4925-b350-57e8f2d3e7b9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:22.046891 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6106a908-0c49-4925-b350-57e8f2d3e7b9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:22.047346 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6106a908-0c49-4925-b350-57e8f2d3e7b9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:22.049826 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=100 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:46:22.063876 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-6f15c0ed-01d0-4ee7-8059-0f1d78e0e862 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:22.064516 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-6f15c0ed-01d0-4ee7-8059-0f1d78e0e862 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:22.071123 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6f15c0ed-01d0-4ee7-8059-0f1d78e0e862 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:22.074630 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6f15c0ed-01d0-4ee7-8059-0f1d78e0e862 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:22.074630 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6f15c0ed-01d0-4ee7-8059-0f1d78e0e862 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:22.074630 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6f15c0ed-01d0-4ee7-8059-0f1d78e0e862 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:22.139064 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-6f15c0ed-01d0-4ee7-8059-0f1d78e0e862 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:22.146914 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-6f15c0ed-01d0-4ee7-8059-0f1d78e0e862 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.086982 Jul 11 11:46:22.147513 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1274/2547] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:22 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:46:22.180108 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-6106a908-0c49-4925-b350-57e8f2d3e7b9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:22.188055 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-6106a908-0c49-4925-b350-57e8f2d3e7b9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.153827 Jul 11 11:46:22.188625 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1274/2548] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:22 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:23.164443 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-f2018984-fb17-44f3-a75e-6f8504e3cee2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:23.165049 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-f2018984-fb17-44f3-a75e-6f8504e3cee2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:23.167867 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_api:SELECT=74 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:46:23.172522 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f2018984-fb17-44f3-a75e-6f8504e3cee2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:23.172962 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f2018984-fb17-44f3-a75e-6f8504e3cee2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:23.173703 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f2018984-fb17-44f3-a75e-6f8504e3cee2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:23.174132 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f2018984-fb17-44f3-a75e-6f8504e3cee2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:23.207046 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-968990b4-7610-4e3b-85dd-e3a10cd91bae tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:23.207692 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-968990b4-7610-4e3b-85dd-e3a10cd91bae tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:23.210029 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_api:SELECT=70 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:46:23.214772 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-968990b4-7610-4e3b-85dd-e3a10cd91bae tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:23.215226 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-968990b4-7610-4e3b-85dd-e3a10cd91bae tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:23.216033 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-968990b4-7610-4e3b-85dd-e3a10cd91bae tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:23.216473 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-968990b4-7610-4e3b-85dd-e3a10cd91bae tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:23.235664 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-f2018984-fb17-44f3-a75e-6f8504e3cee2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:23.243492 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-f2018984-fb17-44f3-a75e-6f8504e3cee2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.082847 Jul 11 11:46:23.244616 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1275/2549] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:23 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:23.342901 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-968990b4-7610-4e3b-85dd-e3a10cd91bae tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:23.350774 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-968990b4-7610-4e3b-85dd-e3a10cd91bae tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.147489 Jul 11 11:46:23.351358 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1275/2550] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:23 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:46:24.261082 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-00e12ad9-5a7d-4fcd-b491-cfb0fb07d5a0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:24.261674 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-00e12ad9-5a7d-4fcd-b491-cfb0fb07d5a0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:24.268223 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-00e12ad9-5a7d-4fcd-b491-cfb0fb07d5a0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:24.268672 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-00e12ad9-5a7d-4fcd-b491-cfb0fb07d5a0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:24.269425 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-00e12ad9-5a7d-4fcd-b491-cfb0fb07d5a0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:24.269859 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-00e12ad9-5a7d-4fcd-b491-cfb0fb07d5a0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:24.334730 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-00e12ad9-5a7d-4fcd-b491-cfb0fb07d5a0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:24.342652 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-00e12ad9-5a7d-4fcd-b491-cfb0fb07d5a0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.086183 Jul 11 11:46:24.343216 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1276/2551] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:24 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:24.368584 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-8351cde1-c8d9-4485-8895-ec971675a0c7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:24.369694 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-8351cde1-c8d9-4485-8895-ec971675a0c7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:24.376039 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8351cde1-c8d9-4485-8895-ec971675a0c7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:24.376481 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8351cde1-c8d9-4485-8895-ec971675a0c7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:24.377222 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8351cde1-c8d9-4485-8895-ec971675a0c7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:24.377649 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8351cde1-c8d9-4485-8895-ec971675a0c7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:24.505882 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-8351cde1-c8d9-4485-8895-ec971675a0c7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:24.514436 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-8351cde1-c8d9-4485-8895-ec971675a0c7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.149596 Jul 11 11:46:24.515001 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1276/2552] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:24 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:25.360026 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-1da34300-9cc7-456c-8eaa-893f48a70b75 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:25.360610 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-1da34300-9cc7-456c-8eaa-893f48a70b75 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:25.367008 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1da34300-9cc7-456c-8eaa-893f48a70b75 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:25.367494 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1da34300-9cc7-456c-8eaa-893f48a70b75 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:25.368244 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1da34300-9cc7-456c-8eaa-893f48a70b75 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:25.368679 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1da34300-9cc7-456c-8eaa-893f48a70b75 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:25.428841 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-1da34300-9cc7-456c-8eaa-893f48a70b75 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:25.443303 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-1da34300-9cc7-456c-8eaa-893f48a70b75 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.087064 Jul 11 11:46:25.443897 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1277/2553] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:25 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:25.532000 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-3dc2f1c9-9429-4662-996f-7f689213c0b4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:25.532607 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-3dc2f1c9-9429-4662-996f-7f689213c0b4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:25.539157 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3dc2f1c9-9429-4662-996f-7f689213c0b4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:25.539615 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3dc2f1c9-9429-4662-996f-7f689213c0b4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:25.540370 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3dc2f1c9-9429-4662-996f-7f689213c0b4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:25.541317 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3dc2f1c9-9429-4662-996f-7f689213c0b4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:25.671115 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-3dc2f1c9-9429-4662-996f-7f689213c0b4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:25.678993 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-3dc2f1c9-9429-4662-996f-7f689213c0b4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.150989 Jul 11 11:46:25.679597 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1277/2554] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:25 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:26.459987 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-35f87e93-4736-4378-b206-fdfc9e68bde9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:26.460605 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-35f87e93-4736-4378-b206-fdfc9e68bde9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:26.467223 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-35f87e93-4736-4378-b206-fdfc9e68bde9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:26.467704 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-35f87e93-4736-4378-b206-fdfc9e68bde9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:26.468461 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-35f87e93-4736-4378-b206-fdfc9e68bde9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:26.468900 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-35f87e93-4736-4378-b206-fdfc9e68bde9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:26.530965 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-35f87e93-4736-4378-b206-fdfc9e68bde9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:26.538760 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-35f87e93-4736-4378-b206-fdfc9e68bde9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.082637 Jul 11 11:46:26.539346 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1278/2555] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:26 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:26.695930 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-12eb9295-5838-4321-910a-58a8dc985877 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:26.696535 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-12eb9295-5838-4321-910a-58a8dc985877 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:26.703760 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-12eb9295-5838-4321-910a-58a8dc985877 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:26.704199 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-12eb9295-5838-4321-910a-58a8dc985877 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:26.704937 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-12eb9295-5838-4321-910a-58a8dc985877 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:26.705360 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-12eb9295-5838-4321-910a-58a8dc985877 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:26.829658 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-12eb9295-5838-4321-910a-58a8dc985877 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:26.837403 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-12eb9295-5838-4321-910a-58a8dc985877 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.145246 Jul 11 11:46:26.837965 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1278/2556] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:26 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:27.558173 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-9436f691-4266-4718-a3fb-bc9505173f1c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:27.558791 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-9436f691-4266-4718-a3fb-bc9505173f1c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:27.565336 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9436f691-4266-4718-a3fb-bc9505173f1c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:27.565814 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9436f691-4266-4718-a3fb-bc9505173f1c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:27.566581 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9436f691-4266-4718-a3fb-bc9505173f1c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:27.567019 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9436f691-4266-4718-a3fb-bc9505173f1c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:27.631132 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-9436f691-4266-4718-a3fb-bc9505173f1c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:27.639555 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-9436f691-4266-4718-a3fb-bc9505173f1c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.087751 Jul 11 11:46:27.640117 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1279/2557] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:27 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:27.854647 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-c1dd2100-b91e-4726-ad2a-2bee4400da23 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:27.855194 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-c1dd2100-b91e-4726-ad2a-2bee4400da23 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:27.861885 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c1dd2100-b91e-4726-ad2a-2bee4400da23 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:27.864667 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c1dd2100-b91e-4726-ad2a-2bee4400da23 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:27.864667 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c1dd2100-b91e-4726-ad2a-2bee4400da23 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:27.864667 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c1dd2100-b91e-4726-ad2a-2bee4400da23 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:28.001562 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-c1dd2100-b91e-4726-ad2a-2bee4400da23 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:28.009360 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-c1dd2100-b91e-4726-ad2a-2bee4400da23 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.158745 Jul 11 11:46:28.010530 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1279/2558] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:27 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:28.657217 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-fcb76f5b-68db-41d5-be4d-45bb00255806 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:28.657804 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-fcb76f5b-68db-41d5-be4d-45bb00255806 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:28.664169 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fcb76f5b-68db-41d5-be4d-45bb00255806 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:28.664610 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fcb76f5b-68db-41d5-be4d-45bb00255806 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:28.665357 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fcb76f5b-68db-41d5-be4d-45bb00255806 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:28.666425 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fcb76f5b-68db-41d5-be4d-45bb00255806 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:28.727651 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-fcb76f5b-68db-41d5-be4d-45bb00255806 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:28.735969 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-fcb76f5b-68db-41d5-be4d-45bb00255806 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.082684 Jul 11 11:46:28.736518 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1280/2559] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:28 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:29.027470 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-43a7de75-c8f1-43da-84de-3b0805afd8a3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:29.028111 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-43a7de75-c8f1-43da-84de-3b0805afd8a3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:29.034647 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-43a7de75-c8f1-43da-84de-3b0805afd8a3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:29.035093 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-43a7de75-c8f1-43da-84de-3b0805afd8a3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:29.035885 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-43a7de75-c8f1-43da-84de-3b0805afd8a3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:29.036317 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-43a7de75-c8f1-43da-84de-3b0805afd8a3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:29.162732 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-43a7de75-c8f1-43da-84de-3b0805afd8a3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:29.171047 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-43a7de75-c8f1-43da-84de-3b0805afd8a3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.147810 Jul 11 11:46:29.171652 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1280/2560] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:29 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:29.754071 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-aa876651-2025-4377-a22a-29ca7104bcb6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:29.754917 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-aa876651-2025-4377-a22a-29ca7104bcb6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:29.762206 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-aa876651-2025-4377-a22a-29ca7104bcb6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:29.762706 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-aa876651-2025-4377-a22a-29ca7104bcb6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:29.763548 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-aa876651-2025-4377-a22a-29ca7104bcb6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:29.764085 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-aa876651-2025-4377-a22a-29ca7104bcb6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:29.824716 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-aa876651-2025-4377-a22a-29ca7104bcb6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:29.832384 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-aa876651-2025-4377-a22a-29ca7104bcb6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.083200 Jul 11 11:46:29.832934 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1281/2561] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:29 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:30.188217 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-31515a22-44f3-4e6f-8217-e45531896586 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:30.188824 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-31515a22-44f3-4e6f-8217-e45531896586 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:30.195282 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-31515a22-44f3-4e6f-8217-e45531896586 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:30.195735 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-31515a22-44f3-4e6f-8217-e45531896586 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:30.196480 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-31515a22-44f3-4e6f-8217-e45531896586 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:30.197730 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-31515a22-44f3-4e6f-8217-e45531896586 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:30.332880 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-31515a22-44f3-4e6f-8217-e45531896586 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:30.340739 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-31515a22-44f3-4e6f-8217-e45531896586 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.156296 Jul 11 11:46:30.341314 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1281/2562] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:30 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:30.849880 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-d1af08b4-4668-420c-ae70-bc461f5f6ef6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:30.850502 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-d1af08b4-4668-420c-ae70-bc461f5f6ef6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:30.857498 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d1af08b4-4668-420c-ae70-bc461f5f6ef6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:30.857944 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d1af08b4-4668-420c-ae70-bc461f5f6ef6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:30.858693 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d1af08b4-4668-420c-ae70-bc461f5f6ef6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:30.859119 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d1af08b4-4668-420c-ae70-bc461f5f6ef6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:30.921925 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-d1af08b4-4668-420c-ae70-bc461f5f6ef6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:30.929638 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-d1af08b4-4668-420c-ae70-bc461f5f6ef6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.083605 Jul 11 11:46:30.930189 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1282/2563] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:30 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:31.135855 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 11:46:31.136021 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Mon Jul 11 11:46:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 11:46:31.356685 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-e7f147ca-513c-4b1e-994e-72959b0e77d3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:31.357327 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-e7f147ca-513c-4b1e-994e-72959b0e77d3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:31.363706 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e7f147ca-513c-4b1e-994e-72959b0e77d3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:31.364147 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e7f147ca-513c-4b1e-994e-72959b0e77d3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:31.364887 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e7f147ca-513c-4b1e-994e-72959b0e77d3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:31.365311 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e7f147ca-513c-4b1e-994e-72959b0e77d3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:31.489643 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-e7f147ca-513c-4b1e-994e-72959b0e77d3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:31.497451 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-e7f147ca-513c-4b1e-994e-72959b0e77d3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.144468 Jul 11 11:46:31.498016 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1282/2564] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:31 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:31.945841 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-74c01d43-21f2-44c4-9550-0c2b1b260814 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:31.946424 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-74c01d43-21f2-44c4-9550-0c2b1b260814 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:31.953691 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-74c01d43-21f2-44c4-9550-0c2b1b260814 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:31.954138 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-74c01d43-21f2-44c4-9550-0c2b1b260814 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:31.954883 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-74c01d43-21f2-44c4-9550-0c2b1b260814 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:31.955345 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-74c01d43-21f2-44c4-9550-0c2b1b260814 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:32.014545 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-74c01d43-21f2-44c4-9550-0c2b1b260814 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:32.022227 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-74c01d43-21f2-44c4-9550-0c2b1b260814 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.080232 Jul 11 11:46:32.022802 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1283/2565] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:31 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:32.514478 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-95794d12-59e1-4006-b76c-292c08f3b644 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:32.515090 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-95794d12-59e1-4006-b76c-292c08f3b644 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:32.521555 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-95794d12-59e1-4006-b76c-292c08f3b644 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:32.521998 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-95794d12-59e1-4006-b76c-292c08f3b644 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:32.522751 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-95794d12-59e1-4006-b76c-292c08f3b644 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:32.523190 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-95794d12-59e1-4006-b76c-292c08f3b644 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:32.649124 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-95794d12-59e1-4006-b76c-292c08f3b644 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:32.657431 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-95794d12-59e1-4006-b76c-292c08f3b644 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.146855 Jul 11 11:46:32.657999 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1283/2566] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:32 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:33.039167 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-89142378-a6ce-459e-a8a4-117a3e845666 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:33.039811 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-89142378-a6ce-459e-a8a4-117a3e845666 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:33.046343 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-89142378-a6ce-459e-a8a4-117a3e845666 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:33.046771 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-89142378-a6ce-459e-a8a4-117a3e845666 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:33.047557 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-89142378-a6ce-459e-a8a4-117a3e845666 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:33.047996 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-89142378-a6ce-459e-a8a4-117a3e845666 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:33.108560 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-89142378-a6ce-459e-a8a4-117a3e845666 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:33.110680 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=100 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:46:33.116901 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-89142378-a6ce-459e-a8a4-117a3e845666 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.081611 Jul 11 11:46:33.117465 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1284/2567] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:33 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:33.675059 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-28382f3c-a4ec-4913-962b-cd69d3a2fe79 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:33.675700 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-28382f3c-a4ec-4913-962b-cd69d3a2fe79 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:33.682750 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-28382f3c-a4ec-4913-962b-cd69d3a2fe79 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:33.683191 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-28382f3c-a4ec-4913-962b-cd69d3a2fe79 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:33.683953 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-28382f3c-a4ec-4913-962b-cd69d3a2fe79 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:33.684383 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-28382f3c-a4ec-4913-962b-cd69d3a2fe79 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:33.810249 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-28382f3c-a4ec-4913-962b-cd69d3a2fe79 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:33.818053 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-28382f3c-a4ec-4913-962b-cd69d3a2fe79 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.146826 Jul 11 11:46:33.818618 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1284/2568] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:33 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:34.138543 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-cda2155d-0cb9-4330-9c06-20a579a4147e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:34.139274 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-cda2155d-0cb9-4330-9c06-20a579a4147e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:34.145822 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cda2155d-0cb9-4330-9c06-20a579a4147e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:34.146271 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cda2155d-0cb9-4330-9c06-20a579a4147e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:34.147033 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cda2155d-0cb9-4330-9c06-20a579a4147e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:34.147503 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cda2155d-0cb9-4330-9c06-20a579a4147e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:34.216028 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-cda2155d-0cb9-4330-9c06-20a579a4147e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:34.223972 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-cda2155d-0cb9-4330-9c06-20a579a4147e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.089619 Jul 11 11:46:34.224520 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1285/2569] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:34 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:34.834979 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-13db1a7a-76ed-4f37-bb5b-77853e88ea95 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:34.835605 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-13db1a7a-76ed-4f37-bb5b-77853e88ea95 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:34.844262 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-13db1a7a-76ed-4f37-bb5b-77853e88ea95 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:34.845174 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-13db1a7a-76ed-4f37-bb5b-77853e88ea95 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:34.846081 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-13db1a7a-76ed-4f37-bb5b-77853e88ea95 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:34.847484 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-13db1a7a-76ed-4f37-bb5b-77853e88ea95 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:34.972078 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-13db1a7a-76ed-4f37-bb5b-77853e88ea95 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:34.979993 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-13db1a7a-76ed-4f37-bb5b-77853e88ea95 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.148874 Jul 11 11:46:34.980568 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1285/2570] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:34 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:35.244157 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-5b7fdfb0-8ac2-44a0-9a48-7a4d9aeebc1b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:35.245361 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-5b7fdfb0-8ac2-44a0-9a48-7a4d9aeebc1b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:35.251853 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5b7fdfb0-8ac2-44a0-9a48-7a4d9aeebc1b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:35.252303 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5b7fdfb0-8ac2-44a0-9a48-7a4d9aeebc1b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:35.253059 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5b7fdfb0-8ac2-44a0-9a48-7a4d9aeebc1b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:35.253499 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5b7fdfb0-8ac2-44a0-9a48-7a4d9aeebc1b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:35.315884 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-5b7fdfb0-8ac2-44a0-9a48-7a4d9aeebc1b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:35.323963 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-5b7fdfb0-8ac2-44a0-9a48-7a4d9aeebc1b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.083719 Jul 11 11:46:35.324525 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1286/2571] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:35 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:35.997063 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-e77dc8e0-f7de-4cd6-b85f-49f6ed670241 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:35.997652 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-e77dc8e0-f7de-4cd6-b85f-49f6ed670241 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:36.004244 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e77dc8e0-f7de-4cd6-b85f-49f6ed670241 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:36.004683 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e77dc8e0-f7de-4cd6-b85f-49f6ed670241 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:36.005431 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e77dc8e0-f7de-4cd6-b85f-49f6ed670241 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:36.005858 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e77dc8e0-f7de-4cd6-b85f-49f6ed670241 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:36.139393 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-e77dc8e0-f7de-4cd6-b85f-49f6ed670241 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:36.143978 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-e77dc8e0-f7de-4cd6-b85f-49f6ed670241 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.150684 Jul 11 11:46:36.144537 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1286/2572] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:35 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:36.341011 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-19239e2a-082a-43ef-bcb4-8249842ca832 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:36.341635 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-19239e2a-082a-43ef-bcb4-8249842ca832 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:36.348227 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-19239e2a-082a-43ef-bcb4-8249842ca832 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:36.348671 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-19239e2a-082a-43ef-bcb4-8249842ca832 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:36.349425 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-19239e2a-082a-43ef-bcb4-8249842ca832 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:36.349861 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-19239e2a-082a-43ef-bcb4-8249842ca832 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:36.412364 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-19239e2a-082a-43ef-bcb4-8249842ca832 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:36.420246 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-19239e2a-082a-43ef-bcb4-8249842ca832 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.083186 Jul 11 11:46:36.420809 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1287/2573] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:36 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:37.161809 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-d508f703-f4ce-4874-9772-bb7c3fb36add tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:37.162405 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-d508f703-f4ce-4874-9772-bb7c3fb36add tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:37.169566 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d508f703-f4ce-4874-9772-bb7c3fb36add tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:37.170010 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d508f703-f4ce-4874-9772-bb7c3fb36add tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:37.170758 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d508f703-f4ce-4874-9772-bb7c3fb36add tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:37.171189 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d508f703-f4ce-4874-9772-bb7c3fb36add tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:37.295698 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-d508f703-f4ce-4874-9772-bb7c3fb36add tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:37.303501 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-d508f703-f4ce-4874-9772-bb7c3fb36add tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.145596 Jul 11 11:46:37.304072 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1287/2574] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:37 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:37.436661 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-0219d33c-520a-4682-86c4-7b4a75356170 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:37.437268 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-0219d33c-520a-4682-86c4-7b4a75356170 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:37.444935 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0219d33c-520a-4682-86c4-7b4a75356170 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:37.445383 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0219d33c-520a-4682-86c4-7b4a75356170 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:37.446139 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0219d33c-520a-4682-86c4-7b4a75356170 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:37.446577 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0219d33c-520a-4682-86c4-7b4a75356170 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:37.506527 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-0219d33c-520a-4682-86c4-7b4a75356170 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:37.514872 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-0219d33c-520a-4682-86c4-7b4a75356170 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.082162 Jul 11 11:46:37.515466 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1288/2575] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:37 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:46:38.320218 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-0bcb3ceb-cafc-4e9d-9ec2-7c65c22f3476 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:38.321337 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-0bcb3ceb-cafc-4e9d-9ec2-7c65c22f3476 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:38.328220 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0bcb3ceb-cafc-4e9d-9ec2-7c65c22f3476 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:38.328610 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0bcb3ceb-cafc-4e9d-9ec2-7c65c22f3476 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:38.329367 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0bcb3ceb-cafc-4e9d-9ec2-7c65c22f3476 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:38.329810 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0bcb3ceb-cafc-4e9d-9ec2-7c65c22f3476 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:38.457872 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-0bcb3ceb-cafc-4e9d-9ec2-7c65c22f3476 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:38.466169 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-0bcb3ceb-cafc-4e9d-9ec2-7c65c22f3476 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.149832 Jul 11 11:46:38.466742 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1288/2576] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:38 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:38.531574 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-6fbf9f4c-9bc5-45c7-b87b-76dd40730ce2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:38.532176 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-6fbf9f4c-9bc5-45c7-b87b-76dd40730ce2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:38.538513 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6fbf9f4c-9bc5-45c7-b87b-76dd40730ce2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:38.538957 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6fbf9f4c-9bc5-45c7-b87b-76dd40730ce2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:38.539774 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6fbf9f4c-9bc5-45c7-b87b-76dd40730ce2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:38.540205 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6fbf9f4c-9bc5-45c7-b87b-76dd40730ce2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:38.599658 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-6fbf9f4c-9bc5-45c7-b87b-76dd40730ce2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:38.608021 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-6fbf9f4c-9bc5-45c7-b87b-76dd40730ce2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.080271 Jul 11 11:46:38.608576 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1289/2577] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:38 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:39.483777 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-318746a7-57a9-4313-afdf-7f944d483bfd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:39.484440 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-318746a7-57a9-4313-afdf-7f944d483bfd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:39.490847 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-318746a7-57a9-4313-afdf-7f944d483bfd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:39.491305 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-318746a7-57a9-4313-afdf-7f944d483bfd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:39.492051 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-318746a7-57a9-4313-afdf-7f944d483bfd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:39.492476 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-318746a7-57a9-4313-afdf-7f944d483bfd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:39.618905 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-318746a7-57a9-4313-afdf-7f944d483bfd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:39.624643 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-a9b8f32f-3e80-48e2-83d1-4b0fbaf9d4ae tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:39.625251 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-a9b8f32f-3e80-48e2-83d1-4b0fbaf9d4ae tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:39.626805 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-318746a7-57a9-4313-afdf-7f944d483bfd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.147416 Jul 11 11:46:39.627419 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1289/2578] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:39 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:39.631704 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a9b8f32f-3e80-48e2-83d1-4b0fbaf9d4ae tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:39.632142 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a9b8f32f-3e80-48e2-83d1-4b0fbaf9d4ae tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:39.632897 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a9b8f32f-3e80-48e2-83d1-4b0fbaf9d4ae tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:39.633332 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a9b8f32f-3e80-48e2-83d1-4b0fbaf9d4ae tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:39.696801 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-a9b8f32f-3e80-48e2-83d1-4b0fbaf9d4ae tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:39.705912 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-a9b8f32f-3e80-48e2-83d1-4b0fbaf9d4ae tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.085015 Jul 11 11:46:39.706617 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1290/2579] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:39 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:46:40.644482 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-0d843b18-1cc9-4b64-bcb1-c037d77f6bde tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:40.645015 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-0d843b18-1cc9-4b64-bcb1-c037d77f6bde tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:40.651453 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0d843b18-1cc9-4b64-bcb1-c037d77f6bde tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:40.651893 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0d843b18-1cc9-4b64-bcb1-c037d77f6bde tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:40.652636 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0d843b18-1cc9-4b64-bcb1-c037d77f6bde tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:40.653087 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0d843b18-1cc9-4b64-bcb1-c037d77f6bde tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:40.724243 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-c244be8b-806b-4212-bb34-5a985ec15f60 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:40.724949 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-c244be8b-806b-4212-bb34-5a985ec15f60 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:40.731462 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c244be8b-806b-4212-bb34-5a985ec15f60 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:40.731914 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c244be8b-806b-4212-bb34-5a985ec15f60 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:40.732680 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c244be8b-806b-4212-bb34-5a985ec15f60 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:40.733116 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c244be8b-806b-4212-bb34-5a985ec15f60 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:40.782885 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-0d843b18-1cc9-4b64-bcb1-c037d77f6bde tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:40.785125 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=100 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:46:40.792056 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-0d843b18-1cc9-4b64-bcb1-c037d77f6bde tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.150954 Jul 11 11:46:40.792219 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1290/2580] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:40 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:40.795110 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-c244be8b-806b-4212-bb34-5a985ec15f60 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:40.803070 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-c244be8b-806b-4212-bb34-5a985ec15f60 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.083266 Jul 11 11:46:40.803655 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1291/2581] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:40 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:46:41.809489 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-a486d50a-63c7-4c6e-a8ea-d2313d794ba3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:41.810091 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-a486d50a-63c7-4c6e-a8ea-d2313d794ba3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:41.817049 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a486d50a-63c7-4c6e-a8ea-d2313d794ba3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:41.817495 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a486d50a-63c7-4c6e-a8ea-d2313d794ba3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:41.818246 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a486d50a-63c7-4c6e-a8ea-d2313d794ba3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:41.818679 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a486d50a-63c7-4c6e-a8ea-d2313d794ba3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:41.819943 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-90324f20-fa2e-4444-920c-b0feba193acb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:41.820550 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-90324f20-fa2e-4444-920c-b0feba193acb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:41.827760 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-90324f20-fa2e-4444-920c-b0feba193acb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:41.828207 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-90324f20-fa2e-4444-920c-b0feba193acb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:41.828955 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-90324f20-fa2e-4444-920c-b0feba193acb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:41.829386 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-90324f20-fa2e-4444-920c-b0feba193acb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:41.889956 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-90324f20-fa2e-4444-920c-b0feba193acb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:41.897764 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-90324f20-fa2e-4444-920c-b0feba193acb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.081644 Jul 11 11:46:41.898326 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1292/2582] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:41 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:41.950097 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-a486d50a-63c7-4c6e-a8ea-d2313d794ba3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:41.957918 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-a486d50a-63c7-4c6e-a8ea-d2313d794ba3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.152273 Jul 11 11:46:41.958478 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1291/2583] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:41 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:42.915418 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-b5d0762b-35da-4fed-bbe0-862fdea3661d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:42.916033 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-b5d0762b-35da-4fed-bbe0-862fdea3661d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:42.923244 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b5d0762b-35da-4fed-bbe0-862fdea3661d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:42.923719 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b5d0762b-35da-4fed-bbe0-862fdea3661d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:42.924471 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b5d0762b-35da-4fed-bbe0-862fdea3661d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:42.924904 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b5d0762b-35da-4fed-bbe0-862fdea3661d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:42.975591 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-688103fe-84c3-4b75-ab21-55a4ee56edf0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:42.986697 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-688103fe-84c3-4b75-ab21-55a4ee56edf0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:42.986697 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-688103fe-84c3-4b75-ab21-55a4ee56edf0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:42.986697 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-688103fe-84c3-4b75-ab21-55a4ee56edf0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:42.986697 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-688103fe-84c3-4b75-ab21-55a4ee56edf0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:42.987282 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-688103fe-84c3-4b75-ab21-55a4ee56edf0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:42.988452 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-b5d0762b-35da-4fed-bbe0-862fdea3661d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:42.997711 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-b5d0762b-35da-4fed-bbe0-862fdea3661d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.086142 Jul 11 11:46:42.998445 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1293/2584] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:42 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:43.111243 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-688103fe-84c3-4b75-ab21-55a4ee56edf0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:43.119055 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-688103fe-84c3-4b75-ab21-55a4ee56edf0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.147293 Jul 11 11:46:43.119663 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1292/2585] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:42 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:46:44.015521 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-247215c6-7680-49a6-b770-867d7dfbdb5f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:44.023279 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-247215c6-7680-49a6-b770-867d7dfbdb5f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:44.023279 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-247215c6-7680-49a6-b770-867d7dfbdb5f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:44.023279 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-247215c6-7680-49a6-b770-867d7dfbdb5f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:44.023700 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-247215c6-7680-49a6-b770-867d7dfbdb5f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:44.024130 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-247215c6-7680-49a6-b770-867d7dfbdb5f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:44.089587 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-247215c6-7680-49a6-b770-867d7dfbdb5f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:44.096143 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-247215c6-7680-49a6-b770-867d7dfbdb5f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.085193 Jul 11 11:46:44.096693 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1294/2586] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:44 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:44.136119 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-235225ec-ddd1-4b7a-b775-9a7ee3867378 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:44.136763 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-235225ec-ddd1-4b7a-b775-9a7ee3867378 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:44.143296 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-235225ec-ddd1-4b7a-b775-9a7ee3867378 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:44.143754 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-235225ec-ddd1-4b7a-b775-9a7ee3867378 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:44.144518 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-235225ec-ddd1-4b7a-b775-9a7ee3867378 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:44.144953 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-235225ec-ddd1-4b7a-b775-9a7ee3867378 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:44.275853 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-235225ec-ddd1-4b7a-b775-9a7ee3867378 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:44.283601 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-235225ec-ddd1-4b7a-b775-9a7ee3867378 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.151330 Jul 11 11:46:44.284166 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1293/2587] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:44 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:45.113029 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-22a97649-df72-4164-b55f-8f8914d657af tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:45.113635 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-22a97649-df72-4164-b55f-8f8914d657af tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:45.120624 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-22a97649-df72-4164-b55f-8f8914d657af tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:45.121066 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-22a97649-df72-4164-b55f-8f8914d657af tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:45.121815 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-22a97649-df72-4164-b55f-8f8914d657af tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:45.122244 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-22a97649-df72-4164-b55f-8f8914d657af tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:45.181652 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-22a97649-df72-4164-b55f-8f8914d657af tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:45.189895 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-22a97649-df72-4164-b55f-8f8914d657af tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.080733 Jul 11 11:46:45.190449 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1295/2588] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:45 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:45.301274 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-bc40308d-87ba-44d4-b65a-9c2c8d6cba31 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:45.301889 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-bc40308d-87ba-44d4-b65a-9c2c8d6cba31 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:45.308413 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bc40308d-87ba-44d4-b65a-9c2c8d6cba31 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:45.308894 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bc40308d-87ba-44d4-b65a-9c2c8d6cba31 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:45.309649 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bc40308d-87ba-44d4-b65a-9c2c8d6cba31 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:45.310083 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bc40308d-87ba-44d4-b65a-9c2c8d6cba31 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:45.433324 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-bc40308d-87ba-44d4-b65a-9c2c8d6cba31 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:45.441188 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-bc40308d-87ba-44d4-b65a-9c2c8d6cba31 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.143886 Jul 11 11:46:45.444874 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1294/2589] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:45 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:46.207880 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-4dd1a746-fedb-45c4-ab98-3cb425858bbe tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:46.208506 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-4dd1a746-fedb-45c4-ab98-3cb425858bbe tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:46.215084 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4dd1a746-fedb-45c4-ab98-3cb425858bbe tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:46.215562 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4dd1a746-fedb-45c4-ab98-3cb425858bbe tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:46.216319 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4dd1a746-fedb-45c4-ab98-3cb425858bbe tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:46.216756 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4dd1a746-fedb-45c4-ab98-3cb425858bbe tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:46.278018 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-4dd1a746-fedb-45c4-ab98-3cb425858bbe tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:46.287815 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-4dd1a746-fedb-45c4-ab98-3cb425858bbe tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.083959 Jul 11 11:46:46.288382 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1296/2590] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:46 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:46.459237 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-b7f95208-d924-4c45-81b8-6cd9dff9823d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:46.459789 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-b7f95208-d924-4c45-81b8-6cd9dff9823d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:46.466812 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b7f95208-d924-4c45-81b8-6cd9dff9823d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:46.467266 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b7f95208-d924-4c45-81b8-6cd9dff9823d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:46.468022 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b7f95208-d924-4c45-81b8-6cd9dff9823d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:46.468451 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b7f95208-d924-4c45-81b8-6cd9dff9823d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:46.595510 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-b7f95208-d924-4c45-81b8-6cd9dff9823d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:46.603325 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-b7f95208-d924-4c45-81b8-6cd9dff9823d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.147955 Jul 11 11:46:46.603890 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1295/2591] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:46 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:47.304833 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-6e68c280-f00d-4fb4-ba9c-16c6d308b446 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:47.305428 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-6e68c280-f00d-4fb4-ba9c-16c6d308b446 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:47.312507 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6e68c280-f00d-4fb4-ba9c-16c6d308b446 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:47.312961 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6e68c280-f00d-4fb4-ba9c-16c6d308b446 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:47.313719 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6e68c280-f00d-4fb4-ba9c-16c6d308b446 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:47.314165 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6e68c280-f00d-4fb4-ba9c-16c6d308b446 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:47.374512 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-6e68c280-f00d-4fb4-ba9c-16c6d308b446 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:47.382338 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-6e68c280-f00d-4fb4-ba9c-16c6d308b446 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.081397 Jul 11 11:46:47.382898 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1297/2592] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:47 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:47.620174 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-a07dafbd-4f31-4937-9562-e53d23b0212e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:47.620779 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-a07dafbd-4f31-4937-9562-e53d23b0212e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:47.627234 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a07dafbd-4f31-4937-9562-e53d23b0212e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:47.627659 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a07dafbd-4f31-4937-9562-e53d23b0212e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:47.628403 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a07dafbd-4f31-4937-9562-e53d23b0212e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:47.628829 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a07dafbd-4f31-4937-9562-e53d23b0212e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:47.752470 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-a07dafbd-4f31-4937-9562-e53d23b0212e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:47.760704 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-a07dafbd-4f31-4937-9562-e53d23b0212e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.143863 Jul 11 11:46:47.761264 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1296/2593] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:47 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:48.399313 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-173d7987-7308-4ea9-af19-b23a070a858b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:48.399930 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-173d7987-7308-4ea9-af19-b23a070a858b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:48.406512 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-173d7987-7308-4ea9-af19-b23a070a858b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:48.406966 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-173d7987-7308-4ea9-af19-b23a070a858b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:48.407768 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-173d7987-7308-4ea9-af19-b23a070a858b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:48.408211 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-173d7987-7308-4ea9-af19-b23a070a858b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:48.472205 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-173d7987-7308-4ea9-af19-b23a070a858b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:48.480161 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-173d7987-7308-4ea9-af19-b23a070a858b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.084755 Jul 11 11:46:48.480786 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1298/2594] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:48 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:48.777663 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-bfffb413-6e55-41a8-b076-545c5c7f185d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:48.778300 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-bfffb413-6e55-41a8-b076-545c5c7f185d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:48.784797 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bfffb413-6e55-41a8-b076-545c5c7f185d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:48.785242 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bfffb413-6e55-41a8-b076-545c5c7f185d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:48.785989 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bfffb413-6e55-41a8-b076-545c5c7f185d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:48.786416 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bfffb413-6e55-41a8-b076-545c5c7f185d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:48.913077 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-bfffb413-6e55-41a8-b076-545c5c7f185d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:48.921380 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-bfffb413-6e55-41a8-b076-545c5c7f185d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.147510 Jul 11 11:46:48.921939 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1297/2595] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:48 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:49.497084 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-76d9207a-e032-45a7-92e2-5e3eee648b24 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:49.497685 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-76d9207a-e032-45a7-92e2-5e3eee648b24 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:49.504194 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-76d9207a-e032-45a7-92e2-5e3eee648b24 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:49.504647 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-76d9207a-e032-45a7-92e2-5e3eee648b24 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:49.505402 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-76d9207a-e032-45a7-92e2-5e3eee648b24 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:49.505837 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-76d9207a-e032-45a7-92e2-5e3eee648b24 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:49.566772 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-76d9207a-e032-45a7-92e2-5e3eee648b24 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:49.575102 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-76d9207a-e032-45a7-92e2-5e3eee648b24 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.081917 Jul 11 11:46:49.575783 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1299/2596] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:49 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:49.938443 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-bd210868-f9ca-48cc-9d76-5fc95f861109 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:49.939086 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-bd210868-f9ca-48cc-9d76-5fc95f861109 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:49.945532 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bd210868-f9ca-48cc-9d76-5fc95f861109 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:49.945977 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bd210868-f9ca-48cc-9d76-5fc95f861109 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:49.946730 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bd210868-f9ca-48cc-9d76-5fc95f861109 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:49.947163 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bd210868-f9ca-48cc-9d76-5fc95f861109 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:50.460462 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-bd210868-f9ca-48cc-9d76-5fc95f861109 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:50.468751 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-bd210868-f9ca-48cc-9d76-5fc95f861109 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.534130 Jul 11 11:46:50.469318 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1298/2597] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:49 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:50.592368 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-f48281a4-e460-4b6a-b8ca-9ac8267c6402 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:50.592918 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-f48281a4-e460-4b6a-b8ca-9ac8267c6402 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:50.599337 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f48281a4-e460-4b6a-b8ca-9ac8267c6402 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:50.599785 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f48281a4-e460-4b6a-b8ca-9ac8267c6402 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:50.600527 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f48281a4-e460-4b6a-b8ca-9ac8267c6402 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:50.600956 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f48281a4-e460-4b6a-b8ca-9ac8267c6402 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:50.662417 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-f48281a4-e460-4b6a-b8ca-9ac8267c6402 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:50.670726 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-f48281a4-e460-4b6a-b8ca-9ac8267c6402 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.082755 Jul 11 11:46:50.671294 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1300/2598] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:50 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:51.485244 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-4a0d2e0b-d808-4c75-8846-05fdceefdd67 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:51.485852 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-4a0d2e0b-d808-4c75-8846-05fdceefdd67 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:51.492282 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4a0d2e0b-d808-4c75-8846-05fdceefdd67 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:51.492759 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4a0d2e0b-d808-4c75-8846-05fdceefdd67 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:51.493511 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4a0d2e0b-d808-4c75-8846-05fdceefdd67 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:51.493941 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4a0d2e0b-d808-4c75-8846-05fdceefdd67 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:51.617692 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-4a0d2e0b-d808-4c75-8846-05fdceefdd67 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:51.626105 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-4a0d2e0b-d808-4c75-8846-05fdceefdd67 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.144672 Jul 11 11:46:51.626663 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1299/2599] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:51 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:51.688095 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-50f2a8ae-ea31-438a-b1f7-bc8ad258e4a7 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:51.688711 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-50f2a8ae-ea31-438a-b1f7-bc8ad258e4a7 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:51.695073 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-50f2a8ae-ea31-438a-b1f7-bc8ad258e4a7 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:51.695556 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-50f2a8ae-ea31-438a-b1f7-bc8ad258e4a7 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:51.696304 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-50f2a8ae-ea31-438a-b1f7-bc8ad258e4a7 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:51.696739 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-50f2a8ae-ea31-438a-b1f7-bc8ad258e4a7 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:51.711209 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=100 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:46:51.757065 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-50f2a8ae-ea31-438a-b1f7-bc8ad258e4a7 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:51.765069 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-50f2a8ae-ea31-438a-b1f7-bc8ad258e4a7 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.080721 Jul 11 11:46:51.765628 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1301/2600] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:51 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:52.643350 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-52ea912f-c6aa-42a9-82b9-143ab6d90b03 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:52.643906 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-52ea912f-c6aa-42a9-82b9-143ab6d90b03 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:52.650275 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-52ea912f-c6aa-42a9-82b9-143ab6d90b03 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:52.650749 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-52ea912f-c6aa-42a9-82b9-143ab6d90b03 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:52.651532 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-52ea912f-c6aa-42a9-82b9-143ab6d90b03 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:52.651966 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-52ea912f-c6aa-42a9-82b9-143ab6d90b03 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:52.778882 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-52ea912f-c6aa-42a9-82b9-143ab6d90b03 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:52.782660 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-965caf40-f030-4d4d-a2d3-5c419572a0f6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:52.784528 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-965caf40-f030-4d4d-a2d3-5c419572a0f6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:52.789021 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-52ea912f-c6aa-42a9-82b9-143ab6d90b03 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.149604 Jul 11 11:46:52.789668 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1300/2601] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:52 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:52.791646 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-965caf40-f030-4d4d-a2d3-5c419572a0f6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:52.792104 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-965caf40-f030-4d4d-a2d3-5c419572a0f6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:52.792872 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-965caf40-f030-4d4d-a2d3-5c419572a0f6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:52.793306 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-965caf40-f030-4d4d-a2d3-5c419572a0f6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:52.855893 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-965caf40-f030-4d4d-a2d3-5c419572a0f6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:52.863769 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-965caf40-f030-4d4d-a2d3-5c419572a0f6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.084984 Jul 11 11:46:52.864330 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1302/2602] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:52 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:46:53.805926 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-a5846924-eeac-4974-8d84-ae540cc02f77 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:53.806566 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-a5846924-eeac-4974-8d84-ae540cc02f77 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:53.808886 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_api:SELECT=52 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:46:53.813637 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a5846924-eeac-4974-8d84-ae540cc02f77 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:53.814088 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a5846924-eeac-4974-8d84-ae540cc02f77 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:53.814853 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a5846924-eeac-4974-8d84-ae540cc02f77 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:53.815319 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a5846924-eeac-4974-8d84-ae540cc02f77 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:53.881274 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-a2677235-58d1-4cba-8289-dd793106506b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:53.881881 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-a2677235-58d1-4cba-8289-dd793106506b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:53.884191 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_api:SELECT=56 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:46:53.889402 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a2677235-58d1-4cba-8289-dd793106506b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:53.889848 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a2677235-58d1-4cba-8289-dd793106506b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:53.894321 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a2677235-58d1-4cba-8289-dd793106506b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:53.894321 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a2677235-58d1-4cba-8289-dd793106506b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:53.941420 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-a5846924-eeac-4974-8d84-ae540cc02f77 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:53.949788 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-a5846924-eeac-4974-8d84-ae540cc02f77 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.147763 Jul 11 11:46:53.951064 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1301/2603] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:53 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:53.953229 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-a2677235-58d1-4cba-8289-dd793106506b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:53.961120 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-a2677235-58d1-4cba-8289-dd793106506b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.083680 Jul 11 11:46:53.961669 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1303/2604] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:53 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:46:54.967535 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-fa863729-1e24-4684-b6b2-73d03f867f10 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:54.968170 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-fa863729-1e24-4684-b6b2-73d03f867f10 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:54.974735 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fa863729-1e24-4684-b6b2-73d03f867f10 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:54.975178 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fa863729-1e24-4684-b6b2-73d03f867f10 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:54.975955 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fa863729-1e24-4684-b6b2-73d03f867f10 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:54.976384 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fa863729-1e24-4684-b6b2-73d03f867f10 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:54.977814 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-e5efe920-e343-4486-bfda-2b3f85621755 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:54.978420 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-e5efe920-e343-4486-bfda-2b3f85621755 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:54.985356 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e5efe920-e343-4486-bfda-2b3f85621755 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:54.985803 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e5efe920-e343-4486-bfda-2b3f85621755 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:54.986560 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e5efe920-e343-4486-bfda-2b3f85621755 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:54.986999 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e5efe920-e343-4486-bfda-2b3f85621755 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:55.047925 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-e5efe920-e343-4486-bfda-2b3f85621755 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:55.056683 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-e5efe920-e343-4486-bfda-2b3f85621755 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.082524 Jul 11 11:46:55.057259 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1304/2605] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:54 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:46:55.107469 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-fa863729-1e24-4684-b6b2-73d03f867f10 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:55.115198 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-fa863729-1e24-4684-b6b2-73d03f867f10 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.152072 Jul 11 11:46:55.115782 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1302/2606] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:54 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:56.073762 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-87604d55-1c6b-43c1-9743-3e56d066704d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:56.074364 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-87604d55-1c6b-43c1-9743-3e56d066704d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:56.080818 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-87604d55-1c6b-43c1-9743-3e56d066704d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:56.081267 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-87604d55-1c6b-43c1-9743-3e56d066704d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:56.082020 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-87604d55-1c6b-43c1-9743-3e56d066704d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:56.082455 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-87604d55-1c6b-43c1-9743-3e56d066704d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:56.132277 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-7468c4ad-bde2-4bd4-9723-faf2751a350c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:56.132893 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-7468c4ad-bde2-4bd4-9723-faf2751a350c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:56.139272 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7468c4ad-bde2-4bd4-9723-faf2751a350c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:56.140123 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7468c4ad-bde2-4bd4-9723-faf2751a350c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:56.140482 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7468c4ad-bde2-4bd4-9723-faf2751a350c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:56.140918 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7468c4ad-bde2-4bd4-9723-faf2751a350c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:56.142306 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-87604d55-1c6b-43c1-9743-3e56d066704d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:56.150108 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-87604d55-1c6b-43c1-9743-3e56d066704d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.080578 Jul 11 11:46:56.150674 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1305/2607] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:56 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:56.271446 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-7468c4ad-bde2-4bd4-9723-faf2751a350c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:56.279555 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-7468c4ad-bde2-4bd4-9723-faf2751a350c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.151044 Jul 11 11:46:56.280119 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1303/2608] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:56 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:46:57.167009 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-bb036e44-c21e-4420-853d-ab78eba6213f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:57.167649 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-bb036e44-c21e-4420-853d-ab78eba6213f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:57.174280 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-bb036e44-c21e-4420-853d-ab78eba6213f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:57.174731 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-bb036e44-c21e-4420-853d-ab78eba6213f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:57.175596 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-bb036e44-c21e-4420-853d-ab78eba6213f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:57.176041 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-bb036e44-c21e-4420-853d-ab78eba6213f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:57.240332 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-bb036e44-c21e-4420-853d-ab78eba6213f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:57.248726 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-bb036e44-c21e-4420-853d-ab78eba6213f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.085546 Jul 11 11:46:57.249291 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1306/2609] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:57 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:57.296360 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-fb779281-04f6-4636-a8a5-02b30812b760 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:57.296963 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-fb779281-04f6-4636-a8a5-02b30812b760 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:57.303437 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fb779281-04f6-4636-a8a5-02b30812b760 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:57.303884 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fb779281-04f6-4636-a8a5-02b30812b760 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:57.304628 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fb779281-04f6-4636-a8a5-02b30812b760 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:57.305057 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fb779281-04f6-4636-a8a5-02b30812b760 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:57.430903 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-fb779281-04f6-4636-a8a5-02b30812b760 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:57.439564 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-fb779281-04f6-4636-a8a5-02b30812b760 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.146875 Jul 11 11:46:57.440134 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1304/2610] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:57 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:58.265832 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-09d3d96d-489c-4fc9-8917-5f112b651f02 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:58.266426 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-09d3d96d-489c-4fc9-8917-5f112b651f02 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:58.272979 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-09d3d96d-489c-4fc9-8917-5f112b651f02 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:58.273429 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-09d3d96d-489c-4fc9-8917-5f112b651f02 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:58.274181 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-09d3d96d-489c-4fc9-8917-5f112b651f02 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:58.274612 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-09d3d96d-489c-4fc9-8917-5f112b651f02 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:58.335357 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-09d3d96d-489c-4fc9-8917-5f112b651f02 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:58.343824 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-09d3d96d-489c-4fc9-8917-5f112b651f02 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.082022 Jul 11 11:46:58.344379 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1307/2611] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:58 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:58.457192 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-b3302059-79d5-48f0-a2ca-cec84e4f715b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:58.457802 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-b3302059-79d5-48f0-a2ca-cec84e4f715b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:58.464892 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b3302059-79d5-48f0-a2ca-cec84e4f715b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:58.465339 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b3302059-79d5-48f0-a2ca-cec84e4f715b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:58.466096 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b3302059-79d5-48f0-a2ca-cec84e4f715b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:58.466559 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b3302059-79d5-48f0-a2ca-cec84e4f715b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:58.611715 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-b3302059-79d5-48f0-a2ca-cec84e4f715b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:58.620097 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-b3302059-79d5-48f0-a2ca-cec84e4f715b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.166981 Jul 11 11:46:58.620660 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1305/2612] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:58 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:59.361225 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-478a654f-c631-4693-a6fc-fa2a8a705d98 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:59.361806 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-478a654f-c631-4693-a6fc-fa2a8a705d98 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:59.368518 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-478a654f-c631-4693-a6fc-fa2a8a705d98 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:59.368963 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-478a654f-c631-4693-a6fc-fa2a8a705d98 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:59.369714 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-478a654f-c631-4693-a6fc-fa2a8a705d98 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:59.370146 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-478a654f-c631-4693-a6fc-fa2a8a705d98 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:59.430109 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-478a654f-c631-4693-a6fc-fa2a8a705d98 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:59.437790 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-478a654f-c631-4693-a6fc-fa2a8a705d98 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.080508 Jul 11 11:46:59.438342 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1308/2613] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:59 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:46:59.637831 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-2c293f89-4605-4971-9309-edbe951f9c64 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:46:59.638372 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-2c293f89-4605-4971-9309-edbe951f9c64 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:46:59.644757 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2c293f89-4605-4971-9309-edbe951f9c64 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:59.645193 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2c293f89-4605-4971-9309-edbe951f9c64 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:59.645936 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2c293f89-4605-4971-9309-edbe951f9c64 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:46:59.646364 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2c293f89-4605-4971-9309-edbe951f9c64 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:46:59.771661 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-2c293f89-4605-4971-9309-edbe951f9c64 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:46:59.779975 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-2c293f89-4605-4971-9309-edbe951f9c64 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.146038 Jul 11 11:46:59.780524 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1306/2614] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:46:59 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:00.454982 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-12523e2a-a909-40ed-9606-4889b491c64b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:00.455772 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-12523e2a-a909-40ed-9606-4889b491c64b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:00.462566 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-12523e2a-a909-40ed-9606-4889b491c64b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:00.463008 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-12523e2a-a909-40ed-9606-4889b491c64b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:00.463788 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-12523e2a-a909-40ed-9606-4889b491c64b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:00.464299 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-12523e2a-a909-40ed-9606-4889b491c64b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:00.526723 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-12523e2a-a909-40ed-9606-4889b491c64b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:00.534690 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-12523e2a-a909-40ed-9606-4889b491c64b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.083912 Jul 11 11:47:00.535280 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1309/2615] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:00 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:00.797525 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-9f0d366a-7a9c-4cc6-8630-367f2bb0fff4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:00.798134 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-9f0d366a-7a9c-4cc6-8630-367f2bb0fff4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:00.804582 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9f0d366a-7a9c-4cc6-8630-367f2bb0fff4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:00.805026 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9f0d366a-7a9c-4cc6-8630-367f2bb0fff4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:00.805782 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9f0d366a-7a9c-4cc6-8630-367f2bb0fff4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:00.806214 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9f0d366a-7a9c-4cc6-8630-367f2bb0fff4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:00.821063 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=100 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:47:00.935235 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-9f0d366a-7a9c-4cc6-8630-367f2bb0fff4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:00.942977 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-9f0d366a-7a9c-4cc6-8630-367f2bb0fff4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.149250 Jul 11 11:47:00.943574 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1307/2616] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:00 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:01.552428 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-969eb031-3e99-468c-b30f-6dde16b16ed3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:01.553039 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-969eb031-3e99-468c-b30f-6dde16b16ed3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:01.561515 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-969eb031-3e99-468c-b30f-6dde16b16ed3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:01.561962 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-969eb031-3e99-468c-b30f-6dde16b16ed3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:01.562709 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-969eb031-3e99-468c-b30f-6dde16b16ed3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:01.563135 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-969eb031-3e99-468c-b30f-6dde16b16ed3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:01.627182 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-969eb031-3e99-468c-b30f-6dde16b16ed3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:01.634979 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-969eb031-3e99-468c-b30f-6dde16b16ed3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.086469 Jul 11 11:47:01.635574 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1310/2617] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:01 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:01.959908 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-f4f5cc0e-4deb-4984-a726-5da217ec5bfb tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:01.960512 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-f4f5cc0e-4deb-4984-a726-5da217ec5bfb tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:01.966933 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f4f5cc0e-4deb-4984-a726-5da217ec5bfb tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:01.967411 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f4f5cc0e-4deb-4984-a726-5da217ec5bfb tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:01.968159 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f4f5cc0e-4deb-4984-a726-5da217ec5bfb tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:01.968588 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f4f5cc0e-4deb-4984-a726-5da217ec5bfb tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:02.093982 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-f4f5cc0e-4deb-4984-a726-5da217ec5bfb tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:02.101718 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-f4f5cc0e-4deb-4984-a726-5da217ec5bfb tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.145642 Jul 11 11:47:02.102274 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1308/2618] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:01 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:02.652401 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-d4186bfc-c516-4660-8b84-df204129ed46 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:02.652970 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-d4186bfc-c516-4660-8b84-df204129ed46 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:02.659472 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d4186bfc-c516-4660-8b84-df204129ed46 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:02.659930 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d4186bfc-c516-4660-8b84-df204129ed46 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:02.660704 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d4186bfc-c516-4660-8b84-df204129ed46 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:02.661131 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d4186bfc-c516-4660-8b84-df204129ed46 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:02.721278 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-d4186bfc-c516-4660-8b84-df204129ed46 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:02.729125 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-d4186bfc-c516-4660-8b84-df204129ed46 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.081158 Jul 11 11:47:02.730366 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1311/2619] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:02 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:03.119357 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-35983f42-e66e-4fe0-9673-34a2f563211f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:03.119970 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-35983f42-e66e-4fe0-9673-34a2f563211f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:03.126880 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-35983f42-e66e-4fe0-9673-34a2f563211f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:03.127353 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-35983f42-e66e-4fe0-9673-34a2f563211f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:03.128122 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-35983f42-e66e-4fe0-9673-34a2f563211f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:03.128605 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-35983f42-e66e-4fe0-9673-34a2f563211f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:03.348673 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-35983f42-e66e-4fe0-9673-34a2f563211f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:03.356645 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-35983f42-e66e-4fe0-9673-34a2f563211f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.241223 Jul 11 11:47:03.357216 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1309/2620] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:03 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:03.747215 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-dd8fd0a0-8589-459b-ada3-f9c1d1b9b9b9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:03.747899 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-dd8fd0a0-8589-459b-ada3-f9c1d1b9b9b9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:03.754269 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-dd8fd0a0-8589-459b-ada3-f9c1d1b9b9b9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:03.754713 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-dd8fd0a0-8589-459b-ada3-f9c1d1b9b9b9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:03.755557 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-dd8fd0a0-8589-459b-ada3-f9c1d1b9b9b9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:03.755989 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-dd8fd0a0-8589-459b-ada3-f9c1d1b9b9b9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:03.816078 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-dd8fd0a0-8589-459b-ada3-f9c1d1b9b9b9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:03.824224 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-dd8fd0a0-8589-459b-ada3-f9c1d1b9b9b9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.081478 Jul 11 11:47:03.824778 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1312/2621] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:03 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:04.373886 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-fee4c334-868a-4730-8fe0-bb2074c48127 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:04.374573 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-fee4c334-868a-4730-8fe0-bb2074c48127 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:04.381077 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fee4c334-868a-4730-8fe0-bb2074c48127 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:04.381523 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fee4c334-868a-4730-8fe0-bb2074c48127 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:04.382277 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fee4c334-868a-4730-8fe0-bb2074c48127 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:04.382710 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fee4c334-868a-4730-8fe0-bb2074c48127 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:04.518531 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-fee4c334-868a-4730-8fe0-bb2074c48127 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:04.526908 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-fee4c334-868a-4730-8fe0-bb2074c48127 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.156316 Jul 11 11:47:04.527498 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1310/2622] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:04 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:04.841061 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-db76bb78-b05e-4495-8233-a7b83ca731ad tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:04.841668 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-db76bb78-b05e-4495-8233-a7b83ca731ad tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:04.848130 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-db76bb78-b05e-4495-8233-a7b83ca731ad tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:04.848580 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-db76bb78-b05e-4495-8233-a7b83ca731ad tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:04.849341 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-db76bb78-b05e-4495-8233-a7b83ca731ad tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:04.849774 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-db76bb78-b05e-4495-8233-a7b83ca731ad tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:04.914736 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-db76bb78-b05e-4495-8233-a7b83ca731ad tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:04.922640 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-db76bb78-b05e-4495-8233-a7b83ca731ad tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.085487 Jul 11 11:47:04.923195 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1313/2623] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:04 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:05.544719 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-d8ad4f54-7562-4ad4-b612-65fd599b8f29 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:05.545363 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-d8ad4f54-7562-4ad4-b612-65fd599b8f29 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:05.551767 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d8ad4f54-7562-4ad4-b612-65fd599b8f29 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:05.552206 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d8ad4f54-7562-4ad4-b612-65fd599b8f29 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:05.552958 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d8ad4f54-7562-4ad4-b612-65fd599b8f29 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:05.553481 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d8ad4f54-7562-4ad4-b612-65fd599b8f29 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:05.679755 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-d8ad4f54-7562-4ad4-b612-65fd599b8f29 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:05.687759 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-d8ad4f54-7562-4ad4-b612-65fd599b8f29 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.147633 Jul 11 11:47:05.688325 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1311/2624] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:05 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:05.939527 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-ab68afa5-00f4-49f3-bb41-78233cfbaf26 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:05.940138 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-ab68afa5-00f4-49f3-bb41-78233cfbaf26 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:05.946635 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ab68afa5-00f4-49f3-bb41-78233cfbaf26 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:05.947086 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ab68afa5-00f4-49f3-bb41-78233cfbaf26 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:05.948735 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ab68afa5-00f4-49f3-bb41-78233cfbaf26 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:05.949177 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ab68afa5-00f4-49f3-bb41-78233cfbaf26 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:06.013120 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-ab68afa5-00f4-49f3-bb41-78233cfbaf26 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:06.021004 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-ab68afa5-00f4-49f3-bb41-78233cfbaf26 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.085494 Jul 11 11:47:06.021566 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1314/2625] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:05 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:06.704971 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-7b929a75-9137-467f-8071-667aa0df2c0e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:06.705581 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-7b929a75-9137-467f-8071-667aa0df2c0e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:06.712009 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7b929a75-9137-467f-8071-667aa0df2c0e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:06.712455 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7b929a75-9137-467f-8071-667aa0df2c0e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:06.713203 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7b929a75-9137-467f-8071-667aa0df2c0e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:06.713638 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7b929a75-9137-467f-8071-667aa0df2c0e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:06.844418 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-7b929a75-9137-467f-8071-667aa0df2c0e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:06.852476 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-7b929a75-9137-467f-8071-667aa0df2c0e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.151397 Jul 11 11:47:06.853042 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1312/2626] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:06 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:07.037853 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-98cf01d7-551e-4c2b-8217-e4fa5bf4f3f9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:07.038404 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-98cf01d7-551e-4c2b-8217-e4fa5bf4f3f9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:07.045329 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-98cf01d7-551e-4c2b-8217-e4fa5bf4f3f9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:07.045770 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-98cf01d7-551e-4c2b-8217-e4fa5bf4f3f9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:07.046521 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-98cf01d7-551e-4c2b-8217-e4fa5bf4f3f9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:07.046951 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-98cf01d7-551e-4c2b-8217-e4fa5bf4f3f9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:07.107371 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-98cf01d7-551e-4c2b-8217-e4fa5bf4f3f9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:07.115146 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-98cf01d7-551e-4c2b-8217-e4fa5bf4f3f9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.081248 Jul 11 11:47:07.115733 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1315/2627] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:07 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:07.869418 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-c89443ec-3547-4249-bd79-e1318c54384e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:07.870605 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-c89443ec-3547-4249-bd79-e1318c54384e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:07.879838 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c89443ec-3547-4249-bd79-e1318c54384e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:07.880512 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c89443ec-3547-4249-bd79-e1318c54384e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:07.881668 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c89443ec-3547-4249-bd79-e1318c54384e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:07.882247 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c89443ec-3547-4249-bd79-e1318c54384e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:08.008664 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-c89443ec-3547-4249-bd79-e1318c54384e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:08.016458 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-c89443ec-3547-4249-bd79-e1318c54384e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.150846 Jul 11 11:47:08.017016 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1313/2628] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:07 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:08.131893 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-2a4062c2-d48e-4090-a9b0-d4adaf390287 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:08.132506 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-2a4062c2-d48e-4090-a9b0-d4adaf390287 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:08.138954 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2a4062c2-d48e-4090-a9b0-d4adaf390287 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:08.139439 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2a4062c2-d48e-4090-a9b0-d4adaf390287 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:08.140193 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2a4062c2-d48e-4090-a9b0-d4adaf390287 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:08.140628 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2a4062c2-d48e-4090-a9b0-d4adaf390287 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:08.202058 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-2a4062c2-d48e-4090-a9b0-d4adaf390287 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:08.209920 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-2a4062c2-d48e-4090-a9b0-d4adaf390287 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.081810 Jul 11 11:47:08.210427 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1316/2629] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:08 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:09.033262 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-d6104da6-c457-4a45-9e20-5e1041be6eaa tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:09.033881 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-d6104da6-c457-4a45-9e20-5e1041be6eaa tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:09.040254 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d6104da6-c457-4a45-9e20-5e1041be6eaa tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:09.040701 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d6104da6-c457-4a45-9e20-5e1041be6eaa tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:09.041482 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d6104da6-c457-4a45-9e20-5e1041be6eaa tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:09.041970 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d6104da6-c457-4a45-9e20-5e1041be6eaa tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:09.170503 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-d6104da6-c457-4a45-9e20-5e1041be6eaa tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:09.178339 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-d6104da6-c457-4a45-9e20-5e1041be6eaa tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.148958 Jul 11 11:47:09.178932 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1314/2630] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:09 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:09.227052 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-b6161da1-f3b3-4124-867d-b8c23004f5e6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:09.227685 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-b6161da1-f3b3-4124-867d-b8c23004f5e6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:09.234034 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b6161da1-f3b3-4124-867d-b8c23004f5e6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:09.234574 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b6161da1-f3b3-4124-867d-b8c23004f5e6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:09.235353 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b6161da1-f3b3-4124-867d-b8c23004f5e6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:09.235815 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b6161da1-f3b3-4124-867d-b8c23004f5e6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:09.295827 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-b6161da1-f3b3-4124-867d-b8c23004f5e6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:09.303603 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-b6161da1-f3b3-4124-867d-b8c23004f5e6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.080455 Jul 11 11:47:09.304168 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1317/2631] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:09 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:10.196012 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-0de3ecba-8dac-47eb-805b-0f05c2c4f46d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:10.196607 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-0de3ecba-8dac-47eb-805b-0f05c2c4f46d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:10.203346 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0de3ecba-8dac-47eb-805b-0f05c2c4f46d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:10.203797 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0de3ecba-8dac-47eb-805b-0f05c2c4f46d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:10.204555 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0de3ecba-8dac-47eb-805b-0f05c2c4f46d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:10.204991 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0de3ecba-8dac-47eb-805b-0f05c2c4f46d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:10.321119 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-540cef8c-8849-40ca-962b-643e55db8779 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:10.321764 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-540cef8c-8849-40ca-962b-643e55db8779 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:10.329266 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-540cef8c-8849-40ca-962b-643e55db8779 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:10.329653 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-540cef8c-8849-40ca-962b-643e55db8779 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:10.330417 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-540cef8c-8849-40ca-962b-643e55db8779 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:10.330850 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-540cef8c-8849-40ca-962b-643e55db8779 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:10.332798 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-0de3ecba-8dac-47eb-805b-0f05c2c4f46d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:10.333472 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=100 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:47:10.348078 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-0de3ecba-8dac-47eb-805b-0f05c2c4f46d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.149197 Jul 11 11:47:10.348078 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1315/2632] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:10 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:10.395475 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-540cef8c-8849-40ca-962b-643e55db8779 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:10.403827 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-540cef8c-8849-40ca-962b-643e55db8779 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.086716 Jul 11 11:47:10.404392 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1318/2633] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:10 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:47:11.359353 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-46fd206e-a525-46e3-8657-a3761c472512 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:11.359906 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-46fd206e-a525-46e3-8657-a3761c472512 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:11.366271 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-46fd206e-a525-46e3-8657-a3761c472512 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:11.366723 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-46fd206e-a525-46e3-8657-a3761c472512 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:11.367513 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-46fd206e-a525-46e3-8657-a3761c472512 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:11.367945 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-46fd206e-a525-46e3-8657-a3761c472512 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:11.421737 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-44e86d8e-7ed7-4d81-9132-6d47f2c38d79 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:11.422344 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-44e86d8e-7ed7-4d81-9132-6d47f2c38d79 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:11.428792 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-44e86d8e-7ed7-4d81-9132-6d47f2c38d79 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:11.429240 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-44e86d8e-7ed7-4d81-9132-6d47f2c38d79 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:11.429999 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-44e86d8e-7ed7-4d81-9132-6d47f2c38d79 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:11.430436 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-44e86d8e-7ed7-4d81-9132-6d47f2c38d79 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:11.493541 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-44e86d8e-7ed7-4d81-9132-6d47f2c38d79 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:11.498670 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-46fd206e-a525-46e3-8657-a3761c472512 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:11.501544 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-44e86d8e-7ed7-4d81-9132-6d47f2c38d79 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.083606 Jul 11 11:47:11.502121 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1319/2634] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:11 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:47:11.506497 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-46fd206e-a525-46e3-8657-a3761c472512 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.151069 Jul 11 11:47:11.507053 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1316/2635] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:11 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:12.518555 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-5d24ed51-11e3-45a8-8972-066e31ff8f21 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:12.519194 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-5d24ed51-11e3-45a8-8972-066e31ff8f21 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:12.522621 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-4850dfa5-1b22-44d6-93cb-f7bee7f4d192 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:12.523269 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-4850dfa5-1b22-44d6-93cb-f7bee7f4d192 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:12.525955 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5d24ed51-11e3-45a8-8972-066e31ff8f21 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:12.526397 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5d24ed51-11e3-45a8-8972-066e31ff8f21 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:12.527159 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5d24ed51-11e3-45a8-8972-066e31ff8f21 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:12.527618 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5d24ed51-11e3-45a8-8972-066e31ff8f21 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:12.533406 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4850dfa5-1b22-44d6-93cb-f7bee7f4d192 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:12.533850 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4850dfa5-1b22-44d6-93cb-f7bee7f4d192 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:12.534981 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4850dfa5-1b22-44d6-93cb-f7bee7f4d192 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:12.535450 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4850dfa5-1b22-44d6-93cb-f7bee7f4d192 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:12.590002 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-5d24ed51-11e3-45a8-8972-066e31ff8f21 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:12.597791 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-5d24ed51-11e3-45a8-8972-066e31ff8f21 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.083186 Jul 11 11:47:12.598352 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1320/2636] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:12 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:12.668577 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-4850dfa5-1b22-44d6-93cb-f7bee7f4d192 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:12.676488 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-4850dfa5-1b22-44d6-93cb-f7bee7f4d192 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.157667 Jul 11 11:47:12.677052 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1317/2637] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:12 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:13.616042 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-116c552b-23a0-4503-b3b5-acbe2885f8d8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:13.616657 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-116c552b-23a0-4503-b3b5-acbe2885f8d8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:13.623101 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-116c552b-23a0-4503-b3b5-acbe2885f8d8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:13.623615 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-116c552b-23a0-4503-b3b5-acbe2885f8d8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:13.624378 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-116c552b-23a0-4503-b3b5-acbe2885f8d8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:13.624816 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-116c552b-23a0-4503-b3b5-acbe2885f8d8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:13.685697 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-116c552b-23a0-4503-b3b5-acbe2885f8d8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:13.693829 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-36aec8c4-32dd-493e-9724-59c31feb7adf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:13.694376 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-116c552b-23a0-4503-b3b5-acbe2885f8d8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.082455 Jul 11 11:47:13.694500 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-36aec8c4-32dd-493e-9724-59c31feb7adf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:13.694808 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1321/2638] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:13 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:13.702177 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-36aec8c4-32dd-493e-9724-59c31feb7adf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:13.702629 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-36aec8c4-32dd-493e-9724-59c31feb7adf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:13.703420 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-36aec8c4-32dd-493e-9724-59c31feb7adf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:13.703855 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-36aec8c4-32dd-493e-9724-59c31feb7adf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:13.830120 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-36aec8c4-32dd-493e-9724-59c31feb7adf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:13.837943 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-36aec8c4-32dd-493e-9724-59c31feb7adf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.147950 Jul 11 11:47:13.838503 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1318/2639] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:13 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:47:14.711449 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-79947424-15c4-4e0d-9ae3-c4f4de2c059f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:14.712056 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-79947424-15c4-4e0d-9ae3-c4f4de2c059f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:14.718950 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-79947424-15c4-4e0d-9ae3-c4f4de2c059f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:14.719425 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-79947424-15c4-4e0d-9ae3-c4f4de2c059f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:14.720176 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-79947424-15c4-4e0d-9ae3-c4f4de2c059f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:14.720621 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-79947424-15c4-4e0d-9ae3-c4f4de2c059f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:14.784466 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-79947424-15c4-4e0d-9ae3-c4f4de2c059f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:14.792419 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-79947424-15c4-4e0d-9ae3-c4f4de2c059f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.084875 Jul 11 11:47:14.792989 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1322/2640] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:14 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:14.854997 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-3b00ae73-32d1-4caa-ab14-40696f4462ff tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:14.855674 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-3b00ae73-32d1-4caa-ab14-40696f4462ff tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:14.861755 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3b00ae73-32d1-4caa-ab14-40696f4462ff tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:14.862204 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3b00ae73-32d1-4caa-ab14-40696f4462ff tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:14.862954 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3b00ae73-32d1-4caa-ab14-40696f4462ff tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:14.863420 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3b00ae73-32d1-4caa-ab14-40696f4462ff tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:14.991505 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-3b00ae73-32d1-4caa-ab14-40696f4462ff tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:14.999342 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-3b00ae73-32d1-4caa-ab14-40696f4462ff tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.148148 Jul 11 11:47:14.999908 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1319/2641] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:14 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:15.810290 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-4bed7a06-5626-4eff-a1db-0fafe0e10343 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:15.810822 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-4bed7a06-5626-4eff-a1db-0fafe0e10343 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:15.816790 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4bed7a06-5626-4eff-a1db-0fafe0e10343 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:15.817233 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4bed7a06-5626-4eff-a1db-0fafe0e10343 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:15.817981 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4bed7a06-5626-4eff-a1db-0fafe0e10343 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:15.818411 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4bed7a06-5626-4eff-a1db-0fafe0e10343 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:15.877981 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-4bed7a06-5626-4eff-a1db-0fafe0e10343 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:15.885603 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-4bed7a06-5626-4eff-a1db-0fafe0e10343 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.079967 Jul 11 11:47:15.886163 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1323/2642] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:15 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:16.016281 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-209db181-4ce9-4aa1-be99-1c203c23e98c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:16.016902 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-209db181-4ce9-4aa1-be99-1c203c23e98c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:16.023223 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-209db181-4ce9-4aa1-be99-1c203c23e98c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:16.023697 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-209db181-4ce9-4aa1-be99-1c203c23e98c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:16.024442 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-209db181-4ce9-4aa1-be99-1c203c23e98c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:16.024869 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-209db181-4ce9-4aa1-be99-1c203c23e98c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:16.153581 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-209db181-4ce9-4aa1-be99-1c203c23e98c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:16.161360 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-209db181-4ce9-4aa1-be99-1c203c23e98c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.148849 Jul 11 11:47:16.161930 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1320/2643] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:16 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:16.902608 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-6b153753-c7ab-4e02-bf8f-2c89ab65ec76 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:16.903169 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-6b153753-c7ab-4e02-bf8f-2c89ab65ec76 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:16.909478 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6b153753-c7ab-4e02-bf8f-2c89ab65ec76 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:16.911703 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6b153753-c7ab-4e02-bf8f-2c89ab65ec76 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:16.911703 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6b153753-c7ab-4e02-bf8f-2c89ab65ec76 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:16.911703 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6b153753-c7ab-4e02-bf8f-2c89ab65ec76 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:16.974087 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-6b153753-c7ab-4e02-bf8f-2c89ab65ec76 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:16.982904 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-6b153753-c7ab-4e02-bf8f-2c89ab65ec76 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.084239 Jul 11 11:47:16.989282 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1324/2644] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:16 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:17.179201 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-d3152c18-a99d-4ecb-97c9-fb9831a72ece tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:17.179854 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-d3152c18-a99d-4ecb-97c9-fb9831a72ece tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:17.187123 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d3152c18-a99d-4ecb-97c9-fb9831a72ece tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:17.187609 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d3152c18-a99d-4ecb-97c9-fb9831a72ece tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:17.188411 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d3152c18-a99d-4ecb-97c9-fb9831a72ece tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:17.188848 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d3152c18-a99d-4ecb-97c9-fb9831a72ece tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:17.319117 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-d3152c18-a99d-4ecb-97c9-fb9831a72ece tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:17.327278 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-d3152c18-a99d-4ecb-97c9-fb9831a72ece tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.151862 Jul 11 11:47:17.328714 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1321/2645] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:17 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:17.999650 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-1783a48a-64e6-4348-8da9-768b4db15f0d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:18.000264 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-1783a48a-64e6-4348-8da9-768b4db15f0d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:18.006686 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1783a48a-64e6-4348-8da9-768b4db15f0d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:18.007138 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1783a48a-64e6-4348-8da9-768b4db15f0d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:18.007929 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1783a48a-64e6-4348-8da9-768b4db15f0d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:18.008363 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1783a48a-64e6-4348-8da9-768b4db15f0d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:18.068865 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-1783a48a-64e6-4348-8da9-768b4db15f0d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:18.077632 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-1783a48a-64e6-4348-8da9-768b4db15f0d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.081840 Jul 11 11:47:18.078195 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1325/2646] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:17 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:18.344645 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-78041902-ab99-4fdd-8337-7c7f67f9517c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:18.345286 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-78041902-ab99-4fdd-8337-7c7f67f9517c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:18.351907 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-78041902-ab99-4fdd-8337-7c7f67f9517c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:18.352355 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-78041902-ab99-4fdd-8337-7c7f67f9517c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:18.353112 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-78041902-ab99-4fdd-8337-7c7f67f9517c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:18.353544 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-78041902-ab99-4fdd-8337-7c7f67f9517c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:18.480053 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-78041902-ab99-4fdd-8337-7c7f67f9517c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:18.489110 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-78041902-ab99-4fdd-8337-7c7f67f9517c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.148416 Jul 11 11:47:18.489684 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1322/2647] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:18 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:19.094446 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-3ade92eb-a60b-460b-a292-0075e87e6cfa tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:19.095053 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-3ade92eb-a60b-460b-a292-0075e87e6cfa tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:19.101472 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3ade92eb-a60b-460b-a292-0075e87e6cfa tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:19.101917 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3ade92eb-a60b-460b-a292-0075e87e6cfa tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:19.102667 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3ade92eb-a60b-460b-a292-0075e87e6cfa tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:19.103101 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3ade92eb-a60b-460b-a292-0075e87e6cfa tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:19.168666 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-3ade92eb-a60b-460b-a292-0075e87e6cfa tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:19.176842 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-3ade92eb-a60b-460b-a292-0075e87e6cfa tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.086348 Jul 11 11:47:19.177402 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1326/2648] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:19 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:19.507513 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-a0181c22-fa69-4576-9b1a-2a3db7ea4741 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:19.508111 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-a0181c22-fa69-4576-9b1a-2a3db7ea4741 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:19.515078 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a0181c22-fa69-4576-9b1a-2a3db7ea4741 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:19.515550 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a0181c22-fa69-4576-9b1a-2a3db7ea4741 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:19.516300 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a0181c22-fa69-4576-9b1a-2a3db7ea4741 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:19.516736 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a0181c22-fa69-4576-9b1a-2a3db7ea4741 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:19.641067 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-a0181c22-fa69-4576-9b1a-2a3db7ea4741 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:19.648951 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-a0181c22-fa69-4576-9b1a-2a3db7ea4741 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.145300 Jul 11 11:47:19.649524 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1323/2649] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:19 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:20.192884 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-8395828f-a494-4f71-918d-675e715aa9f4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:20.193491 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-8395828f-a494-4f71-918d-675e715aa9f4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:20.200265 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8395828f-a494-4f71-918d-675e715aa9f4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:20.200706 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8395828f-a494-4f71-918d-675e715aa9f4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:20.201444 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8395828f-a494-4f71-918d-675e715aa9f4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:20.201873 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8395828f-a494-4f71-918d-675e715aa9f4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:20.263173 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-8395828f-a494-4f71-918d-675e715aa9f4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:20.271061 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-8395828f-a494-4f71-918d-675e715aa9f4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.081990 Jul 11 11:47:20.271666 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1327/2650] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:20 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:20.666146 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-9f025555-8c87-496c-add6-0dc1aa0c1ebc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:20.666786 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-9f025555-8c87-496c-add6-0dc1aa0c1ebc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:20.673975 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9f025555-8c87-496c-add6-0dc1aa0c1ebc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:20.674426 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9f025555-8c87-496c-add6-0dc1aa0c1ebc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:20.675187 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9f025555-8c87-496c-add6-0dc1aa0c1ebc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:20.675656 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9f025555-8c87-496c-add6-0dc1aa0c1ebc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:20.679538 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=100 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:47:20.806506 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-9f025555-8c87-496c-add6-0dc1aa0c1ebc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:20.814333 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-9f025555-8c87-496c-add6-0dc1aa0c1ebc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.152019 Jul 11 11:47:20.814910 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1324/2651] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:20 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:21.287916 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-3a0ad321-7af2-42a4-b8b4-f1b7b85b60b4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:21.288565 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-3a0ad321-7af2-42a4-b8b4-f1b7b85b60b4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:21.295118 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3a0ad321-7af2-42a4-b8b4-f1b7b85b60b4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:21.295597 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3a0ad321-7af2-42a4-b8b4-f1b7b85b60b4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:21.296364 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3a0ad321-7af2-42a4-b8b4-f1b7b85b60b4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:21.296803 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3a0ad321-7af2-42a4-b8b4-f1b7b85b60b4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:21.357339 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-3a0ad321-7af2-42a4-b8b4-f1b7b85b60b4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:21.365090 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-3a0ad321-7af2-42a4-b8b4-f1b7b85b60b4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.081068 Jul 11 11:47:21.365652 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1328/2652] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:21 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:21.832175 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-2ab88af5-f695-4742-be80-e37f87790a0c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:21.832874 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-2ab88af5-f695-4742-be80-e37f87790a0c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:21.839659 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2ab88af5-f695-4742-be80-e37f87790a0c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:21.840098 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2ab88af5-f695-4742-be80-e37f87790a0c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:21.840840 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2ab88af5-f695-4742-be80-e37f87790a0c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:21.841263 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2ab88af5-f695-4742-be80-e37f87790a0c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:21.969859 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-2ab88af5-f695-4742-be80-e37f87790a0c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:21.977660 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-2ab88af5-f695-4742-be80-e37f87790a0c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.149394 Jul 11 11:47:21.978221 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1325/2653] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:21 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:22.382088 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-3838d24d-0178-4dd9-b5c6-4695c34b57cc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:22.382701 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-3838d24d-0178-4dd9-b5c6-4695c34b57cc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:22.389596 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3838d24d-0178-4dd9-b5c6-4695c34b57cc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:22.390073 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3838d24d-0178-4dd9-b5c6-4695c34b57cc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:22.390829 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3838d24d-0178-4dd9-b5c6-4695c34b57cc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:22.391277 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3838d24d-0178-4dd9-b5c6-4695c34b57cc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:22.454488 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-3838d24d-0178-4dd9-b5c6-4695c34b57cc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:22.462289 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-3838d24d-0178-4dd9-b5c6-4695c34b57cc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.084410 Jul 11 11:47:22.462848 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1329/2654] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:22 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:22.996000 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-40fd65c1-6d2c-49ab-92f2-4097a3f77486 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:22.996608 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-40fd65c1-6d2c-49ab-92f2-4097a3f77486 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:23.003079 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-40fd65c1-6d2c-49ab-92f2-4097a3f77486 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:23.003551 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-40fd65c1-6d2c-49ab-92f2-4097a3f77486 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:23.004307 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-40fd65c1-6d2c-49ab-92f2-4097a3f77486 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:23.004740 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-40fd65c1-6d2c-49ab-92f2-4097a3f77486 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:23.134721 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-40fd65c1-6d2c-49ab-92f2-4097a3f77486 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:23.142688 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-40fd65c1-6d2c-49ab-92f2-4097a3f77486 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.151133 Jul 11 11:47:23.143275 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1326/2655] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:22 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:23.480223 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-68588d8d-6ece-4ef5-b552-544688a8ac87 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:23.480833 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-68588d8d-6ece-4ef5-b552-544688a8ac87 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:23.487441 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-68588d8d-6ece-4ef5-b552-544688a8ac87 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:23.487888 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-68588d8d-6ece-4ef5-b552-544688a8ac87 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:23.488641 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-68588d8d-6ece-4ef5-b552-544688a8ac87 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:23.489135 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-68588d8d-6ece-4ef5-b552-544688a8ac87 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:23.552916 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-68588d8d-6ece-4ef5-b552-544688a8ac87 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:23.560743 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-68588d8d-6ece-4ef5-b552-544688a8ac87 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.084933 Jul 11 11:47:23.561302 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1330/2656] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:23 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:24.159556 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-62f53d2e-ad8c-4552-8778-e5e1b07e3889 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:24.160140 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-62f53d2e-ad8c-4552-8778-e5e1b07e3889 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:24.162450 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_api:SELECT=52 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:47:24.167112 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-62f53d2e-ad8c-4552-8778-e5e1b07e3889 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:24.167614 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-62f53d2e-ad8c-4552-8778-e5e1b07e3889 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:24.168365 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-62f53d2e-ad8c-4552-8778-e5e1b07e3889 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:24.168801 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-62f53d2e-ad8c-4552-8778-e5e1b07e3889 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:24.294065 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-62f53d2e-ad8c-4552-8778-e5e1b07e3889 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:24.302040 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-62f53d2e-ad8c-4552-8778-e5e1b07e3889 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.146609 Jul 11 11:47:24.302612 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1327/2657] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:24 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:24.578398 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-546595c3-a7b3-4d11-a698-3fefffeb0fcb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:24.579047 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-546595c3-a7b3-4d11-a698-3fefffeb0fcb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:24.581429 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_api:SELECT=56 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:47:24.586370 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-546595c3-a7b3-4d11-a698-3fefffeb0fcb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:24.586823 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-546595c3-a7b3-4d11-a698-3fefffeb0fcb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:24.587621 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-546595c3-a7b3-4d11-a698-3fefffeb0fcb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:24.588060 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-546595c3-a7b3-4d11-a698-3fefffeb0fcb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:24.650032 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-546595c3-a7b3-4d11-a698-3fefffeb0fcb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:24.658778 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-546595c3-a7b3-4d11-a698-3fefffeb0fcb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.084333 Jul 11 11:47:24.659360 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1331/2658] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:24 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:47:25.319597 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-904c868a-4d09-4114-b391-ad79b82b27ad tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:25.320216 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-904c868a-4d09-4114-b391-ad79b82b27ad tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:25.327001 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-904c868a-4d09-4114-b391-ad79b82b27ad tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:25.327431 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-904c868a-4d09-4114-b391-ad79b82b27ad tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:25.328220 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-904c868a-4d09-4114-b391-ad79b82b27ad tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:25.328660 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-904c868a-4d09-4114-b391-ad79b82b27ad tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:25.456800 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-904c868a-4d09-4114-b391-ad79b82b27ad tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:25.464642 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-904c868a-4d09-4114-b391-ad79b82b27ad tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.148860 Jul 11 11:47:25.465213 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1328/2659] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:25 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:25.676186 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-2fca94e2-210f-4b1c-920a-4c05b3d362a0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:25.676807 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-2fca94e2-210f-4b1c-920a-4c05b3d362a0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:25.683278 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2fca94e2-210f-4b1c-920a-4c05b3d362a0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:25.683742 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2fca94e2-210f-4b1c-920a-4c05b3d362a0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:25.684498 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2fca94e2-210f-4b1c-920a-4c05b3d362a0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:25.684930 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2fca94e2-210f-4b1c-920a-4c05b3d362a0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:25.745455 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-2fca94e2-210f-4b1c-920a-4c05b3d362a0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:25.753226 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-2fca94e2-210f-4b1c-920a-4c05b3d362a0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.080990 Jul 11 11:47:25.753792 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1332/2660] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:25 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:26.481925 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-6457492c-61c7-415a-b7b9-f0fd2c746876 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:26.482527 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-6457492c-61c7-415a-b7b9-f0fd2c746876 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:26.488996 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6457492c-61c7-415a-b7b9-f0fd2c746876 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:26.489433 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6457492c-61c7-415a-b7b9-f0fd2c746876 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:26.490182 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6457492c-61c7-415a-b7b9-f0fd2c746876 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:26.490608 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6457492c-61c7-415a-b7b9-f0fd2c746876 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:26.625835 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-6457492c-61c7-415a-b7b9-f0fd2c746876 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:26.633851 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-6457492c-61c7-415a-b7b9-f0fd2c746876 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.155731 Jul 11 11:47:26.634414 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1329/2661] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:26 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:26.769804 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-2c0a2826-b2d1-4f52-8b46-4a8bad2c1560 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:26.770431 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-2c0a2826-b2d1-4f52-8b46-4a8bad2c1560 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:26.776783 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2c0a2826-b2d1-4f52-8b46-4a8bad2c1560 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:26.777226 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2c0a2826-b2d1-4f52-8b46-4a8bad2c1560 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:26.777969 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2c0a2826-b2d1-4f52-8b46-4a8bad2c1560 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:26.778422 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2c0a2826-b2d1-4f52-8b46-4a8bad2c1560 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:26.840610 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-2c0a2826-b2d1-4f52-8b46-4a8bad2c1560 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:26.848541 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-2c0a2826-b2d1-4f52-8b46-4a8bad2c1560 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.082570 Jul 11 11:47:26.849091 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1333/2662] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:26 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:27.652374 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-c6bad85c-acf0-45ba-93cf-9fa1d9f4306c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:27.652942 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-c6bad85c-acf0-45ba-93cf-9fa1d9f4306c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:27.659576 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c6bad85c-acf0-45ba-93cf-9fa1d9f4306c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:27.660027 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c6bad85c-acf0-45ba-93cf-9fa1d9f4306c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:27.660817 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c6bad85c-acf0-45ba-93cf-9fa1d9f4306c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:27.661257 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c6bad85c-acf0-45ba-93cf-9fa1d9f4306c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:27.790689 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-c6bad85c-acf0-45ba-93cf-9fa1d9f4306c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:27.798505 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-c6bad85c-acf0-45ba-93cf-9fa1d9f4306c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.150733 Jul 11 11:47:27.799062 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1330/2663] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:27 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:27.864902 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-3335faf6-cfa0-49b1-9751-d9022481da71 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:27.865512 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-3335faf6-cfa0-49b1-9751-d9022481da71 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:27.872585 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3335faf6-cfa0-49b1-9751-d9022481da71 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:27.873031 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3335faf6-cfa0-49b1-9751-d9022481da71 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:27.873786 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3335faf6-cfa0-49b1-9751-d9022481da71 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:27.874221 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3335faf6-cfa0-49b1-9751-d9022481da71 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:27.938888 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-3335faf6-cfa0-49b1-9751-d9022481da71 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:27.941073 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=100 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:47:27.947369 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-3335faf6-cfa0-49b1-9751-d9022481da71 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.086237 Jul 11 11:47:27.951875 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1334/2664] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:27 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:28.815577 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-9b33b00a-5d50-499c-b6ac-6b5b1b431f0b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:28.816177 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-9b33b00a-5d50-499c-b6ac-6b5b1b431f0b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:28.822954 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9b33b00a-5d50-499c-b6ac-6b5b1b431f0b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:28.823464 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9b33b00a-5d50-499c-b6ac-6b5b1b431f0b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:28.824215 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9b33b00a-5d50-499c-b6ac-6b5b1b431f0b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:28.824646 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9b33b00a-5d50-499c-b6ac-6b5b1b431f0b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:28.966422 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-0b16bcdd-8400-46f2-bf92-97df9dccadc4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:28.967115 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-0b16bcdd-8400-46f2-bf92-97df9dccadc4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:28.974497 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0b16bcdd-8400-46f2-bf92-97df9dccadc4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:28.979610 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0b16bcdd-8400-46f2-bf92-97df9dccadc4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:28.979610 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0b16bcdd-8400-46f2-bf92-97df9dccadc4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:28.979610 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0b16bcdd-8400-46f2-bf92-97df9dccadc4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:28.980065 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-9b33b00a-5d50-499c-b6ac-6b5b1b431f0b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:28.985293 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-9b33b00a-5d50-499c-b6ac-6b5b1b431f0b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.173626 Jul 11 11:47:28.985860 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1331/2665] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:28 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:29.037619 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-0b16bcdd-8400-46f2-bf92-97df9dccadc4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:29.045526 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-0b16bcdd-8400-46f2-bf92-97df9dccadc4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.084055 Jul 11 11:47:29.046094 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1335/2666] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:28 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:47:30.002130 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-190ac504-2e85-4ffe-82a6-3d9f29683a2b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:30.002734 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-190ac504-2e85-4ffe-82a6-3d9f29683a2b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:30.009323 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-190ac504-2e85-4ffe-82a6-3d9f29683a2b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:30.009770 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-190ac504-2e85-4ffe-82a6-3d9f29683a2b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:30.010554 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-190ac504-2e85-4ffe-82a6-3d9f29683a2b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:30.010989 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-190ac504-2e85-4ffe-82a6-3d9f29683a2b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:30.062536 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-cae15c6d-2e0e-492a-9959-585eaf9c5e48 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:30.063154 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-cae15c6d-2e0e-492a-9959-585eaf9c5e48 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:30.069890 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cae15c6d-2e0e-492a-9959-585eaf9c5e48 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:30.070347 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cae15c6d-2e0e-492a-9959-585eaf9c5e48 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:30.071116 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cae15c6d-2e0e-492a-9959-585eaf9c5e48 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:30.071581 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cae15c6d-2e0e-492a-9959-585eaf9c5e48 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:30.132613 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-cae15c6d-2e0e-492a-9959-585eaf9c5e48 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:30.140369 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-190ac504-2e85-4ffe-82a6-3d9f29683a2b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:30.140641 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-cae15c6d-2e0e-492a-9959-585eaf9c5e48 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.081977 Jul 11 11:47:30.141415 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1336/2667] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:30 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:47:30.148276 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-190ac504-2e85-4ffe-82a6-3d9f29683a2b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.150011 Jul 11 11:47:30.148827 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1332/2668] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:29 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:47:31.157695 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-c87660fe-2e40-47a2-b900-77fa8d2fee74 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:31.158366 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-c87660fe-2e40-47a2-b900-77fa8d2fee74 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:31.164742 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-7ac0805c-9d02-4cf9-9c81-6c2709ec2b28 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:31.165212 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c87660fe-2e40-47a2-b900-77fa8d2fee74 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:31.165345 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c87660fe-2e40-47a2-b900-77fa8d2fee74 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:31.165457 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-7ac0805c-9d02-4cf9-9c81-6c2709ec2b28 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:31.166017 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c87660fe-2e40-47a2-b900-77fa8d2fee74 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:31.166449 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c87660fe-2e40-47a2-b900-77fa8d2fee74 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:31.172223 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7ac0805c-9d02-4cf9-9c81-6c2709ec2b28 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:31.173059 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7ac0805c-9d02-4cf9-9c81-6c2709ec2b28 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:31.173996 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7ac0805c-9d02-4cf9-9c81-6c2709ec2b28 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:31.174429 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7ac0805c-9d02-4cf9-9c81-6c2709ec2b28 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:31.235082 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-c87660fe-2e40-47a2-b900-77fa8d2fee74 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:31.243791 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-c87660fe-2e40-47a2-b900-77fa8d2fee74 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.089821 Jul 11 11:47:31.244521 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1337/2669] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:31 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:31.312266 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-7ac0805c-9d02-4cf9-9c81-6c2709ec2b28 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:31.320094 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-7ac0805c-9d02-4cf9-9c81-6c2709ec2b28 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.159131 Jul 11 11:47:31.320652 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1333/2670] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:31 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:47:32.261611 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-0289c301-c175-4d22-826e-b194a4e114be tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:32.262306 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-0289c301-c175-4d22-826e-b194a4e114be tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:32.268800 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0289c301-c175-4d22-826e-b194a4e114be tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:32.269251 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0289c301-c175-4d22-826e-b194a4e114be tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:32.270005 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0289c301-c175-4d22-826e-b194a4e114be tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:32.270447 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0289c301-c175-4d22-826e-b194a4e114be tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:32.333488 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-0289c301-c175-4d22-826e-b194a4e114be tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:32.337232 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-fa35bb57-91ac-436a-993a-03eadd1df6b8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:32.337852 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-fa35bb57-91ac-436a-993a-03eadd1df6b8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:32.341890 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-0289c301-c175-4d22-826e-b194a4e114be tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.084111 Jul 11 11:47:32.342459 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1338/2671] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:32 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:32.344476 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fa35bb57-91ac-436a-993a-03eadd1df6b8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:32.344927 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fa35bb57-91ac-436a-993a-03eadd1df6b8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:32.345693 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fa35bb57-91ac-436a-993a-03eadd1df6b8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:32.346130 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fa35bb57-91ac-436a-993a-03eadd1df6b8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:32.471569 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-fa35bb57-91ac-436a-993a-03eadd1df6b8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:32.479994 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-fa35bb57-91ac-436a-993a-03eadd1df6b8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.145846 Jul 11 11:47:32.480560 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1334/2672] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:32 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:47:33.357815 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-c9cc4944-6eb8-4743-9f87-832a55ce25a8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:33.358424 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-c9cc4944-6eb8-4743-9f87-832a55ce25a8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:33.364918 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c9cc4944-6eb8-4743-9f87-832a55ce25a8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:33.365367 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c9cc4944-6eb8-4743-9f87-832a55ce25a8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:33.366121 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c9cc4944-6eb8-4743-9f87-832a55ce25a8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:33.366556 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c9cc4944-6eb8-4743-9f87-832a55ce25a8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:33.428768 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-c9cc4944-6eb8-4743-9f87-832a55ce25a8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:33.436950 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-c9cc4944-6eb8-4743-9f87-832a55ce25a8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.083000 Jul 11 11:47:33.437513 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1339/2673] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:33 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:33.496687 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-14aa995e-b8f6-48d9-9094-02b0d3a1a6ab tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:33.497953 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-14aa995e-b8f6-48d9-9094-02b0d3a1a6ab tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:33.503635 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-14aa995e-b8f6-48d9-9094-02b0d3a1a6ab tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:33.504080 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-14aa995e-b8f6-48d9-9094-02b0d3a1a6ab tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:33.504823 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-14aa995e-b8f6-48d9-9094-02b0d3a1a6ab tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:33.505249 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-14aa995e-b8f6-48d9-9094-02b0d3a1a6ab tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:33.630459 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-14aa995e-b8f6-48d9-9094-02b0d3a1a6ab tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:33.638240 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-14aa995e-b8f6-48d9-9094-02b0d3a1a6ab tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.145978 Jul 11 11:47:33.638799 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1335/2674] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:33 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:34.456306 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-a79fa487-b8eb-4953-b404-b2ba709961c0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:34.457191 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-a79fa487-b8eb-4953-b404-b2ba709961c0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:34.468006 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a79fa487-b8eb-4953-b404-b2ba709961c0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:34.468465 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a79fa487-b8eb-4953-b404-b2ba709961c0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:34.469326 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a79fa487-b8eb-4953-b404-b2ba709961c0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:34.469870 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a79fa487-b8eb-4953-b404-b2ba709961c0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:34.536778 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-a79fa487-b8eb-4953-b404-b2ba709961c0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:34.544701 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-a79fa487-b8eb-4953-b404-b2ba709961c0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.093971 Jul 11 11:47:34.545266 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1340/2675] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:34 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:34.655913 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-0873f66e-4ad3-43d3-b791-1f0096c7a253 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:34.656483 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-0873f66e-4ad3-43d3-b791-1f0096c7a253 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:34.663007 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0873f66e-4ad3-43d3-b791-1f0096c7a253 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:34.663490 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0873f66e-4ad3-43d3-b791-1f0096c7a253 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:34.664264 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0873f66e-4ad3-43d3-b791-1f0096c7a253 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:34.664692 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0873f66e-4ad3-43d3-b791-1f0096c7a253 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:34.795719 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-0873f66e-4ad3-43d3-b791-1f0096c7a253 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:34.803644 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-0873f66e-4ad3-43d3-b791-1f0096c7a253 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.151632 Jul 11 11:47:34.804214 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1336/2676] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:34 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:35.561960 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-280726fe-451f-449d-b1aa-33743fc1d3b5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:35.562555 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-280726fe-451f-449d-b1aa-33743fc1d3b5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:35.569179 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-280726fe-451f-449d-b1aa-33743fc1d3b5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:35.569629 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-280726fe-451f-449d-b1aa-33743fc1d3b5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:35.574230 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-280726fe-451f-449d-b1aa-33743fc1d3b5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:35.574230 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-280726fe-451f-449d-b1aa-33743fc1d3b5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:35.635698 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-280726fe-451f-449d-b1aa-33743fc1d3b5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:35.643664 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-280726fe-451f-449d-b1aa-33743fc1d3b5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.085516 Jul 11 11:47:35.644223 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1341/2677] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:35 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:47:35.821215 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-dd9437a6-e376-4c34-92ce-5ac1ef7ecf97 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:35.821788 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-dd9437a6-e376-4c34-92ce-5ac1ef7ecf97 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:35.828951 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-dd9437a6-e376-4c34-92ce-5ac1ef7ecf97 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:35.829393 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-dd9437a6-e376-4c34-92ce-5ac1ef7ecf97 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:35.830134 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-dd9437a6-e376-4c34-92ce-5ac1ef7ecf97 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:35.830562 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-dd9437a6-e376-4c34-92ce-5ac1ef7ecf97 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:35.957979 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-dd9437a6-e376-4c34-92ce-5ac1ef7ecf97 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:35.966854 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-dd9437a6-e376-4c34-92ce-5ac1ef7ecf97 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.149535 Jul 11 11:47:35.967449 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1337/2678] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:35 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:36.661076 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-7ed1dc96-92ef-4681-b77e-0156cf9708d0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:36.661693 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-7ed1dc96-92ef-4681-b77e-0156cf9708d0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:36.668659 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7ed1dc96-92ef-4681-b77e-0156cf9708d0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:36.669115 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7ed1dc96-92ef-4681-b77e-0156cf9708d0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:36.669870 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7ed1dc96-92ef-4681-b77e-0156cf9708d0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:36.670307 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7ed1dc96-92ef-4681-b77e-0156cf9708d0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:36.733681 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-7ed1dc96-92ef-4681-b77e-0156cf9708d0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:36.741571 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-7ed1dc96-92ef-4681-b77e-0156cf9708d0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.084386 Jul 11 11:47:36.742136 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1342/2679] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:36 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:36.984502 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-28363a40-7928-49c3-a2d3-ebbb3b141529 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:36.985044 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-28363a40-7928-49c3-a2d3-ebbb3b141529 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:36.991429 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-28363a40-7928-49c3-a2d3-ebbb3b141529 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:36.991874 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-28363a40-7928-49c3-a2d3-ebbb3b141529 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:36.992632 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-28363a40-7928-49c3-a2d3-ebbb3b141529 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:36.993042 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-28363a40-7928-49c3-a2d3-ebbb3b141529 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:37.124757 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-28363a40-7928-49c3-a2d3-ebbb3b141529 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:37.132621 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-28363a40-7928-49c3-a2d3-ebbb3b141529 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.152087 Jul 11 11:47:37.133195 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1338/2680] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:36 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:37.758166 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-55b2a157-5ecd-40ab-af67-d70a13a5e233 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:37.758774 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-55b2a157-5ecd-40ab-af67-d70a13a5e233 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:37.765883 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-55b2a157-5ecd-40ab-af67-d70a13a5e233 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:37.766323 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-55b2a157-5ecd-40ab-af67-d70a13a5e233 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:37.767079 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-55b2a157-5ecd-40ab-af67-d70a13a5e233 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:37.767605 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-55b2a157-5ecd-40ab-af67-d70a13a5e233 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:37.829112 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-55b2a157-5ecd-40ab-af67-d70a13a5e233 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:37.837159 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-55b2a157-5ecd-40ab-af67-d70a13a5e233 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.082830 Jul 11 11:47:37.837730 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1343/2681] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:37 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:38.149584 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-9613a8cd-9105-4056-ae2b-2098f674d0ec tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:38.150198 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-9613a8cd-9105-4056-ae2b-2098f674d0ec tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:38.156804 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9613a8cd-9105-4056-ae2b-2098f674d0ec tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:38.157249 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9613a8cd-9105-4056-ae2b-2098f674d0ec tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:38.158003 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9613a8cd-9105-4056-ae2b-2098f674d0ec tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:38.158435 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9613a8cd-9105-4056-ae2b-2098f674d0ec tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:38.290081 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-9613a8cd-9105-4056-ae2b-2098f674d0ec tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:38.298579 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-9613a8cd-9105-4056-ae2b-2098f674d0ec tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.152828 Jul 11 11:47:38.299147 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1339/2682] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:38 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:38.397531 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 11:47:38.397695 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Mon Jul 11 11:47:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 11:47:38.854499 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-372d65ec-fa29-495a-a049-e73f2eac1ab8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:38.855185 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-372d65ec-fa29-495a-a049-e73f2eac1ab8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:38.861600 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-372d65ec-fa29-495a-a049-e73f2eac1ab8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:38.862052 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-372d65ec-fa29-495a-a049-e73f2eac1ab8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:38.862821 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-372d65ec-fa29-495a-a049-e73f2eac1ab8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:38.863270 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-372d65ec-fa29-495a-a049-e73f2eac1ab8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:38.923422 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-372d65ec-fa29-495a-a049-e73f2eac1ab8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:38.931178 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-372d65ec-fa29-495a-a049-e73f2eac1ab8 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.081137 Jul 11 11:47:38.931777 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1344/2683] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:38 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:39.011004 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 11:47:39.011174 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Mon Jul 11 11:47:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 11:47:39.315870 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-9398351f-c6ff-4c42-b251-6412b8741f17 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:39.316484 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-9398351f-c6ff-4c42-b251-6412b8741f17 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:39.323298 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9398351f-c6ff-4c42-b251-6412b8741f17 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:39.323754 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9398351f-c6ff-4c42-b251-6412b8741f17 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:39.324569 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9398351f-c6ff-4c42-b251-6412b8741f17 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:39.325002 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9398351f-c6ff-4c42-b251-6412b8741f17 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:39.453976 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-9398351f-c6ff-4c42-b251-6412b8741f17 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:39.456137 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=100 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:47:39.462330 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-9398351f-c6ff-4c42-b251-6412b8741f17 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.150435 Jul 11 11:47:39.463402 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1340/2684] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:39 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:39.949065 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-fd1a7c8e-159d-487a-9bf0-b8dfc67b7300 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:39.949701 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-fd1a7c8e-159d-487a-9bf0-b8dfc67b7300 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:39.956075 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fd1a7c8e-159d-487a-9bf0-b8dfc67b7300 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:39.956525 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fd1a7c8e-159d-487a-9bf0-b8dfc67b7300 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:39.957267 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fd1a7c8e-159d-487a-9bf0-b8dfc67b7300 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:39.957697 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fd1a7c8e-159d-487a-9bf0-b8dfc67b7300 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:40.017655 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-fd1a7c8e-159d-487a-9bf0-b8dfc67b7300 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:40.025744 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-fd1a7c8e-159d-487a-9bf0-b8dfc67b7300 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.080806 Jul 11 11:47:40.026797 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1345/2685] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:39 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:40.480374 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-d1dfdea8-fbdb-4515-80d6-e98c8052acfb tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:40.480987 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-d1dfdea8-fbdb-4515-80d6-e98c8052acfb tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:40.487793 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d1dfdea8-fbdb-4515-80d6-e98c8052acfb tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:40.488238 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d1dfdea8-fbdb-4515-80d6-e98c8052acfb tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:40.489009 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d1dfdea8-fbdb-4515-80d6-e98c8052acfb tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:40.489444 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d1dfdea8-fbdb-4515-80d6-e98c8052acfb tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:40.614120 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-d1dfdea8-fbdb-4515-80d6-e98c8052acfb tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:40.621982 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-d1dfdea8-fbdb-4515-80d6-e98c8052acfb tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.145936 Jul 11 11:47:40.622536 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1341/2686] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:40 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:41.042685 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-cdc0b2d5-62df-464b-bd5a-bb947d886d08 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:41.043332 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-cdc0b2d5-62df-464b-bd5a-bb947d886d08 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:41.049800 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cdc0b2d5-62df-464b-bd5a-bb947d886d08 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:41.050252 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cdc0b2d5-62df-464b-bd5a-bb947d886d08 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:41.051010 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cdc0b2d5-62df-464b-bd5a-bb947d886d08 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:41.051473 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cdc0b2d5-62df-464b-bd5a-bb947d886d08 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:41.117485 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-cdc0b2d5-62df-464b-bd5a-bb947d886d08 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:41.126140 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-cdc0b2d5-62df-464b-bd5a-bb947d886d08 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.087831 Jul 11 11:47:41.126741 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1346/2687] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:41 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:41.638482 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-cd81a406-78a1-4a2a-a059-c0d75aee2ee5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:41.639091 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-cd81a406-78a1-4a2a-a059-c0d75aee2ee5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:41.646128 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-cd81a406-78a1-4a2a-a059-c0d75aee2ee5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:41.646575 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-cd81a406-78a1-4a2a-a059-c0d75aee2ee5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:41.647366 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-cd81a406-78a1-4a2a-a059-c0d75aee2ee5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:41.647803 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-cd81a406-78a1-4a2a-a059-c0d75aee2ee5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:41.773599 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-cd81a406-78a1-4a2a-a059-c0d75aee2ee5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:41.782026 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-cd81a406-78a1-4a2a-a059-c0d75aee2ee5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.147391 Jul 11 11:47:41.782608 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1342/2688] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:41 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:41.937322 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 11:47:41.937544 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Mon Jul 11 11:47:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 11:47:42.142774 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-13d241ea-e24e-4475-9661-43b3f5330d94 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:42.143449 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-13d241ea-e24e-4475-9661-43b3f5330d94 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:42.150344 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-13d241ea-e24e-4475-9661-43b3f5330d94 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:42.150809 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-13d241ea-e24e-4475-9661-43b3f5330d94 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:42.151707 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-13d241ea-e24e-4475-9661-43b3f5330d94 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:42.152141 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-13d241ea-e24e-4475-9661-43b3f5330d94 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:42.212760 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-13d241ea-e24e-4475-9661-43b3f5330d94 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:42.221269 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-13d241ea-e24e-4475-9661-43b3f5330d94 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.082382 Jul 11 11:47:42.221828 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1347/2689] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:42 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:42.798596 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-83904b0a-d6fd-4fdb-be26-f4bd4898424b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:42.799203 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-83904b0a-d6fd-4fdb-be26-f4bd4898424b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:42.805768 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-83904b0a-d6fd-4fdb-be26-f4bd4898424b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:42.806159 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-83904b0a-d6fd-4fdb-be26-f4bd4898424b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:42.806910 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-83904b0a-d6fd-4fdb-be26-f4bd4898424b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:42.807957 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-83904b0a-d6fd-4fdb-be26-f4bd4898424b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:42.938407 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-83904b0a-d6fd-4fdb-be26-f4bd4898424b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:42.946214 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-83904b0a-d6fd-4fdb-be26-f4bd4898424b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.151498 Jul 11 11:47:42.946779 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1343/2690] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:42 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:43.238941 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-9b6e3d40-c0cb-42b1-8e2e-b4ddb0172f65 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:43.239578 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-9b6e3d40-c0cb-42b1-8e2e-b4ddb0172f65 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:43.246180 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9b6e3d40-c0cb-42b1-8e2e-b4ddb0172f65 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:43.246629 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9b6e3d40-c0cb-42b1-8e2e-b4ddb0172f65 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:43.247410 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9b6e3d40-c0cb-42b1-8e2e-b4ddb0172f65 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:43.247848 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9b6e3d40-c0cb-42b1-8e2e-b4ddb0172f65 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:43.309115 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-9b6e3d40-c0cb-42b1-8e2e-b4ddb0172f65 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:43.317142 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-9b6e3d40-c0cb-42b1-8e2e-b4ddb0172f65 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.082069 Jul 11 11:47:43.317712 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1348/2691] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:43 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:43.963567 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-6c9ba795-c7ea-4a22-b5fb-fa2b15289aad tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:43.964177 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-6c9ba795-c7ea-4a22-b5fb-fa2b15289aad tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:43.970536 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6c9ba795-c7ea-4a22-b5fb-fa2b15289aad tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:43.970981 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6c9ba795-c7ea-4a22-b5fb-fa2b15289aad tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:43.971761 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6c9ba795-c7ea-4a22-b5fb-fa2b15289aad tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:43.972194 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6c9ba795-c7ea-4a22-b5fb-fa2b15289aad tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:44.098336 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-6c9ba795-c7ea-4a22-b5fb-fa2b15289aad tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:44.106760 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-6c9ba795-c7ea-4a22-b5fb-fa2b15289aad tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.146991 Jul 11 11:47:44.107454 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1344/2692] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:43 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:44.334044 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-4570c375-b37c-45a5-aa5f-8439569a7540 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:44.334717 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-4570c375-b37c-45a5-aa5f-8439569a7540 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:44.341644 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4570c375-b37c-45a5-aa5f-8439569a7540 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:44.342093 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4570c375-b37c-45a5-aa5f-8439569a7540 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:44.342848 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4570c375-b37c-45a5-aa5f-8439569a7540 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:44.343302 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4570c375-b37c-45a5-aa5f-8439569a7540 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:44.403272 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-4570c375-b37c-45a5-aa5f-8439569a7540 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:44.410937 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-4570c375-b37c-45a5-aa5f-8439569a7540 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.080763 Jul 11 11:47:44.411537 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1349/2693] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:44 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:45.124518 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-97476769-ae55-455f-bad8-66925a525ae9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:45.125127 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-97476769-ae55-455f-bad8-66925a525ae9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:45.131246 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-97476769-ae55-455f-bad8-66925a525ae9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:45.131720 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-97476769-ae55-455f-bad8-66925a525ae9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:45.132470 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-97476769-ae55-455f-bad8-66925a525ae9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:45.132904 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-97476769-ae55-455f-bad8-66925a525ae9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:45.267730 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-97476769-ae55-455f-bad8-66925a525ae9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:45.275643 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-97476769-ae55-455f-bad8-66925a525ae9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.154964 Jul 11 11:47:45.276211 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1345/2694] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:45 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:45.428243 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-d43faa5d-bd1f-48cc-a001-b8c1a4519240 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:45.428853 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-d43faa5d-bd1f-48cc-a001-b8c1a4519240 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:45.435870 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d43faa5d-bd1f-48cc-a001-b8c1a4519240 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:45.436325 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d43faa5d-bd1f-48cc-a001-b8c1a4519240 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:45.437080 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d43faa5d-bd1f-48cc-a001-b8c1a4519240 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:45.437513 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d43faa5d-bd1f-48cc-a001-b8c1a4519240 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:45.502344 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-d43faa5d-bd1f-48cc-a001-b8c1a4519240 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:45.510475 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-d43faa5d-bd1f-48cc-a001-b8c1a4519240 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.085983 Jul 11 11:47:45.516863 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1350/2695] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:45 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:46.292713 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-30b0c8b0-d89f-49c2-b988-37ff04280b34 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:46.293316 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-30b0c8b0-d89f-49c2-b988-37ff04280b34 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:46.299769 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-30b0c8b0-d89f-49c2-b988-37ff04280b34 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:46.300210 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-30b0c8b0-d89f-49c2-b988-37ff04280b34 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:46.300959 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-30b0c8b0-d89f-49c2-b988-37ff04280b34 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:46.301385 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-30b0c8b0-d89f-49c2-b988-37ff04280b34 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:46.426596 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-30b0c8b0-d89f-49c2-b988-37ff04280b34 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:46.434459 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-30b0c8b0-d89f-49c2-b988-37ff04280b34 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.145607 Jul 11 11:47:46.435022 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1346/2696] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:46 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:46.527726 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-568138c9-03f9-4305-925d-8902eae1246c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:46.528343 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-568138c9-03f9-4305-925d-8902eae1246c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:46.534373 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-568138c9-03f9-4305-925d-8902eae1246c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:46.534822 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-568138c9-03f9-4305-925d-8902eae1246c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:46.535683 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-568138c9-03f9-4305-925d-8902eae1246c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:46.536125 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-568138c9-03f9-4305-925d-8902eae1246c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:46.550387 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=100 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:47:46.596981 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-568138c9-03f9-4305-925d-8902eae1246c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:46.604883 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-568138c9-03f9-4305-925d-8902eae1246c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.081823 Jul 11 11:47:46.605506 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1351/2697] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:46 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:47.452197 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-92f7288e-cd48-4be4-a720-37ed58b20f9e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:47.453471 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-92f7288e-cd48-4be4-a720-37ed58b20f9e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:47.460023 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-92f7288e-cd48-4be4-a720-37ed58b20f9e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:47.460472 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-92f7288e-cd48-4be4-a720-37ed58b20f9e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:47.461225 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-92f7288e-cd48-4be4-a720-37ed58b20f9e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:47.461659 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-92f7288e-cd48-4be4-a720-37ed58b20f9e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:47.586771 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-92f7288e-cd48-4be4-a720-37ed58b20f9e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:47.594620 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-92f7288e-cd48-4be4-a720-37ed58b20f9e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.147038 Jul 11 11:47:47.595180 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1347/2698] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:47 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:47.621281 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-f8a0633e-87b5-49cc-89d7-457bef77a256 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:47.621889 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-f8a0633e-87b5-49cc-89d7-457bef77a256 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:47.628341 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f8a0633e-87b5-49cc-89d7-457bef77a256 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:47.628790 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f8a0633e-87b5-49cc-89d7-457bef77a256 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:47.629544 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f8a0633e-87b5-49cc-89d7-457bef77a256 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:47.629977 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f8a0633e-87b5-49cc-89d7-457bef77a256 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:47.692009 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-f8a0633e-87b5-49cc-89d7-457bef77a256 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:47.700691 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-f8a0633e-87b5-49cc-89d7-457bef77a256 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.083775 Jul 11 11:47:47.701258 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1352/2699] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:47 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:48.611782 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-2c079e47-1d81-4353-8c79-95f470936737 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:48.612305 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-2c079e47-1d81-4353-8c79-95f470936737 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:48.618962 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2c079e47-1d81-4353-8c79-95f470936737 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:48.620067 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2c079e47-1d81-4353-8c79-95f470936737 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:48.620813 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2c079e47-1d81-4353-8c79-95f470936737 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:48.621250 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2c079e47-1d81-4353-8c79-95f470936737 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:48.717852 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-1099692b-597b-40f7-baf4-127753ffc8c5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:48.718561 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-1099692b-597b-40f7-baf4-127753ffc8c5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:48.725154 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1099692b-597b-40f7-baf4-127753ffc8c5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:48.725680 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1099692b-597b-40f7-baf4-127753ffc8c5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:48.726443 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1099692b-597b-40f7-baf4-127753ffc8c5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:48.726875 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1099692b-597b-40f7-baf4-127753ffc8c5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:48.760177 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-2c079e47-1d81-4353-8c79-95f470936737 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:48.768143 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-2c079e47-1d81-4353-8c79-95f470936737 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.160247 Jul 11 11:47:48.768728 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1348/2700] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:48 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:48.787627 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-1099692b-597b-40f7-baf4-127753ffc8c5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:48.795877 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-1099692b-597b-40f7-baf4-127753ffc8c5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.081835 Jul 11 11:47:48.796433 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1353/2701] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:48 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:47:49.785618 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-afebbf82-ca48-41ee-bab9-fce2ef45b1b1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:49.786227 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-afebbf82-ca48-41ee-bab9-fce2ef45b1b1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:49.793383 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-afebbf82-ca48-41ee-bab9-fce2ef45b1b1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:49.793828 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-afebbf82-ca48-41ee-bab9-fce2ef45b1b1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:49.794579 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-afebbf82-ca48-41ee-bab9-fce2ef45b1b1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:49.795010 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-afebbf82-ca48-41ee-bab9-fce2ef45b1b1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:49.812406 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-e846bea9-0dd7-4dd5-97a1-cbdc4d407bb3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:49.812995 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-e846bea9-0dd7-4dd5-97a1-cbdc4d407bb3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:49.819366 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e846bea9-0dd7-4dd5-97a1-cbdc4d407bb3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:49.819812 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e846bea9-0dd7-4dd5-97a1-cbdc4d407bb3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:49.820560 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e846bea9-0dd7-4dd5-97a1-cbdc4d407bb3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:49.820991 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e846bea9-0dd7-4dd5-97a1-cbdc4d407bb3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:49.887157 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-e846bea9-0dd7-4dd5-97a1-cbdc4d407bb3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:49.895117 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-e846bea9-0dd7-4dd5-97a1-cbdc4d407bb3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.086486 Jul 11 11:47:49.895875 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1354/2702] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:49 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:47:49.930957 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-afebbf82-ca48-41ee-bab9-fce2ef45b1b1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:49.938888 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-afebbf82-ca48-41ee-bab9-fce2ef45b1b1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.157116 Jul 11 11:47:49.939483 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1349/2703] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:49 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:50.914411 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-ab2292c2-5abe-4587-8f42-932cf8a6486f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:50.915062 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-ab2292c2-5abe-4587-8f42-932cf8a6486f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:50.922231 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ab2292c2-5abe-4587-8f42-932cf8a6486f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:50.922679 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ab2292c2-5abe-4587-8f42-932cf8a6486f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:50.923469 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ab2292c2-5abe-4587-8f42-932cf8a6486f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:50.923906 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ab2292c2-5abe-4587-8f42-932cf8a6486f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:50.956478 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-3287a9a4-d265-4957-8bdb-2cc9bb915e2f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:50.957123 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-3287a9a4-d265-4957-8bdb-2cc9bb915e2f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:50.963635 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3287a9a4-d265-4957-8bdb-2cc9bb915e2f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:50.964082 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3287a9a4-d265-4957-8bdb-2cc9bb915e2f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:50.964844 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3287a9a4-d265-4957-8bdb-2cc9bb915e2f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:50.965279 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3287a9a4-d265-4957-8bdb-2cc9bb915e2f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:50.984975 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-ab2292c2-5abe-4587-8f42-932cf8a6486f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:50.992928 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-ab2292c2-5abe-4587-8f42-932cf8a6486f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.084003 Jul 11 11:47:50.993499 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1355/2704] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:50 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:51.097587 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-3287a9a4-d265-4957-8bdb-2cc9bb915e2f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:51.106037 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-3287a9a4-d265-4957-8bdb-2cc9bb915e2f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.153316 Jul 11 11:47:51.106612 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1350/2705] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:50 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:47:52.010607 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-9d4e5464-00c3-4277-a2ec-2e84ab294146 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:52.011211 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-9d4e5464-00c3-4277-a2ec-2e84ab294146 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:52.017684 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9d4e5464-00c3-4277-a2ec-2e84ab294146 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:52.018131 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9d4e5464-00c3-4277-a2ec-2e84ab294146 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:52.018884 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9d4e5464-00c3-4277-a2ec-2e84ab294146 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:52.019351 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9d4e5464-00c3-4277-a2ec-2e84ab294146 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:52.079538 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-9d4e5464-00c3-4277-a2ec-2e84ab294146 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:52.087453 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-9d4e5464-00c3-4277-a2ec-2e84ab294146 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.081307 Jul 11 11:47:52.088055 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1356/2706] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:52 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:52.123757 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-ebc768fe-c38d-44ab-8633-93b7d1360b14 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:52.124370 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-ebc768fe-c38d-44ab-8633-93b7d1360b14 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:52.130726 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ebc768fe-c38d-44ab-8633-93b7d1360b14 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:52.131176 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ebc768fe-c38d-44ab-8633-93b7d1360b14 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:52.131988 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ebc768fe-c38d-44ab-8633-93b7d1360b14 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:52.132432 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ebc768fe-c38d-44ab-8633-93b7d1360b14 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:52.257864 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-ebc768fe-c38d-44ab-8633-93b7d1360b14 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:52.265783 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-ebc768fe-c38d-44ab-8633-93b7d1360b14 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.146328 Jul 11 11:47:52.266299 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1351/2707] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:52 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:53.104372 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-c0feff2f-c829-4cf6-8f54-7013954c9451 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:53.105010 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-c0feff2f-c829-4cf6-8f54-7013954c9451 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:53.111514 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c0feff2f-c829-4cf6-8f54-7013954c9451 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:53.111955 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c0feff2f-c829-4cf6-8f54-7013954c9451 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:53.112696 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c0feff2f-c829-4cf6-8f54-7013954c9451 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:53.113122 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c0feff2f-c829-4cf6-8f54-7013954c9451 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:53.172496 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-c0feff2f-c829-4cf6-8f54-7013954c9451 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:53.180135 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-c0feff2f-c829-4cf6-8f54-7013954c9451 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.079667 Jul 11 11:47:53.180696 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1357/2708] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:53 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:53.282326 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-6ae3af9d-e08d-48b7-b97c-c23da7baf08e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:53.282934 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-6ae3af9d-e08d-48b7-b97c-c23da7baf08e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:53.289677 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6ae3af9d-e08d-48b7-b97c-c23da7baf08e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:53.290145 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6ae3af9d-e08d-48b7-b97c-c23da7baf08e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:53.290898 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6ae3af9d-e08d-48b7-b97c-c23da7baf08e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:53.291393 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6ae3af9d-e08d-48b7-b97c-c23da7baf08e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:53.419573 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-6ae3af9d-e08d-48b7-b97c-c23da7baf08e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:53.427324 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-6ae3af9d-e08d-48b7-b97c-c23da7baf08e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.148820 Jul 11 11:47:53.427885 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1352/2709] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:53 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:54.196725 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-22bfbea3-ab09-4e99-ba34-63d932540097 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:54.197363 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-22bfbea3-ab09-4e99-ba34-63d932540097 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:54.204149 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-22bfbea3-ab09-4e99-ba34-63d932540097 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:54.206957 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-22bfbea3-ab09-4e99-ba34-63d932540097 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:54.206957 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-22bfbea3-ab09-4e99-ba34-63d932540097 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:54.206957 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-22bfbea3-ab09-4e99-ba34-63d932540097 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:54.269100 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-22bfbea3-ab09-4e99-ba34-63d932540097 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:54.277452 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-22bfbea3-ab09-4e99-ba34-63d932540097 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.084520 Jul 11 11:47:54.278137 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1358/2710] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:54 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:54.444050 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-a3cf9f9b-5c4c-4fee-8adc-402bdeb2b868 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:54.444657 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-a3cf9f9b-5c4c-4fee-8adc-402bdeb2b868 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:54.446912 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_api:SELECT=52 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:47:54.452386 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a3cf9f9b-5c4c-4fee-8adc-402bdeb2b868 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:54.452829 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a3cf9f9b-5c4c-4fee-8adc-402bdeb2b868 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:54.453625 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a3cf9f9b-5c4c-4fee-8adc-402bdeb2b868 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:54.454049 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a3cf9f9b-5c4c-4fee-8adc-402bdeb2b868 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:54.579989 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-a3cf9f9b-5c4c-4fee-8adc-402bdeb2b868 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:54.587796 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-a3cf9f9b-5c4c-4fee-8adc-402bdeb2b868 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.147597 Jul 11 11:47:54.588355 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1353/2711] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:54 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:55.294624 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-d4054dfd-7ba2-4a98-8a32-a22e6f2289bd tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:55.295237 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-d4054dfd-7ba2-4a98-8a32-a22e6f2289bd tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:55.297564 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_api:SELECT=56 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:47:55.302269 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d4054dfd-7ba2-4a98-8a32-a22e6f2289bd tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:55.302716 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d4054dfd-7ba2-4a98-8a32-a22e6f2289bd tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:55.303502 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d4054dfd-7ba2-4a98-8a32-a22e6f2289bd tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:55.303939 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d4054dfd-7ba2-4a98-8a32-a22e6f2289bd tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:55.367816 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-d4054dfd-7ba2-4a98-8a32-a22e6f2289bd tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:55.376237 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-d4054dfd-7ba2-4a98-8a32-a22e6f2289bd tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.085999 Jul 11 11:47:55.376798 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1359/2712] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:55 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:55.605976 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-e592c9b4-21b4-4014-b809-61b79b1e1335 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:55.606578 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-e592c9b4-21b4-4014-b809-61b79b1e1335 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:55.612973 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e592c9b4-21b4-4014-b809-61b79b1e1335 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:55.613411 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e592c9b4-21b4-4014-b809-61b79b1e1335 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:55.614157 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e592c9b4-21b4-4014-b809-61b79b1e1335 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:55.614584 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e592c9b4-21b4-4014-b809-61b79b1e1335 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:55.738721 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-e592c9b4-21b4-4014-b809-61b79b1e1335 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:55.746634 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-e592c9b4-21b4-4014-b809-61b79b1e1335 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.145119 Jul 11 11:47:55.747203 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1354/2713] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:55 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:56.393119 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-16bf2351-0645-44d0-91ac-baf54d3ea62d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:56.393728 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-16bf2351-0645-44d0-91ac-baf54d3ea62d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:56.400219 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-16bf2351-0645-44d0-91ac-baf54d3ea62d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:56.400673 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-16bf2351-0645-44d0-91ac-baf54d3ea62d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:56.401459 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-16bf2351-0645-44d0-91ac-baf54d3ea62d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:56.401896 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-16bf2351-0645-44d0-91ac-baf54d3ea62d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:56.461902 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-16bf2351-0645-44d0-91ac-baf54d3ea62d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:56.469783 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-16bf2351-0645-44d0-91ac-baf54d3ea62d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.080568 Jul 11 11:47:56.470349 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1360/2714] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:56 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:56.763794 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-cf2bb25d-fd53-44d9-9a91-299b8dc477ba tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:56.764407 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-cf2bb25d-fd53-44d9-9a91-299b8dc477ba tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:56.771000 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-cf2bb25d-fd53-44d9-9a91-299b8dc477ba tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:56.771481 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-cf2bb25d-fd53-44d9-9a91-299b8dc477ba tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:56.772236 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-cf2bb25d-fd53-44d9-9a91-299b8dc477ba tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:56.772668 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-cf2bb25d-fd53-44d9-9a91-299b8dc477ba tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:56.903004 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-cf2bb25d-fd53-44d9-9a91-299b8dc477ba tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:56.911004 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-cf2bb25d-fd53-44d9-9a91-299b8dc477ba tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.151144 Jul 11 11:47:56.911588 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1355/2715] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:56 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:57.486588 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-2384d7ec-7474-412c-b675-8c00b6e2a3bc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:57.487200 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-2384d7ec-7474-412c-b675-8c00b6e2a3bc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:57.493713 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2384d7ec-7474-412c-b675-8c00b6e2a3bc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:57.494167 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2384d7ec-7474-412c-b675-8c00b6e2a3bc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:57.494928 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2384d7ec-7474-412c-b675-8c00b6e2a3bc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:57.495399 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2384d7ec-7474-412c-b675-8c00b6e2a3bc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:57.556233 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-2384d7ec-7474-412c-b675-8c00b6e2a3bc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:57.564553 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-2384d7ec-7474-412c-b675-8c00b6e2a3bc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.081740 Jul 11 11:47:57.565137 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1361/2716] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:57 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:57.929029 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-93a786f3-4bcd-46ea-a70d-078413eda7e3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:57.929633 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-93a786f3-4bcd-46ea-a70d-078413eda7e3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:57.936619 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-93a786f3-4bcd-46ea-a70d-078413eda7e3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:57.937052 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-93a786f3-4bcd-46ea-a70d-078413eda7e3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:57.937801 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-93a786f3-4bcd-46ea-a70d-078413eda7e3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:57.938228 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-93a786f3-4bcd-46ea-a70d-078413eda7e3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:58.063578 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-93a786f3-4bcd-46ea-a70d-078413eda7e3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:58.071433 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-93a786f3-4bcd-46ea-a70d-078413eda7e3 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.146374 Jul 11 11:47:58.072002 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1356/2717] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:57 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:58.582190 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-44a3cb70-5a8b-46a4-9287-883b9a98a04a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:58.582833 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-44a3cb70-5a8b-46a4-9287-883b9a98a04a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:58.589876 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-44a3cb70-5a8b-46a4-9287-883b9a98a04a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:58.590320 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-44a3cb70-5a8b-46a4-9287-883b9a98a04a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:58.591063 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-44a3cb70-5a8b-46a4-9287-883b9a98a04a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:58.591522 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-44a3cb70-5a8b-46a4-9287-883b9a98a04a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:58.653939 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-44a3cb70-5a8b-46a4-9287-883b9a98a04a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:58.661723 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-44a3cb70-5a8b-46a4-9287-883b9a98a04a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.083434 Jul 11 11:47:58.662292 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1362/2718] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:58 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:59.090006 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-0cac70da-d1f2-4d30-b22f-a2aee1450196 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:59.090616 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-0cac70da-d1f2-4d30-b22f-a2aee1450196 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:59.097140 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0cac70da-d1f2-4d30-b22f-a2aee1450196 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:59.097589 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0cac70da-d1f2-4d30-b22f-a2aee1450196 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:59.098341 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0cac70da-d1f2-4d30-b22f-a2aee1450196 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:59.098778 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0cac70da-d1f2-4d30-b22f-a2aee1450196 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:59.115178 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=100 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:47:59.232195 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-0cac70da-d1f2-4d30-b22f-a2aee1450196 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:59.239993 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-0cac70da-d1f2-4d30-b22f-a2aee1450196 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.154472 Jul 11 11:47:59.240564 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1357/2719] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:59 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:47:59.679126 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-23024915-807c-4822-bacd-98acb2b14c69 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:47:59.679763 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-23024915-807c-4822-bacd-98acb2b14c69 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:47:59.686728 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-23024915-807c-4822-bacd-98acb2b14c69 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:59.687175 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-23024915-807c-4822-bacd-98acb2b14c69 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:59.688025 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-23024915-807c-4822-bacd-98acb2b14c69 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:47:59.688459 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-23024915-807c-4822-bacd-98acb2b14c69 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:47:59.749245 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-23024915-807c-4822-bacd-98acb2b14c69 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:47:59.757076 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-23024915-807c-4822-bacd-98acb2b14c69 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.081800 Jul 11 11:47:59.757634 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1363/2720] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:47:59 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:48:00.257075 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-7b4befd8-f8f3-4c7e-aeb9-54589a040e6c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:00.257715 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-7b4befd8-f8f3-4c7e-aeb9-54589a040e6c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:00.264316 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7b4befd8-f8f3-4c7e-aeb9-54589a040e6c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:00.264760 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7b4befd8-f8f3-4c7e-aeb9-54589a040e6c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:00.265510 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7b4befd8-f8f3-4c7e-aeb9-54589a040e6c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:00.265945 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7b4befd8-f8f3-4c7e-aeb9-54589a040e6c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:00.390999 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-7b4befd8-f8f3-4c7e-aeb9-54589a040e6c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:00.398805 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-7b4befd8-f8f3-4c7e-aeb9-54589a040e6c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.145589 Jul 11 11:48:00.399395 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1358/2721] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:00 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:48:00.773722 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-1068c41c-2643-48ae-bb19-abd028bf355d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:00.774323 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-1068c41c-2643-48ae-bb19-abd028bf355d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:00.780853 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1068c41c-2643-48ae-bb19-abd028bf355d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:00.781303 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1068c41c-2643-48ae-bb19-abd028bf355d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:00.782055 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1068c41c-2643-48ae-bb19-abd028bf355d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:00.782491 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1068c41c-2643-48ae-bb19-abd028bf355d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:00.843373 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-1068c41c-2643-48ae-bb19-abd028bf355d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:00.851267 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-1068c41c-2643-48ae-bb19-abd028bf355d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.081405 Jul 11 11:48:00.851848 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1364/2722] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:00 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:48:01.417021 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-afaa4756-4d44-4642-a865-db18763b2420 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:01.417642 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-afaa4756-4d44-4642-a865-db18763b2420 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:01.424173 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-afaa4756-4d44-4642-a865-db18763b2420 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:01.424616 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-afaa4756-4d44-4642-a865-db18763b2420 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:01.425378 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-afaa4756-4d44-4642-a865-db18763b2420 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:01.425811 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-afaa4756-4d44-4642-a865-db18763b2420 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:01.549708 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-afaa4756-4d44-4642-a865-db18763b2420 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:01.557507 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-afaa4756-4d44-4642-a865-db18763b2420 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.144399 Jul 11 11:48:01.558591 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1359/2723] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:01 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:48:01.869267 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-9940e15b-0ff5-4a78-a57a-f5a6b90c044f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:01.869891 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-9940e15b-0ff5-4a78-a57a-f5a6b90c044f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:01.878721 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9940e15b-0ff5-4a78-a57a-f5a6b90c044f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:01.879167 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9940e15b-0ff5-4a78-a57a-f5a6b90c044f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:01.879954 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9940e15b-0ff5-4a78-a57a-f5a6b90c044f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:01.880387 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9940e15b-0ff5-4a78-a57a-f5a6b90c044f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:01.946551 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-9940e15b-0ff5-4a78-a57a-f5a6b90c044f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:01.955169 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-9940e15b-0ff5-4a78-a57a-f5a6b90c044f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.089913 Jul 11 11:48:01.955765 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1365/2724] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:01 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:48:02.575167 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-da789d21-984e-485d-a652-bcbd3f67c403 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:02.575808 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-da789d21-984e-485d-a652-bcbd3f67c403 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:02.582234 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-da789d21-984e-485d-a652-bcbd3f67c403 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:02.582678 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-da789d21-984e-485d-a652-bcbd3f67c403 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:02.583469 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-da789d21-984e-485d-a652-bcbd3f67c403 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:02.583903 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-da789d21-984e-485d-a652-bcbd3f67c403 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:02.712911 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-da789d21-984e-485d-a652-bcbd3f67c403 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:02.721308 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-da789d21-984e-485d-a652-bcbd3f67c403 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.150260 Jul 11 11:48:02.721878 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1360/2725] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:02 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:48:02.972131 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-88e4bb5f-f2d0-40d4-8afc-439dee88cb92 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:02.972738 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-88e4bb5f-f2d0-40d4-8afc-439dee88cb92 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:02.979128 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-88e4bb5f-f2d0-40d4-8afc-439dee88cb92 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:02.979621 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-88e4bb5f-f2d0-40d4-8afc-439dee88cb92 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:02.980452 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-88e4bb5f-f2d0-40d4-8afc-439dee88cb92 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:02.981937 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-88e4bb5f-f2d0-40d4-8afc-439dee88cb92 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:03.047297 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-88e4bb5f-f2d0-40d4-8afc-439dee88cb92 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:03.055513 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-88e4bb5f-f2d0-40d4-8afc-439dee88cb92 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.087059 Jul 11 11:48:03.056082 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1366/2726] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:02 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:48:03.668317 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 11:48:03.668884 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Mon Jul 11 11:48:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 11:48:03.737600 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-4d89751e-c63b-428a-9742-abb4b12418e7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:03.738203 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-4d89751e-c63b-428a-9742-abb4b12418e7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:03.744627 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4d89751e-c63b-428a-9742-abb4b12418e7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:03.745072 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4d89751e-c63b-428a-9742-abb4b12418e7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:03.746361 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4d89751e-c63b-428a-9742-abb4b12418e7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:03.746786 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4d89751e-c63b-428a-9742-abb4b12418e7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:03.870734 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-4d89751e-c63b-428a-9742-abb4b12418e7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:03.878667 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-4d89751e-c63b-428a-9742-abb4b12418e7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.144803 Jul 11 11:48:03.879229 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1361/2727] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:03 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:48:04.073424 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-210f21b6-072d-4b02-8028-6b46ec28c907 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:04.073842 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-210f21b6-072d-4b02-8028-6b46ec28c907 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:04.080074 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-210f21b6-072d-4b02-8028-6b46ec28c907 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:04.080516 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-210f21b6-072d-4b02-8028-6b46ec28c907 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:04.081262 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-210f21b6-072d-4b02-8028-6b46ec28c907 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:04.081693 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-210f21b6-072d-4b02-8028-6b46ec28c907 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:04.142998 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-210f21b6-072d-4b02-8028-6b46ec28c907 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:04.151071 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-210f21b6-072d-4b02-8028-6b46ec28c907 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.082208 Jul 11 11:48:04.160436 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1367/2728] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:04 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:48:04.895993 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-071f9533-3d73-4afd-8f4d-bdd437613d10 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:04.896626 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-071f9533-3d73-4afd-8f4d-bdd437613d10 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:04.903075 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-071f9533-3d73-4afd-8f4d-bdd437613d10 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:04.903554 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-071f9533-3d73-4afd-8f4d-bdd437613d10 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:04.904346 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-071f9533-3d73-4afd-8f4d-bdd437613d10 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:04.904782 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-071f9533-3d73-4afd-8f4d-bdd437613d10 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:05.035330 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-071f9533-3d73-4afd-8f4d-bdd437613d10 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:05.043608 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-071f9533-3d73-4afd-8f4d-bdd437613d10 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.151526 Jul 11 11:48:05.044169 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1362/2729] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:04 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:48:05.176009 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-30ecdd62-17c4-4a8d-bdf5-40217c85ac65 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:05.176657 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-30ecdd62-17c4-4a8d-bdf5-40217c85ac65 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:05.184979 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-30ecdd62-17c4-4a8d-bdf5-40217c85ac65 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:05.185420 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-30ecdd62-17c4-4a8d-bdf5-40217c85ac65 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:05.186174 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-30ecdd62-17c4-4a8d-bdf5-40217c85ac65 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:05.186606 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-30ecdd62-17c4-4a8d-bdf5-40217c85ac65 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:05.189395 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=100 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:48:05.248129 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-30ecdd62-17c4-4a8d-bdf5-40217c85ac65 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:05.255773 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-30ecdd62-17c4-4a8d-bdf5-40217c85ac65 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.083600 Jul 11 11:48:05.256337 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1368/2730] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:05 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:48:06.061062 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-60307fcf-f621-4512-a629-82e9e047d54e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:06.061671 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-60307fcf-f621-4512-a629-82e9e047d54e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:06.068205 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-60307fcf-f621-4512-a629-82e9e047d54e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:06.068658 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-60307fcf-f621-4512-a629-82e9e047d54e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:06.069428 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-60307fcf-f621-4512-a629-82e9e047d54e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:06.069851 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-60307fcf-f621-4512-a629-82e9e047d54e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:06.196631 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-60307fcf-f621-4512-a629-82e9e047d54e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:06.205401 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-60307fcf-f621-4512-a629-82e9e047d54e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.148661 Jul 11 11:48:06.205966 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1363/2731] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:06 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:48:06.272596 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-917496b3-e58c-4ea4-b020-d0c575494cba tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:06.273169 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-917496b3-e58c-4ea4-b020-d0c575494cba tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:06.279891 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-917496b3-e58c-4ea4-b020-d0c575494cba tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:06.280350 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-917496b3-e58c-4ea4-b020-d0c575494cba tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:06.281116 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-917496b3-e58c-4ea4-b020-d0c575494cba tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:06.281558 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-917496b3-e58c-4ea4-b020-d0c575494cba tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:06.343110 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-917496b3-e58c-4ea4-b020-d0c575494cba tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:06.351161 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-917496b3-e58c-4ea4-b020-d0c575494cba tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.082473 Jul 11 11:48:06.351778 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1369/2732] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:06 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:48:07.222989 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-9073236b-197a-49b7-acfb-710116040fd0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:07.223634 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-9073236b-197a-49b7-acfb-710116040fd0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:07.230077 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9073236b-197a-49b7-acfb-710116040fd0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:07.230526 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9073236b-197a-49b7-acfb-710116040fd0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:07.231310 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9073236b-197a-49b7-acfb-710116040fd0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:07.231750 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9073236b-197a-49b7-acfb-710116040fd0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:07.361054 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-9073236b-197a-49b7-acfb-710116040fd0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:07.368480 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-e543fad1-0a16-416b-86c1-d956b9df64cf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:07.368996 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-9073236b-197a-49b7-acfb-710116040fd0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.149973 Jul 11 11:48:07.369240 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-e543fad1-0a16-416b-86c1-d956b9df64cf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:07.369517 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1364/2733] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:07 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:48:07.375880 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e543fad1-0a16-416b-86c1-d956b9df64cf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:07.376333 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e543fad1-0a16-416b-86c1-d956b9df64cf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:07.377089 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e543fad1-0a16-416b-86c1-d956b9df64cf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:07.377525 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e543fad1-0a16-416b-86c1-d956b9df64cf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:07.440281 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-e543fad1-0a16-416b-86c1-d956b9df64cf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:07.448402 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-e543fad1-0a16-416b-86c1-d956b9df64cf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.083855 Jul 11 11:48:07.448971 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1370/2734] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:07 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:48:08.385577 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-11c761d2-beb4-43bb-ac21-116a44f4ef50 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:08.386180 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-11c761d2-beb4-43bb-ac21-116a44f4ef50 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:08.392813 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-11c761d2-beb4-43bb-ac21-116a44f4ef50 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:08.393250 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-11c761d2-beb4-43bb-ac21-116a44f4ef50 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:08.393995 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-11c761d2-beb4-43bb-ac21-116a44f4ef50 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:08.394423 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-11c761d2-beb4-43bb-ac21-116a44f4ef50 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:08.465783 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-cd199098-3be3-4616-8997-aac9d29156ba tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:08.466380 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-cd199098-3be3-4616-8997-aac9d29156ba tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:08.473107 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cd199098-3be3-4616-8997-aac9d29156ba tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:08.473566 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cd199098-3be3-4616-8997-aac9d29156ba tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:08.474338 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cd199098-3be3-4616-8997-aac9d29156ba tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:08.474805 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cd199098-3be3-4616-8997-aac9d29156ba tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:08.521416 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-11c761d2-beb4-43bb-ac21-116a44f4ef50 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:08.530393 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-11c761d2-beb4-43bb-ac21-116a44f4ef50 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.148563 Jul 11 11:48:08.530974 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1365/2735] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:08 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:48:08.539565 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-cd199098-3be3-4616-8997-aac9d29156ba tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:08.548296 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-cd199098-3be3-4616-8997-aac9d29156ba tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.086820 Jul 11 11:48:08.548870 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1371/2736] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:08 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:48:09.548623 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-ad4e1fa1-3646-4b2f-884b-578a1a9facaf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:09.549258 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-ad4e1fa1-3646-4b2f-884b-578a1a9facaf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:09.555690 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ad4e1fa1-3646-4b2f-884b-578a1a9facaf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:09.556129 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ad4e1fa1-3646-4b2f-884b-578a1a9facaf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:09.556873 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ad4e1fa1-3646-4b2f-884b-578a1a9facaf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:09.557300 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ad4e1fa1-3646-4b2f-884b-578a1a9facaf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:09.565063 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-9557b13e-f1a2-40a1-ad1f-a594329165c5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:09.565754 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-9557b13e-f1a2-40a1-ad1f-a594329165c5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:09.573039 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9557b13e-f1a2-40a1-ad1f-a594329165c5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:09.573582 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9557b13e-f1a2-40a1-ad1f-a594329165c5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:09.574237 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9557b13e-f1a2-40a1-ad1f-a594329165c5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:09.574669 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9557b13e-f1a2-40a1-ad1f-a594329165c5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:09.639361 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-9557b13e-f1a2-40a1-ad1f-a594329165c5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:09.647424 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-9557b13e-f1a2-40a1-ad1f-a594329165c5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.086103 Jul 11 11:48:09.648002 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1372/2737] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:09 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:48:09.689404 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-ad4e1fa1-3646-4b2f-884b-578a1a9facaf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:09.697473 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-ad4e1fa1-3646-4b2f-884b-578a1a9facaf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.153113 Jul 11 11:48:09.698296 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1366/2738] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:09 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:48:10.664455 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-be2e6c52-cbdf-48bc-a646-57b820f0d0a9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:10.665061 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-be2e6c52-cbdf-48bc-a646-57b820f0d0a9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:10.672122 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-be2e6c52-cbdf-48bc-a646-57b820f0d0a9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:10.672566 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-be2e6c52-cbdf-48bc-a646-57b820f0d0a9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:10.673312 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-be2e6c52-cbdf-48bc-a646-57b820f0d0a9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:10.673742 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-be2e6c52-cbdf-48bc-a646-57b820f0d0a9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:10.714819 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-116e870d-4182-4e90-ac6d-ca21dbf34f72 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:10.715981 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-116e870d-4182-4e90-ac6d-ca21dbf34f72 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:10.722746 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-116e870d-4182-4e90-ac6d-ca21dbf34f72 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:10.723198 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-116e870d-4182-4e90-ac6d-ca21dbf34f72 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:10.724002 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-116e870d-4182-4e90-ac6d-ca21dbf34f72 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:10.724433 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-116e870d-4182-4e90-ac6d-ca21dbf34f72 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:10.735163 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-be2e6c52-cbdf-48bc-a646-57b820f0d0a9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:10.743028 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-be2e6c52-cbdf-48bc-a646-57b820f0d0a9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.082420 Jul 11 11:48:10.743616 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1373/2739] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:10 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:48:10.852708 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-116e870d-4182-4e90-ac6d-ca21dbf34f72 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:10.861221 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-116e870d-4182-4e90-ac6d-ca21dbf34f72 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.150143 Jul 11 11:48:10.861784 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1367/2740] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:10 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:48:11.759872 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-0ddf3146-4dab-490a-812c-b466d08049e5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:11.760529 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-0ddf3146-4dab-490a-812c-b466d08049e5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:11.766953 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0ddf3146-4dab-490a-812c-b466d08049e5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:11.767435 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0ddf3146-4dab-490a-812c-b466d08049e5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:11.768182 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0ddf3146-4dab-490a-812c-b466d08049e5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:11.768613 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0ddf3146-4dab-490a-812c-b466d08049e5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:11.831648 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-0ddf3146-4dab-490a-812c-b466d08049e5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:11.839427 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-0ddf3146-4dab-490a-812c-b466d08049e5 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.083386 Jul 11 11:48:11.839987 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1374/2741] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:11 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:48:11.878572 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-4d00edd2-5970-4fa4-b64d-c124cc967717 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:11.879181 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-4d00edd2-5970-4fa4-b64d-c124cc967717 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:11.885617 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4d00edd2-5970-4fa4-b64d-c124cc967717 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:11.886065 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4d00edd2-5970-4fa4-b64d-c124cc967717 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:11.886815 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4d00edd2-5970-4fa4-b64d-c124cc967717 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:11.887789 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4d00edd2-5970-4fa4-b64d-c124cc967717 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:12.013596 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-4d00edd2-5970-4fa4-b64d-c124cc967717 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:12.021621 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-4d00edd2-5970-4fa4-b64d-c124cc967717 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.146979 Jul 11 11:48:12.022189 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1368/2742] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:11 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:48:12.859522 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-d33950fa-f801-443f-8cf2-f2b7349dbcdf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:12.860147 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-d33950fa-f801-443f-8cf2-f2b7349dbcdf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:12.866668 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d33950fa-f801-443f-8cf2-f2b7349dbcdf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:12.867122 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d33950fa-f801-443f-8cf2-f2b7349dbcdf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:12.867912 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d33950fa-f801-443f-8cf2-f2b7349dbcdf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:12.868347 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d33950fa-f801-443f-8cf2-f2b7349dbcdf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:12.931793 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-d33950fa-f801-443f-8cf2-f2b7349dbcdf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:12.939809 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-d33950fa-f801-443f-8cf2-f2b7349dbcdf tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.087258 Jul 11 11:48:12.940374 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1375/2743] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:12 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:48:13.041336 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-200740d0-0568-4e3e-a79d-5dd1ca98b9be tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:13.041942 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-200740d0-0568-4e3e-a79d-5dd1ca98b9be tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:13.049003 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-200740d0-0568-4e3e-a79d-5dd1ca98b9be tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:13.049451 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-200740d0-0568-4e3e-a79d-5dd1ca98b9be tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:13.050215 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-200740d0-0568-4e3e-a79d-5dd1ca98b9be tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:13.050645 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-200740d0-0568-4e3e-a79d-5dd1ca98b9be tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:13.193979 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-200740d0-0568-4e3e-a79d-5dd1ca98b9be tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:13.208687 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-200740d0-0568-4e3e-a79d-5dd1ca98b9be tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.171174 Jul 11 11:48:13.210988 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1369/2744] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:13 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:48:13.957731 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-72875ee7-8dca-4dcc-b01e-0d73a64451e4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:13.958342 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-72875ee7-8dca-4dcc-b01e-0d73a64451e4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:13.964884 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-72875ee7-8dca-4dcc-b01e-0d73a64451e4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:13.965334 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-72875ee7-8dca-4dcc-b01e-0d73a64451e4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:13.966094 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-72875ee7-8dca-4dcc-b01e-0d73a64451e4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:13.966538 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-72875ee7-8dca-4dcc-b01e-0d73a64451e4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:14.026541 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-72875ee7-8dca-4dcc-b01e-0d73a64451e4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:14.034611 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-72875ee7-8dca-4dcc-b01e-0d73a64451e4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.080738 Jul 11 11:48:14.035176 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1376/2745] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:13 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:48:14.228533 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-1133b385-ebe0-453e-beed-e2fe77d446e1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:14.229079 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-1133b385-ebe0-453e-beed-e2fe77d446e1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:14.235987 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1133b385-ebe0-453e-beed-e2fe77d446e1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:14.236460 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1133b385-ebe0-453e-beed-e2fe77d446e1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:14.237283 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1133b385-ebe0-453e-beed-e2fe77d446e1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:14.237643 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1133b385-ebe0-453e-beed-e2fe77d446e1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:14.364641 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-1133b385-ebe0-453e-beed-e2fe77d446e1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:14.372583 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-1133b385-ebe0-453e-beed-e2fe77d446e1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.147952 Jul 11 11:48:14.373206 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1370/2746] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:14 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:48:15.052048 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-5ace30cc-ed91-46a6-abd1-e9c22f105f54 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:15.052659 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-5ace30cc-ed91-46a6-abd1-e9c22f105f54 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:15.059353 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5ace30cc-ed91-46a6-abd1-e9c22f105f54 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:15.059796 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5ace30cc-ed91-46a6-abd1-e9c22f105f54 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:15.060556 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5ace30cc-ed91-46a6-abd1-e9c22f105f54 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:15.060974 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5ace30cc-ed91-46a6-abd1-e9c22f105f54 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:15.122629 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-5ace30cc-ed91-46a6-abd1-e9c22f105f54 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:15.130332 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-5ace30cc-ed91-46a6-abd1-e9c22f105f54 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.082215 Jul 11 11:48:15.130894 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1377/2747] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:15 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:48:15.390691 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-15d6bafd-a284-4e20-9219-d0b77470cddf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:15.391273 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-15d6bafd-a284-4e20-9219-d0b77470cddf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:15.397243 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-15d6bafd-a284-4e20-9219-d0b77470cddf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:15.397724 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-15d6bafd-a284-4e20-9219-d0b77470cddf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:15.398483 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-15d6bafd-a284-4e20-9219-d0b77470cddf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:15.398921 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-15d6bafd-a284-4e20-9219-d0b77470cddf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:15.535570 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-15d6bafd-a284-4e20-9219-d0b77470cddf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:15.544019 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-15d6bafd-a284-4e20-9219-d0b77470cddf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.157529 Jul 11 11:48:15.544595 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1371/2748] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:15 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:48:16.147388 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-5626b46b-7eb6-4429-b886-7c6dff5d0c4c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:16.147995 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-5626b46b-7eb6-4429-b886-7c6dff5d0c4c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:16.154699 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5626b46b-7eb6-4429-b886-7c6dff5d0c4c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:16.155142 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5626b46b-7eb6-4429-b886-7c6dff5d0c4c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:16.155924 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5626b46b-7eb6-4429-b886-7c6dff5d0c4c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:16.156353 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5626b46b-7eb6-4429-b886-7c6dff5d0c4c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:16.221298 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-5626b46b-7eb6-4429-b886-7c6dff5d0c4c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:16.229125 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-5626b46b-7eb6-4429-b886-7c6dff5d0c4c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.085789 Jul 11 11:48:16.229684 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1378/2749] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:16 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:48:16.560479 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-93e69fce-00c9-4c13-a791-913f5490aed9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:16.561090 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-93e69fce-00c9-4c13-a791-913f5490aed9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:16.567527 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-93e69fce-00c9-4c13-a791-913f5490aed9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:16.567971 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-93e69fce-00c9-4c13-a791-913f5490aed9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:16.568721 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-93e69fce-00c9-4c13-a791-913f5490aed9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:16.569154 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-93e69fce-00c9-4c13-a791-913f5490aed9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:16.695988 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-93e69fce-00c9-4c13-a791-913f5490aed9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:16.704156 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-93e69fce-00c9-4c13-a791-913f5490aed9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.147516 Jul 11 11:48:16.704719 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1372/2750] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:16 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:48:17.246137 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-06cfc082-94c3-4730-a485-cac37a823766 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:17.247410 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-06cfc082-94c3-4730-a485-cac37a823766 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:17.253820 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-06cfc082-94c3-4730-a485-cac37a823766 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:17.254267 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-06cfc082-94c3-4730-a485-cac37a823766 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:17.255021 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-06cfc082-94c3-4730-a485-cac37a823766 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:17.255492 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-06cfc082-94c3-4730-a485-cac37a823766 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:17.316385 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-06cfc082-94c3-4730-a485-cac37a823766 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:17.324619 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-06cfc082-94c3-4730-a485-cac37a823766 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.082269 Jul 11 11:48:17.325124 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1379/2751] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:17 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:48:17.721850 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-b8979d6a-f053-4c2b-8b34-9d7e483b7828 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:17.722457 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-b8979d6a-f053-4c2b-8b34-9d7e483b7828 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:17.728991 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b8979d6a-f053-4c2b-8b34-9d7e483b7828 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:17.729432 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b8979d6a-f053-4c2b-8b34-9d7e483b7828 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:17.730182 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b8979d6a-f053-4c2b-8b34-9d7e483b7828 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:17.730620 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b8979d6a-f053-4c2b-8b34-9d7e483b7828 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:17.861233 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-b8979d6a-f053-4c2b-8b34-9d7e483b7828 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:17.869580 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-b8979d6a-f053-4c2b-8b34-9d7e483b7828 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.151579 Jul 11 11:48:17.870184 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1373/2752] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:17 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:48:18.341830 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-d6d6b50d-7503-40d5-a09e-9cf0fdda33c4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:18.342359 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-d6d6b50d-7503-40d5-a09e-9cf0fdda33c4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:18.348965 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d6d6b50d-7503-40d5-a09e-9cf0fdda33c4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:18.349415 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d6d6b50d-7503-40d5-a09e-9cf0fdda33c4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:18.350172 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d6d6b50d-7503-40d5-a09e-9cf0fdda33c4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:18.350612 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d6d6b50d-7503-40d5-a09e-9cf0fdda33c4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:18.412061 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-d6d6b50d-7503-40d5-a09e-9cf0fdda33c4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:18.420554 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-d6d6b50d-7503-40d5-a09e-9cf0fdda33c4 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.082822 Jul 11 11:48:18.421115 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1380/2753] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:18 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:48:18.886791 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-97dbe86c-f9ad-4636-8b53-e23484d38ee4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:18.887623 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-97dbe86c-f9ad-4636-8b53-e23484d38ee4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:18.894293 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-97dbe86c-f9ad-4636-8b53-e23484d38ee4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:18.894730 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-97dbe86c-f9ad-4636-8b53-e23484d38ee4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:18.895511 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-97dbe86c-f9ad-4636-8b53-e23484d38ee4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:18.895941 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-97dbe86c-f9ad-4636-8b53-e23484d38ee4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:18.898454 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=100 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:48:19.024684 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-97dbe86c-f9ad-4636-8b53-e23484d38ee4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:19.033224 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-97dbe86c-f9ad-4636-8b53-e23484d38ee4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.150265 Jul 11 11:48:19.033792 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1374/2754] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:18 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:48:19.437397 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-3271b2c8-13db-4960-8865-83fa857b7c1a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:19.437986 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-3271b2c8-13db-4960-8865-83fa857b7c1a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:19.444496 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3271b2c8-13db-4960-8865-83fa857b7c1a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:19.444946 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3271b2c8-13db-4960-8865-83fa857b7c1a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:19.445699 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3271b2c8-13db-4960-8865-83fa857b7c1a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:19.446136 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3271b2c8-13db-4960-8865-83fa857b7c1a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:19.506413 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-3271b2c8-13db-4960-8865-83fa857b7c1a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:19.514736 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-3271b2c8-13db-4960-8865-83fa857b7c1a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.081242 Jul 11 11:48:19.515313 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1381/2755] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:19 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:48:20.050455 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-35ad8886-c9d3-452f-9980-3f63c68c138b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:20.051067 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-35ad8886-c9d3-452f-9980-3f63c68c138b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:20.057781 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-35ad8886-c9d3-452f-9980-3f63c68c138b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:20.058225 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-35ad8886-c9d3-452f-9980-3f63c68c138b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:20.059649 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-35ad8886-c9d3-452f-9980-3f63c68c138b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:20.060084 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-35ad8886-c9d3-452f-9980-3f63c68c138b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:20.188245 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-35ad8886-c9d3-452f-9980-3f63c68c138b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:20.196655 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-35ad8886-c9d3-452f-9980-3f63c68c138b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.150170 Jul 11 11:48:20.197219 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1375/2756] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:20 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:48:20.532108 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-408b4588-f401-46da-8a22-03edc3a3c084 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:20.532709 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-408b4588-f401-46da-8a22-03edc3a3c084 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:20.539171 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-408b4588-f401-46da-8a22-03edc3a3c084 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:20.539648 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-408b4588-f401-46da-8a22-03edc3a3c084 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:20.540404 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-408b4588-f401-46da-8a22-03edc3a3c084 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:20.540837 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-408b4588-f401-46da-8a22-03edc3a3c084 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:20.604285 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-408b4588-f401-46da-8a22-03edc3a3c084 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:20.612726 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-408b4588-f401-46da-8a22-03edc3a3c084 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.085067 Jul 11 11:48:20.613289 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1382/2757] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:20 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:48:21.213914 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-0d06dda3-f4c1-47fa-a7ec-7a3fa35c3a9b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:21.214516 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-0d06dda3-f4c1-47fa-a7ec-7a3fa35c3a9b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:21.221050 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0d06dda3-f4c1-47fa-a7ec-7a3fa35c3a9b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:21.221492 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0d06dda3-f4c1-47fa-a7ec-7a3fa35c3a9b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:21.222241 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0d06dda3-f4c1-47fa-a7ec-7a3fa35c3a9b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:21.222666 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0d06dda3-f4c1-47fa-a7ec-7a3fa35c3a9b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:21.352176 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-0d06dda3-f4c1-47fa-a7ec-7a3fa35c3a9b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:21.360015 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-0d06dda3-f4c1-47fa-a7ec-7a3fa35c3a9b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.149872 Jul 11 11:48:21.367384 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1376/2758] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:21 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:48:21.629535 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-810b39d1-4e03-48ef-a684-062bca3720cc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:21.630086 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-810b39d1-4e03-48ef-a684-062bca3720cc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:21.636484 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-810b39d1-4e03-48ef-a684-062bca3720cc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:21.636932 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-810b39d1-4e03-48ef-a684-062bca3720cc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:21.637679 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-810b39d1-4e03-48ef-a684-062bca3720cc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:21.638112 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-810b39d1-4e03-48ef-a684-062bca3720cc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:21.698012 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-810b39d1-4e03-48ef-a684-062bca3720cc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:21.705871 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-810b39d1-4e03-48ef-a684-062bca3720cc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.080230 Jul 11 11:48:21.706427 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1383/2759] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:21 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:48:22.377235 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-1c86c609-e222-4467-8cfa-9e76b547f77a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:22.377842 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-1c86c609-e222-4467-8cfa-9e76b547f77a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:22.384291 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1c86c609-e222-4467-8cfa-9e76b547f77a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:22.384731 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1c86c609-e222-4467-8cfa-9e76b547f77a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:22.385475 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1c86c609-e222-4467-8cfa-9e76b547f77a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:22.385898 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1c86c609-e222-4467-8cfa-9e76b547f77a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:22.510468 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-1c86c609-e222-4467-8cfa-9e76b547f77a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:22.518784 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-1c86c609-e222-4467-8cfa-9e76b547f77a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.145427 Jul 11 11:48:22.519365 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1377/2760] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:22 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:48:22.721696 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-1972fef4-8afc-430d-877c-78d57a30067a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:22.722307 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-1972fef4-8afc-430d-877c-78d57a30067a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:22.728865 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1972fef4-8afc-430d-877c-78d57a30067a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:22.729315 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1972fef4-8afc-430d-877c-78d57a30067a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:22.730066 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1972fef4-8afc-430d-877c-78d57a30067a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:22.730579 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1972fef4-8afc-430d-877c-78d57a30067a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:22.793528 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-1972fef4-8afc-430d-877c-78d57a30067a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:22.795726 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=100 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:48:22.801927 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-1972fef4-8afc-430d-877c-78d57a30067a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.084019 Jul 11 11:48:22.802503 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1384/2761] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:22 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:48:23.536737 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-14743c31-e13f-4544-832c-78877eab0f41 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:23.537354 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-14743c31-e13f-4544-832c-78877eab0f41 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:23.544609 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-14743c31-e13f-4544-832c-78877eab0f41 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:23.547469 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-14743c31-e13f-4544-832c-78877eab0f41 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:23.547469 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-14743c31-e13f-4544-832c-78877eab0f41 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:23.547469 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-14743c31-e13f-4544-832c-78877eab0f41 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:23.671434 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-14743c31-e13f-4544-832c-78877eab0f41 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:23.679302 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-14743c31-e13f-4544-832c-78877eab0f41 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.146662 Jul 11 11:48:23.679875 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1378/2762] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:23 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:48:23.820167 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-d0174c89-34ed-40c0-b387-2c4ea392c0ad tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:23.820744 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-d0174c89-34ed-40c0-b387-2c4ea392c0ad tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:23.827919 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d0174c89-34ed-40c0-b387-2c4ea392c0ad tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:23.828368 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d0174c89-34ed-40c0-b387-2c4ea392c0ad tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:23.829117 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d0174c89-34ed-40c0-b387-2c4ea392c0ad tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:23.829553 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d0174c89-34ed-40c0-b387-2c4ea392c0ad tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:23.889266 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-d0174c89-34ed-40c0-b387-2c4ea392c0ad tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:23.897083 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-d0174c89-34ed-40c0-b387-2c4ea392c0ad tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.081249 Jul 11 11:48:23.897638 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1385/2763] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:23 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:48:24.695632 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-2151db7d-c6bd-493e-a0e0-268fac348004 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:24.696248 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-2151db7d-c6bd-493e-a0e0-268fac348004 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:24.698840 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_api:SELECT=52 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:48:24.703618 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2151db7d-c6bd-493e-a0e0-268fac348004 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:24.704070 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2151db7d-c6bd-493e-a0e0-268fac348004 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:24.704824 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2151db7d-c6bd-493e-a0e0-268fac348004 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:24.705261 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2151db7d-c6bd-493e-a0e0-268fac348004 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:24.836578 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-2151db7d-c6bd-493e-a0e0-268fac348004 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:24.844999 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-2151db7d-c6bd-493e-a0e0-268fac348004 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.153333 Jul 11 11:48:24.845569 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1379/2764] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:24 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:48:24.913708 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-b111de26-1efe-43a8-b9ac-505a62af261b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:24.914323 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-b111de26-1efe-43a8-b9ac-505a62af261b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:24.921397 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b111de26-1efe-43a8-b9ac-505a62af261b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:24.921850 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b111de26-1efe-43a8-b9ac-505a62af261b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:24.922600 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b111de26-1efe-43a8-b9ac-505a62af261b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:24.923042 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b111de26-1efe-43a8-b9ac-505a62af261b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:24.985923 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-b111de26-1efe-43a8-b9ac-505a62af261b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:24.993741 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-b111de26-1efe-43a8-b9ac-505a62af261b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.083849 Jul 11 11:48:24.994302 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1386/2765] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:24 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:48:25.861950 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-643a737a-015e-4bfa-b68e-ad113fffde0b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:25.862516 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-643a737a-015e-4bfa-b68e-ad113fffde0b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:25.869066 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-643a737a-015e-4bfa-b68e-ad113fffde0b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:25.869507 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-643a737a-015e-4bfa-b68e-ad113fffde0b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:25.870251 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-643a737a-015e-4bfa-b68e-ad113fffde0b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:25.870675 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-643a737a-015e-4bfa-b68e-ad113fffde0b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:25.994415 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-643a737a-015e-4bfa-b68e-ad113fffde0b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:26.002862 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-643a737a-015e-4bfa-b68e-ad113fffde0b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.144830 Jul 11 11:48:26.003449 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1380/2766] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:25 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:48:26.010970 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-7268146f-61e7-41d3-a638-71706e42dd45 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:26.011659 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-7268146f-61e7-41d3-a638-71706e42dd45 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:26.013906 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_api:SELECT=56 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:48:26.018531 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7268146f-61e7-41d3-a638-71706e42dd45 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:26.023963 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7268146f-61e7-41d3-a638-71706e42dd45 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:26.023963 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7268146f-61e7-41d3-a638-71706e42dd45 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:26.023963 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7268146f-61e7-41d3-a638-71706e42dd45 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:26.081652 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-7268146f-61e7-41d3-a638-71706e42dd45 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:26.089504 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-7268146f-61e7-41d3-a638-71706e42dd45 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.082309 Jul 11 11:48:26.090154 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1387/2767] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:26 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:48:27.019585 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-36d53d8a-5b4b-42c8-9924-d1f7c405354d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:27.020196 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-36d53d8a-5b4b-42c8-9924-d1f7c405354d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:27.026561 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-36d53d8a-5b4b-42c8-9924-d1f7c405354d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:27.027007 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-36d53d8a-5b4b-42c8-9924-d1f7c405354d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:27.028415 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-36d53d8a-5b4b-42c8-9924-d1f7c405354d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:27.028809 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-36d53d8a-5b4b-42c8-9924-d1f7c405354d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:27.106332 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-1fd6b337-89b8-42f2-a96b-90573b0a8465 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:27.106973 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-1fd6b337-89b8-42f2-a96b-90573b0a8465 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:27.113620 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1fd6b337-89b8-42f2-a96b-90573b0a8465 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:27.114070 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1fd6b337-89b8-42f2-a96b-90573b0a8465 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:27.114825 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1fd6b337-89b8-42f2-a96b-90573b0a8465 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:27.115346 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1fd6b337-89b8-42f2-a96b-90573b0a8465 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:27.161244 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-36d53d8a-5b4b-42c8-9924-d1f7c405354d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:27.166428 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-36d53d8a-5b4b-42c8-9924-d1f7c405354d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.150686 Jul 11 11:48:27.166990 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1381/2768] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:27 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:48:27.176306 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-1fd6b337-89b8-42f2-a96b-90573b0a8465 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:27.184342 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-1fd6b337-89b8-42f2-a96b-90573b0a8465 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.082453 Jul 11 11:48:27.184946 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1388/2769] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:27 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:48:28.183236 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-74b34528-b385-45b9-aedd-f07a1f505751 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:28.183872 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-74b34528-b385-45b9-aedd-f07a1f505751 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:28.190889 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-74b34528-b385-45b9-aedd-f07a1f505751 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:28.191380 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-74b34528-b385-45b9-aedd-f07a1f505751 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:28.192146 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-74b34528-b385-45b9-aedd-f07a1f505751 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:28.192574 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-74b34528-b385-45b9-aedd-f07a1f505751 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:28.202717 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-7e31639b-fb64-43df-bda6-c9e8d7f7193c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:28.203333 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-7e31639b-fb64-43df-bda6-c9e8d7f7193c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:28.209790 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7e31639b-fb64-43df-bda6-c9e8d7f7193c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:28.210241 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7e31639b-fb64-43df-bda6-c9e8d7f7193c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:28.210999 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7e31639b-fb64-43df-bda6-c9e8d7f7193c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:28.211471 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7e31639b-fb64-43df-bda6-c9e8d7f7193c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:28.279194 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-7e31639b-fb64-43df-bda6-c9e8d7f7193c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:28.287269 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-7e31639b-fb64-43df-bda6-c9e8d7f7193c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.088835 Jul 11 11:48:28.290099 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1389/2770] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:28 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:48:28.332248 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-74b34528-b385-45b9-aedd-f07a1f505751 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:28.340759 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-74b34528-b385-45b9-aedd-f07a1f505751 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.161340 Jul 11 11:48:28.341542 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1382/2771] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:28 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:48:29.304358 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-691d0d42-5cc7-48bc-89ed-43249e469165 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:29.304973 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-691d0d42-5cc7-48bc-89ed-43249e469165 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:29.311980 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-691d0d42-5cc7-48bc-89ed-43249e469165 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:29.312433 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-691d0d42-5cc7-48bc-89ed-43249e469165 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:29.313189 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-691d0d42-5cc7-48bc-89ed-43249e469165 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:29.313625 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-691d0d42-5cc7-48bc-89ed-43249e469165 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:29.357895 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-11259de6-a786-40a3-a5ac-18a42679443b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:29.358440 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-11259de6-a786-40a3-a5ac-18a42679443b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:29.364828 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-11259de6-a786-40a3-a5ac-18a42679443b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:29.365270 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-11259de6-a786-40a3-a5ac-18a42679443b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:29.366024 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-11259de6-a786-40a3-a5ac-18a42679443b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:29.366459 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-11259de6-a786-40a3-a5ac-18a42679443b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:29.377272 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-691d0d42-5cc7-48bc-89ed-43249e469165 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:29.385163 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-691d0d42-5cc7-48bc-89ed-43249e469165 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.084625 Jul 11 11:48:29.385732 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1390/2772] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:29 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:48:29.496825 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-11259de6-a786-40a3-a5ac-18a42679443b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:29.504650 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-11259de6-a786-40a3-a5ac-18a42679443b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.150680 Jul 11 11:48:29.505214 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1383/2773] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:29 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:48:30.401839 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-173e2217-a2c2-45d3-a829-2bb2c4afe804 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:30.403013 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-173e2217-a2c2-45d3-a829-2bb2c4afe804 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:30.409619 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-173e2217-a2c2-45d3-a829-2bb2c4afe804 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:30.410060 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-173e2217-a2c2-45d3-a829-2bb2c4afe804 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:30.410810 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-173e2217-a2c2-45d3-a829-2bb2c4afe804 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:30.411242 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-173e2217-a2c2-45d3-a829-2bb2c4afe804 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:30.473515 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-173e2217-a2c2-45d3-a829-2bb2c4afe804 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:30.481747 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-173e2217-a2c2-45d3-a829-2bb2c4afe804 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.083800 Jul 11 11:48:30.482298 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1391/2774] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:30 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:48:30.522115 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-3d725172-4f52-4c2c-9c4e-5ec7bbdc9a78 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:30.522725 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-3d725172-4f52-4c2c-9c4e-5ec7bbdc9a78 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:30.529159 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3d725172-4f52-4c2c-9c4e-5ec7bbdc9a78 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:30.529598 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3d725172-4f52-4c2c-9c4e-5ec7bbdc9a78 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:30.530342 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3d725172-4f52-4c2c-9c4e-5ec7bbdc9a78 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:30.530772 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3d725172-4f52-4c2c-9c4e-5ec7bbdc9a78 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:30.657131 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-3d725172-4f52-4c2c-9c4e-5ec7bbdc9a78 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:30.664924 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-3d725172-4f52-4c2c-9c4e-5ec7bbdc9a78 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.146633 Jul 11 11:48:30.665489 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1384/2775] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:30 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:48:31.498789 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-08377b89-7dce-4460-ac1b-42e8e0fcb761 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:31.499423 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-08377b89-7dce-4460-ac1b-42e8e0fcb761 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:31.505943 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-08377b89-7dce-4460-ac1b-42e8e0fcb761 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:31.506390 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-08377b89-7dce-4460-ac1b-42e8e0fcb761 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:31.507141 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-08377b89-7dce-4460-ac1b-42e8e0fcb761 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:31.507613 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-08377b89-7dce-4460-ac1b-42e8e0fcb761 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:31.568108 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-08377b89-7dce-4460-ac1b-42e8e0fcb761 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:31.576819 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-08377b89-7dce-4460-ac1b-42e8e0fcb761 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.081885 Jul 11 11:48:31.577383 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1392/2776] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:31 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:48:31.682288 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-23c9a5e3-6698-4bc6-a171-85722d091d85 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:31.682897 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-23c9a5e3-6698-4bc6-a171-85722d091d85 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:31.689952 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-23c9a5e3-6698-4bc6-a171-85722d091d85 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:31.690398 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-23c9a5e3-6698-4bc6-a171-85722d091d85 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:31.691151 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-23c9a5e3-6698-4bc6-a171-85722d091d85 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:31.691613 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-23c9a5e3-6698-4bc6-a171-85722d091d85 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:31.815407 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-23c9a5e3-6698-4bc6-a171-85722d091d85 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:31.823517 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-23c9a5e3-6698-4bc6-a171-85722d091d85 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.144996 Jul 11 11:48:31.824672 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1385/2777] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:31 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:48:32.595311 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-70cb6260-b284-4cff-997e-8ea7609694be tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:32.596165 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-70cb6260-b284-4cff-997e-8ea7609694be tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:32.603165 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-70cb6260-b284-4cff-997e-8ea7609694be tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:32.603640 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-70cb6260-b284-4cff-997e-8ea7609694be tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:32.604415 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-70cb6260-b284-4cff-997e-8ea7609694be tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:32.604847 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-70cb6260-b284-4cff-997e-8ea7609694be tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:32.667857 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-70cb6260-b284-4cff-997e-8ea7609694be tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:32.675993 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-70cb6260-b284-4cff-997e-8ea7609694be tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.085363 Jul 11 11:48:32.676804 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1393/2778] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:32 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:48:32.842104 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-98d83205-9d37-4475-8e40-c21feae1109b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:32.842752 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-98d83205-9d37-4475-8e40-c21feae1109b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:32.849233 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-98d83205-9d37-4475-8e40-c21feae1109b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:32.849681 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-98d83205-9d37-4475-8e40-c21feae1109b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:32.850435 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-98d83205-9d37-4475-8e40-c21feae1109b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:32.850866 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-98d83205-9d37-4475-8e40-c21feae1109b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:32.977734 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-98d83205-9d37-4475-8e40-c21feae1109b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:32.985548 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-98d83205-9d37-4475-8e40-c21feae1109b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.147981 Jul 11 11:48:32.986110 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1386/2779] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:32 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:48:33.693036 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-60acdeb9-e03f-402c-85dd-b70062f776da tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:33.693634 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-60acdeb9-e03f-402c-85dd-b70062f776da tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:33.700358 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-60acdeb9-e03f-402c-85dd-b70062f776da tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:33.700794 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-60acdeb9-e03f-402c-85dd-b70062f776da tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:33.701539 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-60acdeb9-e03f-402c-85dd-b70062f776da tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:33.701972 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-60acdeb9-e03f-402c-85dd-b70062f776da tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:33.764955 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-60acdeb9-e03f-402c-85dd-b70062f776da tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:33.773066 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-60acdeb9-e03f-402c-85dd-b70062f776da tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.083942 Jul 11 11:48:33.773632 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1394/2780] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:33 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:48:34.002569 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-8c1bb5e8-03a3-4d9c-951b-2f3ddf96ae8c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:34.003181 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-8c1bb5e8-03a3-4d9c-951b-2f3ddf96ae8c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:34.009684 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8c1bb5e8-03a3-4d9c-951b-2f3ddf96ae8c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:34.010128 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8c1bb5e8-03a3-4d9c-951b-2f3ddf96ae8c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:34.010876 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8c1bb5e8-03a3-4d9c-951b-2f3ddf96ae8c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:34.011377 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8c1bb5e8-03a3-4d9c-951b-2f3ddf96ae8c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:34.137279 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-8c1bb5e8-03a3-4d9c-951b-2f3ddf96ae8c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:34.145146 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-8c1bb5e8-03a3-4d9c-951b-2f3ddf96ae8c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.146411 Jul 11 11:48:34.145714 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1387/2781] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:33 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:48:34.789953 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-7e51b466-385c-4526-b1cc-ab12f96acd9a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:34.790575 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-7e51b466-385c-4526-b1cc-ab12f96acd9a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:34.797058 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7e51b466-385c-4526-b1cc-ab12f96acd9a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:34.797535 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7e51b466-385c-4526-b1cc-ab12f96acd9a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:34.798280 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7e51b466-385c-4526-b1cc-ab12f96acd9a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:34.798712 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7e51b466-385c-4526-b1cc-ab12f96acd9a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:34.865106 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-7e51b466-385c-4526-b1cc-ab12f96acd9a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:34.873589 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-7e51b466-385c-4526-b1cc-ab12f96acd9a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.087568 Jul 11 11:48:34.874153 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1395/2782] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:34 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:48:35.162985 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-14c79449-356c-44c9-b6e9-1bee07f1a37b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:35.163613 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-14c79449-356c-44c9-b6e9-1bee07f1a37b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:35.170608 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-14c79449-356c-44c9-b6e9-1bee07f1a37b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:35.171043 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-14c79449-356c-44c9-b6e9-1bee07f1a37b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:35.171815 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-14c79449-356c-44c9-b6e9-1bee07f1a37b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:35.172242 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-14c79449-356c-44c9-b6e9-1bee07f1a37b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:35.301236 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-14c79449-356c-44c9-b6e9-1bee07f1a37b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:35.309076 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-14c79449-356c-44c9-b6e9-1bee07f1a37b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.149887 Jul 11 11:48:35.309638 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1388/2783] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:35 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:48:35.890565 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-d504cdef-d676-4f96-ad36-23dc154da396 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:35.891137 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-d504cdef-d676-4f96-ad36-23dc154da396 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:35.897639 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d504cdef-d676-4f96-ad36-23dc154da396 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:35.898084 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d504cdef-d676-4f96-ad36-23dc154da396 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:35.898860 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d504cdef-d676-4f96-ad36-23dc154da396 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:35.899314 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d504cdef-d676-4f96-ad36-23dc154da396 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:35.959676 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-d504cdef-d676-4f96-ad36-23dc154da396 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:35.967397 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-d504cdef-d676-4f96-ad36-23dc154da396 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.080762 Jul 11 11:48:35.967953 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1396/2784] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:35 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:48:36.326510 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-15cf1de4-0399-4941-803d-957ed65cd93c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:36.327243 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-15cf1de4-0399-4941-803d-957ed65cd93c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:36.333690 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-15cf1de4-0399-4941-803d-957ed65cd93c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:36.334130 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-15cf1de4-0399-4941-803d-957ed65cd93c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:36.334874 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-15cf1de4-0399-4941-803d-957ed65cd93c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:36.335330 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-15cf1de4-0399-4941-803d-957ed65cd93c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:36.467189 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-15cf1de4-0399-4941-803d-957ed65cd93c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:36.475060 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-15cf1de4-0399-4941-803d-957ed65cd93c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.152649 Jul 11 11:48:36.475656 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1389/2785] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:36 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:48:36.984278 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-2f3f51b4-bd8c-4422-8a20-6609f096442d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:36.984892 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-2f3f51b4-bd8c-4422-8a20-6609f096442d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:36.991428 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2f3f51b4-bd8c-4422-8a20-6609f096442d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:36.991881 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2f3f51b4-bd8c-4422-8a20-6609f096442d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:36.992632 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2f3f51b4-bd8c-4422-8a20-6609f096442d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:36.993069 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2f3f51b4-bd8c-4422-8a20-6609f096442d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:37.056304 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-2f3f51b4-bd8c-4422-8a20-6609f096442d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:37.064737 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-2f3f51b4-bd8c-4422-8a20-6609f096442d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.084299 Jul 11 11:48:37.065299 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1397/2786] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:36 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:48:37.492184 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-a991930b-aa72-45b6-91b5-0f3d70491c63 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:37.492794 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-a991930b-aa72-45b6-91b5-0f3d70491c63 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:37.499901 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a991930b-aa72-45b6-91b5-0f3d70491c63 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:37.500350 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a991930b-aa72-45b6-91b5-0f3d70491c63 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:37.501102 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a991930b-aa72-45b6-91b5-0f3d70491c63 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:37.501533 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a991930b-aa72-45b6-91b5-0f3d70491c63 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:37.627001 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-a991930b-aa72-45b6-91b5-0f3d70491c63 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:37.629159 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=100 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:48:37.635369 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-a991930b-aa72-45b6-91b5-0f3d70491c63 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.146991 Jul 11 11:48:37.635999 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1390/2787] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:37 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:48:38.082391 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-5992ba37-4893-42c8-8f27-681847f6f4e0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:38.083002 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-5992ba37-4893-42c8-8f27-681847f6f4e0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:38.089632 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5992ba37-4893-42c8-8f27-681847f6f4e0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:38.090083 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5992ba37-4893-42c8-8f27-681847f6f4e0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:38.090832 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5992ba37-4893-42c8-8f27-681847f6f4e0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:38.091285 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5992ba37-4893-42c8-8f27-681847f6f4e0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:38.154194 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-5992ba37-4893-42c8-8f27-681847f6f4e0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:38.162061 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-5992ba37-4893-42c8-8f27-681847f6f4e0 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.083589 Jul 11 11:48:38.162621 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1398/2788] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:38 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:48:38.652646 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-5adc5e21-9097-4205-bfc8-d35654faaee6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:38.653176 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-5adc5e21-9097-4205-bfc8-d35654faaee6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:38.660181 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5adc5e21-9097-4205-bfc8-d35654faaee6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:38.660626 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5adc5e21-9097-4205-bfc8-d35654faaee6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:38.661376 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5adc5e21-9097-4205-bfc8-d35654faaee6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:38.661835 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5adc5e21-9097-4205-bfc8-d35654faaee6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:38.789217 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-5adc5e21-9097-4205-bfc8-d35654faaee6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:38.797513 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-5adc5e21-9097-4205-bfc8-d35654faaee6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.148790 Jul 11 11:48:38.798086 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1391/2789] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:38 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:48:39.179536 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-d56cfad9-ce72-4ecd-a525-fc35384cf3fc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:39.180171 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-d56cfad9-ce72-4ecd-a525-fc35384cf3fc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:39.186624 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d56cfad9-ce72-4ecd-a525-fc35384cf3fc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:39.187065 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d56cfad9-ce72-4ecd-a525-fc35384cf3fc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:39.187833 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d56cfad9-ce72-4ecd-a525-fc35384cf3fc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:39.188264 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d56cfad9-ce72-4ecd-a525-fc35384cf3fc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:39.249330 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-d56cfad9-ce72-4ecd-a525-fc35384cf3fc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:39.257131 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-d56cfad9-ce72-4ecd-a525-fc35384cf3fc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.081477 Jul 11 11:48:39.257685 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1399/2790] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:39 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:48:39.815230 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-4f64cf7a-69a2-4a40-8b43-038b9360dcf7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:39.815941 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-4f64cf7a-69a2-4a40-8b43-038b9360dcf7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:39.822323 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4f64cf7a-69a2-4a40-8b43-038b9360dcf7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:39.823032 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4f64cf7a-69a2-4a40-8b43-038b9360dcf7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:39.824466 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4f64cf7a-69a2-4a40-8b43-038b9360dcf7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:39.824898 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4f64cf7a-69a2-4a40-8b43-038b9360dcf7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:39.950526 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-4f64cf7a-69a2-4a40-8b43-038b9360dcf7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:39.958358 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-4f64cf7a-69a2-4a40-8b43-038b9360dcf7 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.147076 Jul 11 11:48:39.961750 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1392/2791] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:39 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:48:40.273960 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-8032219e-3813-49f8-9b72-0fa40cd7d36d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:40.274572 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-8032219e-3813-49f8-9b72-0fa40cd7d36d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:40.281024 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8032219e-3813-49f8-9b72-0fa40cd7d36d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:40.281472 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8032219e-3813-49f8-9b72-0fa40cd7d36d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:40.282222 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8032219e-3813-49f8-9b72-0fa40cd7d36d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:40.282658 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8032219e-3813-49f8-9b72-0fa40cd7d36d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:40.343594 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-8032219e-3813-49f8-9b72-0fa40cd7d36d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:40.351429 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-8032219e-3813-49f8-9b72-0fa40cd7d36d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.081303 Jul 11 11:48:40.352001 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1400/2792] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:40 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:48:40.974846 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-e7d33724-d40d-4270-90cb-bc292306bbd0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:40.975465 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-e7d33724-d40d-4270-90cb-bc292306bbd0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:40.982007 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e7d33724-d40d-4270-90cb-bc292306bbd0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:40.982454 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e7d33724-d40d-4270-90cb-bc292306bbd0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:40.983209 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e7d33724-d40d-4270-90cb-bc292306bbd0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:40.983669 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e7d33724-d40d-4270-90cb-bc292306bbd0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:41.343222 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-e7d33724-d40d-4270-90cb-bc292306bbd0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:41.351053 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-e7d33724-d40d-4270-90cb-bc292306bbd0 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.380053 Jul 11 11:48:41.351650 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1393/2793] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:40 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:48:41.368379 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-9868897b-8c4d-4a75-bbfc-07ac135e593e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:41.368994 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-9868897b-8c4d-4a75-bbfc-07ac135e593e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:41.376057 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9868897b-8c4d-4a75-bbfc-07ac135e593e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:41.376503 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9868897b-8c4d-4a75-bbfc-07ac135e593e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:41.377258 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9868897b-8c4d-4a75-bbfc-07ac135e593e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:41.377695 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9868897b-8c4d-4a75-bbfc-07ac135e593e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:41.392558 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=100 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:48:41.438017 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-9868897b-8c4d-4a75-bbfc-07ac135e593e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:41.445729 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-9868897b-8c4d-4a75-bbfc-07ac135e593e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.081153 Jul 11 11:48:41.446288 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1401/2794] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:41 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:48:42.368554 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-41e6edba-f3dd-4c47-8523-34f4ef28cb36 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:42.369108 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-41e6edba-f3dd-4c47-8523-34f4ef28cb36 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:42.375900 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-41e6edba-f3dd-4c47-8523-34f4ef28cb36 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:42.376347 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-41e6edba-f3dd-4c47-8523-34f4ef28cb36 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:42.377101 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-41e6edba-f3dd-4c47-8523-34f4ef28cb36 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:42.377534 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-41e6edba-f3dd-4c47-8523-34f4ef28cb36 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:42.463191 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-45d96355-f261-487a-b4c3-865f420d97dc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:42.463839 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-45d96355-f261-487a-b4c3-865f420d97dc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:42.470822 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-45d96355-f261-487a-b4c3-865f420d97dc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:42.471343 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-45d96355-f261-487a-b4c3-865f420d97dc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:42.472054 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-45d96355-f261-487a-b4c3-865f420d97dc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:42.472481 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-45d96355-f261-487a-b4c3-865f420d97dc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:42.503748 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-41e6edba-f3dd-4c47-8523-34f4ef28cb36 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:42.512423 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-41e6edba-f3dd-4c47-8523-34f4ef28cb36 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.147733 Jul 11 11:48:42.512997 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1394/2795] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:42 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:48:42.536297 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-45d96355-f261-487a-b4c3-865f420d97dc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:42.544148 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-45d96355-f261-487a-b4c3-865f420d97dc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.084711 Jul 11 11:48:42.544716 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1402/2796] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:42 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:48:43.530518 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-603e758c-61c1-47ed-a1f8-b1525985d9ca tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:43.531150 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-603e758c-61c1-47ed-a1f8-b1525985d9ca tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:43.537629 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-603e758c-61c1-47ed-a1f8-b1525985d9ca tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:43.538077 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-603e758c-61c1-47ed-a1f8-b1525985d9ca tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:43.538837 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-603e758c-61c1-47ed-a1f8-b1525985d9ca tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:43.539299 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-603e758c-61c1-47ed-a1f8-b1525985d9ca tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:43.561060 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-48d537d4-0b94-40f5-8bfa-c6d55ec64155 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:43.561678 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-48d537d4-0b94-40f5-8bfa-c6d55ec64155 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:43.568198 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-48d537d4-0b94-40f5-8bfa-c6d55ec64155 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:43.573578 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-48d537d4-0b94-40f5-8bfa-c6d55ec64155 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:43.573578 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-48d537d4-0b94-40f5-8bfa-c6d55ec64155 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:43.573578 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-48d537d4-0b94-40f5-8bfa-c6d55ec64155 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:43.634331 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-48d537d4-0b94-40f5-8bfa-c6d55ec64155 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:43.642470 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-48d537d4-0b94-40f5-8bfa-c6d55ec64155 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.085333 Jul 11 11:48:43.643052 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1403/2797] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:43 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:48:43.671747 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-603e758c-61c1-47ed-a1f8-b1525985d9ca tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:43.679657 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-603e758c-61c1-47ed-a1f8-b1525985d9ca tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.153536 Jul 11 11:48:43.680221 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1395/2798] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:43 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:48:44.659542 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-a430ce24-b65a-47d7-9873-6044df1199fb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:44.660106 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-a430ce24-b65a-47d7-9873-6044df1199fb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:44.666553 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a430ce24-b65a-47d7-9873-6044df1199fb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:44.667005 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a430ce24-b65a-47d7-9873-6044df1199fb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:44.668295 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a430ce24-b65a-47d7-9873-6044df1199fb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:44.668734 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a430ce24-b65a-47d7-9873-6044df1199fb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:44.697182 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-e81f01f8-4c58-4a7f-8e73-c4c52ec0caec tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:44.698150 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-e81f01f8-4c58-4a7f-8e73-c4c52ec0caec tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:44.704654 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e81f01f8-4c58-4a7f-8e73-c4c52ec0caec tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:44.705160 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e81f01f8-4c58-4a7f-8e73-c4c52ec0caec tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:44.705943 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e81f01f8-4c58-4a7f-8e73-c4c52ec0caec tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:44.706380 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e81f01f8-4c58-4a7f-8e73-c4c52ec0caec tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:44.731914 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-a430ce24-b65a-47d7-9873-6044df1199fb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:44.739894 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-a430ce24-b65a-47d7-9873-6044df1199fb tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.084349 Jul 11 11:48:44.740472 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1404/2799] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:44 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:48:44.834419 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-e81f01f8-4c58-4a7f-8e73-c4c52ec0caec tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:44.842296 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-e81f01f8-4c58-4a7f-8e73-c4c52ec0caec tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.148925 Jul 11 11:48:44.842865 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1396/2800] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:44 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:48:45.757284 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-5d594677-90d4-4dff-b455-2ce7d53a52ff tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:45.758082 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-5d594677-90d4-4dff-b455-2ce7d53a52ff tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:45.764882 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5d594677-90d4-4dff-b455-2ce7d53a52ff tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:45.765324 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5d594677-90d4-4dff-b455-2ce7d53a52ff tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:45.766068 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5d594677-90d4-4dff-b455-2ce7d53a52ff tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:45.766497 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5d594677-90d4-4dff-b455-2ce7d53a52ff tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:45.828473 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-5d594677-90d4-4dff-b455-2ce7d53a52ff tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:45.836884 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-5d594677-90d4-4dff-b455-2ce7d53a52ff tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.083357 Jul 11 11:48:45.838397 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1405/2801] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:45 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:48:45.858799 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-593a37a5-ee37-462b-add5-d94187e3f6c1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:45.859429 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-593a37a5-ee37-462b-add5-d94187e3f6c1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:45.865845 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-593a37a5-ee37-462b-add5-d94187e3f6c1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:45.866276 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-593a37a5-ee37-462b-add5-d94187e3f6c1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:45.867019 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-593a37a5-ee37-462b-add5-d94187e3f6c1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:45.867484 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-593a37a5-ee37-462b-add5-d94187e3f6c1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:45.992458 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-593a37a5-ee37-462b-add5-d94187e3f6c1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:46.000781 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-593a37a5-ee37-462b-add5-d94187e3f6c1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.145791 Jul 11 11:48:46.001343 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1397/2802] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:45 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:48:46.853854 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-0416c628-3ca1-45a5-91f7-1d9436ef1b90 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:46.854486 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-0416c628-3ca1-45a5-91f7-1d9436ef1b90 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:46.862905 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0416c628-3ca1-45a5-91f7-1d9436ef1b90 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:46.863738 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0416c628-3ca1-45a5-91f7-1d9436ef1b90 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:46.864820 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0416c628-3ca1-45a5-91f7-1d9436ef1b90 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:46.865351 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0416c628-3ca1-45a5-91f7-1d9436ef1b90 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:46.937723 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-0416c628-3ca1-45a5-91f7-1d9436ef1b90 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:46.945660 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-0416c628-3ca1-45a5-91f7-1d9436ef1b90 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.095687 Jul 11 11:48:46.946234 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1406/2803] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:46 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:48:47.017772 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-68687880-70d7-4601-886e-ad857b5119a8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:47.018387 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-68687880-70d7-4601-886e-ad857b5119a8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:47.024877 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-68687880-70d7-4601-886e-ad857b5119a8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:47.025327 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-68687880-70d7-4601-886e-ad857b5119a8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:47.026097 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-68687880-70d7-4601-886e-ad857b5119a8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:47.027174 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-68687880-70d7-4601-886e-ad857b5119a8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:47.157518 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-68687880-70d7-4601-886e-ad857b5119a8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:47.165298 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-68687880-70d7-4601-886e-ad857b5119a8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.151333 Jul 11 11:48:47.165862 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1398/2804] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:47 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:48:47.963234 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-eb683c4e-c772-4fce-bcdd-a2534407c85b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:47.963868 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-eb683c4e-c772-4fce-bcdd-a2534407c85b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:47.970922 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-eb683c4e-c772-4fce-bcdd-a2534407c85b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:47.971415 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-eb683c4e-c772-4fce-bcdd-a2534407c85b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:47.972171 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-eb683c4e-c772-4fce-bcdd-a2534407c85b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:47.972607 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-eb683c4e-c772-4fce-bcdd-a2534407c85b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:48.032478 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-eb683c4e-c772-4fce-bcdd-a2534407c85b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:48.040326 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-eb683c4e-c772-4fce-bcdd-a2534407c85b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.080965 Jul 11 11:48:48.040934 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1407/2805] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:47 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:48:48.181896 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-14fcc64c-daf4-43f5-a592-a790e1ba88f8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:48.182508 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-14fcc64c-daf4-43f5-a592-a790e1ba88f8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:48.189603 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-14fcc64c-daf4-43f5-a592-a790e1ba88f8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:48.190050 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-14fcc64c-daf4-43f5-a592-a790e1ba88f8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:48.190807 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-14fcc64c-daf4-43f5-a592-a790e1ba88f8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:48.191239 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-14fcc64c-daf4-43f5-a592-a790e1ba88f8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:48.317110 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-14fcc64c-daf4-43f5-a592-a790e1ba88f8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:48.325304 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-14fcc64c-daf4-43f5-a592-a790e1ba88f8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.147288 Jul 11 11:48:48.325867 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1399/2806] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:48 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:48:49.057268 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-d59c71b8-65f0-4fa9-bed2-b4dcf0442e90 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:49.058529 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-d59c71b8-65f0-4fa9-bed2-b4dcf0442e90 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:49.065247 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d59c71b8-65f0-4fa9-bed2-b4dcf0442e90 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:49.065815 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d59c71b8-65f0-4fa9-bed2-b4dcf0442e90 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:49.066577 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d59c71b8-65f0-4fa9-bed2-b4dcf0442e90 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:49.067143 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d59c71b8-65f0-4fa9-bed2-b4dcf0442e90 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:49.127669 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-d59c71b8-65f0-4fa9-bed2-b4dcf0442e90 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:49.135412 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-d59c71b8-65f0-4fa9-bed2-b4dcf0442e90 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.082008 Jul 11 11:48:49.136648 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1408/2807] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:49 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:48:49.342564 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-cde5be3d-0e0a-48b5-8779-20ebdd7e1168 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:49.343136 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-cde5be3d-0e0a-48b5-8779-20ebdd7e1168 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:49.349565 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-cde5be3d-0e0a-48b5-8779-20ebdd7e1168 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:49.350013 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-cde5be3d-0e0a-48b5-8779-20ebdd7e1168 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:49.350771 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-cde5be3d-0e0a-48b5-8779-20ebdd7e1168 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:49.351207 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-cde5be3d-0e0a-48b5-8779-20ebdd7e1168 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:49.480472 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-cde5be3d-0e0a-48b5-8779-20ebdd7e1168 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:49.488319 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-cde5be3d-0e0a-48b5-8779-20ebdd7e1168 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.149758 Jul 11 11:48:49.488882 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1400/2808] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:49 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:48:50.153432 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-4b578e90-b833-41a3-9cc9-7eafb92db25f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:50.154051 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-4b578e90-b833-41a3-9cc9-7eafb92db25f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:50.160572 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4b578e90-b833-41a3-9cc9-7eafb92db25f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:50.161018 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4b578e90-b833-41a3-9cc9-7eafb92db25f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:50.161774 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4b578e90-b833-41a3-9cc9-7eafb92db25f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:50.162236 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4b578e90-b833-41a3-9cc9-7eafb92db25f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:50.223536 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-4b578e90-b833-41a3-9cc9-7eafb92db25f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:50.231274 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-4b578e90-b833-41a3-9cc9-7eafb92db25f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.082221 Jul 11 11:48:50.231859 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1409/2809] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:50 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:48:50.506088 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-dc881fe4-6627-4781-9453-a9a0d05310b9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:50.506730 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-dc881fe4-6627-4781-9453-a9a0d05310b9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:50.513766 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-dc881fe4-6627-4781-9453-a9a0d05310b9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:50.514207 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-dc881fe4-6627-4781-9453-a9a0d05310b9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:50.514959 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-dc881fe4-6627-4781-9453-a9a0d05310b9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:50.515424 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-dc881fe4-6627-4781-9453-a9a0d05310b9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:50.640296 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-dc881fe4-6627-4781-9453-a9a0d05310b9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:50.648131 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-dc881fe4-6627-4781-9453-a9a0d05310b9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.145873 Jul 11 11:48:50.648643 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1401/2810] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:50 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:48:51.248607 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-72ee0dca-4ef6-4199-8f82-9896d251a4d1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:51.249210 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-72ee0dca-4ef6-4199-8f82-9896d251a4d1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:51.255679 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-72ee0dca-4ef6-4199-8f82-9896d251a4d1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:51.256128 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-72ee0dca-4ef6-4199-8f82-9896d251a4d1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:51.256882 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-72ee0dca-4ef6-4199-8f82-9896d251a4d1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:51.257319 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-72ee0dca-4ef6-4199-8f82-9896d251a4d1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:51.322079 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-72ee0dca-4ef6-4199-8f82-9896d251a4d1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:51.331005 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-72ee0dca-4ef6-4199-8f82-9896d251a4d1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.086700 Jul 11 11:48:51.331568 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1410/2811] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:51 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:48:51.665858 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-75c566c6-7e82-4e37-87cb-fdfb81277924 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:51.666470 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-75c566c6-7e82-4e37-87cb-fdfb81277924 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:51.673589 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-75c566c6-7e82-4e37-87cb-fdfb81277924 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:51.674042 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-75c566c6-7e82-4e37-87cb-fdfb81277924 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:51.674839 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-75c566c6-7e82-4e37-87cb-fdfb81277924 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:51.675344 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-75c566c6-7e82-4e37-87cb-fdfb81277924 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:51.806157 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-75c566c6-7e82-4e37-87cb-fdfb81277924 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:51.813987 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-75c566c6-7e82-4e37-87cb-fdfb81277924 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.152005 Jul 11 11:48:51.814558 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1402/2812] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:51 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:48:52.347828 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-661104bb-64f6-4b79-86b9-e1276c783313 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:52.348400 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-661104bb-64f6-4b79-86b9-e1276c783313 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:52.354762 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-661104bb-64f6-4b79-86b9-e1276c783313 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:52.355209 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-661104bb-64f6-4b79-86b9-e1276c783313 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:52.355991 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-661104bb-64f6-4b79-86b9-e1276c783313 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:52.356423 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-661104bb-64f6-4b79-86b9-e1276c783313 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:52.416607 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-661104bb-64f6-4b79-86b9-e1276c783313 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:52.424538 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-661104bb-64f6-4b79-86b9-e1276c783313 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.080604 Jul 11 11:48:52.425100 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1411/2813] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:52 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:48:52.831420 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-74260a42-5979-4b25-b30d-1651c33c746e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:52.832024 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-74260a42-5979-4b25-b30d-1651c33c746e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:52.838525 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-74260a42-5979-4b25-b30d-1651c33c746e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:52.838965 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-74260a42-5979-4b25-b30d-1651c33c746e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:52.839740 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-74260a42-5979-4b25-b30d-1651c33c746e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:52.840167 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-74260a42-5979-4b25-b30d-1651c33c746e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:52.974157 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-74260a42-5979-4b25-b30d-1651c33c746e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:52.982631 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-74260a42-5979-4b25-b30d-1651c33c746e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.155086 Jul 11 11:48:52.983190 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1403/2814] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:52 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:48:53.441309 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-e850fbc1-bb25-459e-b9a0-18c53eb9e490 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:53.441909 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-e850fbc1-bb25-459e-b9a0-18c53eb9e490 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:53.448748 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e850fbc1-bb25-459e-b9a0-18c53eb9e490 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:53.449200 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e850fbc1-bb25-459e-b9a0-18c53eb9e490 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:53.449962 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e850fbc1-bb25-459e-b9a0-18c53eb9e490 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:53.450402 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e850fbc1-bb25-459e-b9a0-18c53eb9e490 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:53.510404 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-e850fbc1-bb25-459e-b9a0-18c53eb9e490 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:53.518314 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-e850fbc1-bb25-459e-b9a0-18c53eb9e490 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.080879 Jul 11 11:48:53.518896 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1412/2815] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:53 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:48:54.008998 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-3ddba243-6ab3-4565-b88c-7fdab407f1ca tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:54.009595 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-3ddba243-6ab3-4565-b88c-7fdab407f1ca tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:54.016042 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3ddba243-6ab3-4565-b88c-7fdab407f1ca tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:54.016484 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3ddba243-6ab3-4565-b88c-7fdab407f1ca tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:54.017243 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3ddba243-6ab3-4565-b88c-7fdab407f1ca tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:54.017672 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3ddba243-6ab3-4565-b88c-7fdab407f1ca tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:54.143458 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-3ddba243-6ab3-4565-b88c-7fdab407f1ca tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:54.151310 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-3ddba243-6ab3-4565-b88c-7fdab407f1ca tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.146120 Jul 11 11:48:54.165075 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1404/2816] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:54 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:48:54.535908 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-0e9dc66f-97d0-45fe-8774-b8468eb420b9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:54.536495 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-0e9dc66f-97d0-45fe-8774-b8468eb420b9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:54.542972 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0e9dc66f-97d0-45fe-8774-b8468eb420b9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:54.543444 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0e9dc66f-97d0-45fe-8774-b8468eb420b9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:54.544186 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0e9dc66f-97d0-45fe-8774-b8468eb420b9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:54.544614 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0e9dc66f-97d0-45fe-8774-b8468eb420b9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:54.604198 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-0e9dc66f-97d0-45fe-8774-b8468eb420b9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:54.611929 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-0e9dc66f-97d0-45fe-8774-b8468eb420b9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.079856 Jul 11 11:48:54.612493 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1413/2817] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:54 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:48:55.169537 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-5cdc87de-7704-44f0-ab4b-709c97660f36 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:55.170139 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-5cdc87de-7704-44f0-ab4b-709c97660f36 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:55.172428 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_api:SELECT=52 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:48:55.177140 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5cdc87de-7704-44f0-ab4b-709c97660f36 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:55.177582 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5cdc87de-7704-44f0-ab4b-709c97660f36 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:55.178336 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5cdc87de-7704-44f0-ab4b-709c97660f36 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:55.178765 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5cdc87de-7704-44f0-ab4b-709c97660f36 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:55.307919 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-5cdc87de-7704-44f0-ab4b-709c97660f36 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:55.316372 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-5cdc87de-7704-44f0-ab4b-709c97660f36 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.151194 Jul 11 11:48:55.316935 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1405/2818] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:55 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:48:55.627814 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-07cb6ce1-c945-456b-8468-e6e8721a2067 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:55.628409 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-07cb6ce1-c945-456b-8468-e6e8721a2067 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:55.634807 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-07cb6ce1-c945-456b-8468-e6e8721a2067 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:55.635275 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-07cb6ce1-c945-456b-8468-e6e8721a2067 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:55.636032 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-07cb6ce1-c945-456b-8468-e6e8721a2067 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:55.636464 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-07cb6ce1-c945-456b-8468-e6e8721a2067 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:55.699488 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-07cb6ce1-c945-456b-8468-e6e8721a2067 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:55.707274 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-07cb6ce1-c945-456b-8468-e6e8721a2067 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.083398 Jul 11 11:48:55.707845 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1414/2819] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:55 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:48:56.333740 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-7c7be276-ff37-4a6d-9526-37f4890bd160 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:56.334283 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-7c7be276-ff37-4a6d-9526-37f4890bd160 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:56.340684 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7c7be276-ff37-4a6d-9526-37f4890bd160 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:56.341125 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7c7be276-ff37-4a6d-9526-37f4890bd160 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:56.341900 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7c7be276-ff37-4a6d-9526-37f4890bd160 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:56.342331 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7c7be276-ff37-4a6d-9526-37f4890bd160 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:56.466615 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-7c7be276-ff37-4a6d-9526-37f4890bd160 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:56.474423 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-7c7be276-ff37-4a6d-9526-37f4890bd160 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.144583 Jul 11 11:48:56.474980 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1406/2820] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:56 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:48:56.724928 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-2916b990-a242-460e-902e-02470aa049ee tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:56.725542 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-2916b990-a242-460e-902e-02470aa049ee tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:56.727858 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_api:SELECT=56 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:48:56.733125 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2916b990-a242-460e-902e-02470aa049ee tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:56.733573 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2916b990-a242-460e-902e-02470aa049ee tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:56.734324 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2916b990-a242-460e-902e-02470aa049ee tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:56.734763 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2916b990-a242-460e-902e-02470aa049ee tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:56.795038 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-2916b990-a242-460e-902e-02470aa049ee tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:56.802740 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-2916b990-a242-460e-902e-02470aa049ee tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.081706 Jul 11 11:48:56.803320 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1415/2821] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:56 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:48:57.491524 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-e4e1848b-1561-4a70-a445-f24f22af1eb2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:57.492147 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-e4e1848b-1561-4a70-a445-f24f22af1eb2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:57.499149 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e4e1848b-1561-4a70-a445-f24f22af1eb2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:57.499619 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e4e1848b-1561-4a70-a445-f24f22af1eb2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:57.500371 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e4e1848b-1561-4a70-a445-f24f22af1eb2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:57.500806 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e4e1848b-1561-4a70-a445-f24f22af1eb2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:57.515070 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=100 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:48:57.628710 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-e4e1848b-1561-4a70-a445-f24f22af1eb2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:57.636666 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-e4e1848b-1561-4a70-a445-f24f22af1eb2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.149017 Jul 11 11:48:57.637229 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1407/2822] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:57 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:48:57.820167 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-c76dc616-8092-4e03-a55d-82bedbf6ac74 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:57.820803 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-c76dc616-8092-4e03-a55d-82bedbf6ac74 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:57.827578 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c76dc616-8092-4e03-a55d-82bedbf6ac74 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:57.828020 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c76dc616-8092-4e03-a55d-82bedbf6ac74 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:57.828779 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c76dc616-8092-4e03-a55d-82bedbf6ac74 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:57.829207 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c76dc616-8092-4e03-a55d-82bedbf6ac74 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:57.889303 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-c76dc616-8092-4e03-a55d-82bedbf6ac74 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:57.897192 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-c76dc616-8092-4e03-a55d-82bedbf6ac74 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.080853 Jul 11 11:48:57.897756 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1416/2823] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:57 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:48:58.653859 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-8cce26b0-a3a1-49eb-82e8-40f4c68d636c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:58.654418 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-8cce26b0-a3a1-49eb-82e8-40f4c68d636c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:58.660764 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8cce26b0-a3a1-49eb-82e8-40f4c68d636c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:58.661199 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8cce26b0-a3a1-49eb-82e8-40f4c68d636c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:58.661943 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8cce26b0-a3a1-49eb-82e8-40f4c68d636c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:58.662369 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8cce26b0-a3a1-49eb-82e8-40f4c68d636c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:58.794110 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-8cce26b0-a3a1-49eb-82e8-40f4c68d636c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:58.802049 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-8cce26b0-a3a1-49eb-82e8-40f4c68d636c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.152138 Jul 11 11:48:58.802622 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1408/2824] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:58 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:48:58.913766 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-1a027fae-2c5a-4f3e-a40d-3799ba519ffc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:58.914418 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-1a027fae-2c5a-4f3e-a40d-3799ba519ffc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:58.921548 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1a027fae-2c5a-4f3e-a40d-3799ba519ffc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:58.922026 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1a027fae-2c5a-4f3e-a40d-3799ba519ffc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:58.922784 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1a027fae-2c5a-4f3e-a40d-3799ba519ffc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:58.923222 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1a027fae-2c5a-4f3e-a40d-3799ba519ffc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:58.989440 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-1a027fae-2c5a-4f3e-a40d-3799ba519ffc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:58.997261 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-1a027fae-2c5a-4f3e-a40d-3799ba519ffc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.087406 Jul 11 11:48:58.997820 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1417/2825] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:58 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:48:59.819950 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-100d407e-0967-427b-8a97-b26c0313f192 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:48:59.820555 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-100d407e-0967-427b-8a97-b26c0313f192 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:48:59.827374 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-100d407e-0967-427b-8a97-b26c0313f192 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:59.827820 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-100d407e-0967-427b-8a97-b26c0313f192 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:59.828588 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-100d407e-0967-427b-8a97-b26c0313f192 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:48:59.829028 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-100d407e-0967-427b-8a97-b26c0313f192 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:48:59.956998 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-100d407e-0967-427b-8a97-b26c0313f192 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:48:59.964917 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-100d407e-0967-427b-8a97-b26c0313f192 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.148832 Jul 11 11:48:59.965489 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1409/2826] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:48:59 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:49:00.013658 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-73b4dd73-c202-4ceb-a164-6ae66cdd41c2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:49:00.014291 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-73b4dd73-c202-4ceb-a164-6ae66cdd41c2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:49:00.020782 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-73b4dd73-c202-4ceb-a164-6ae66cdd41c2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:00.021256 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-73b4dd73-c202-4ceb-a164-6ae66cdd41c2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:00.022005 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-73b4dd73-c202-4ceb-a164-6ae66cdd41c2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:00.022435 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-73b4dd73-c202-4ceb-a164-6ae66cdd41c2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:00.024933 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=100 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:49:00.088171 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-73b4dd73-c202-4ceb-a164-6ae66cdd41c2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:49:00.096697 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-73b4dd73-c202-4ceb-a164-6ae66cdd41c2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.086844 Jul 11 11:49:00.097268 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1418/2827] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:49:00 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:49:00.981791 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-762d4943-987c-47d8-953a-1ba1be33c608 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:49:00.982398 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-762d4943-987c-47d8-953a-1ba1be33c608 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:49:00.988936 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-762d4943-987c-47d8-953a-1ba1be33c608 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:00.989382 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-762d4943-987c-47d8-953a-1ba1be33c608 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:00.990141 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-762d4943-987c-47d8-953a-1ba1be33c608 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:00.990574 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-762d4943-987c-47d8-953a-1ba1be33c608 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:01.116199 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-e7cb54a5-76ab-4561-aa68-c3d8074393dd tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:49:01.116810 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-e7cb54a5-76ab-4561-aa68-c3d8074393dd tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:49:01.123727 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e7cb54a5-76ab-4561-aa68-c3d8074393dd tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:01.124170 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e7cb54a5-76ab-4561-aa68-c3d8074393dd tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:01.124928 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e7cb54a5-76ab-4561-aa68-c3d8074393dd tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:01.125360 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e7cb54a5-76ab-4561-aa68-c3d8074393dd tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:01.128657 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-762d4943-987c-47d8-953a-1ba1be33c608 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:49:01.136894 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-762d4943-987c-47d8-953a-1ba1be33c608 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.158981 Jul 11 11:49:01.137554 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1410/2828] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:49:00 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:49:01.186630 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-e7cb54a5-76ab-4561-aa68-c3d8074393dd tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:49:01.194444 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-e7cb54a5-76ab-4561-aa68-c3d8074393dd tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.083579 Jul 11 11:49:01.195002 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1419/2829] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:49:01 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:49:02.154493 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-3fcb2776-dc3c-4d08-bc14-0f0326dfd7dc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:49:02.155102 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-3fcb2776-dc3c-4d08-bc14-0f0326dfd7dc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:49:02.161567 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3fcb2776-dc3c-4d08-bc14-0f0326dfd7dc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:02.162018 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3fcb2776-dc3c-4d08-bc14-0f0326dfd7dc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:02.162766 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3fcb2776-dc3c-4d08-bc14-0f0326dfd7dc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:02.163207 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3fcb2776-dc3c-4d08-bc14-0f0326dfd7dc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:02.211591 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-cf708479-c515-40d7-babe-e8aafcf03be2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:49:02.212294 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-cf708479-c515-40d7-babe-e8aafcf03be2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:49:02.219503 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cf708479-c515-40d7-babe-e8aafcf03be2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:02.220054 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cf708479-c515-40d7-babe-e8aafcf03be2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:02.220889 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cf708479-c515-40d7-babe-e8aafcf03be2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:02.221396 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cf708479-c515-40d7-babe-e8aafcf03be2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:02.281933 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-cf708479-c515-40d7-babe-e8aafcf03be2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:49:02.289827 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-cf708479-c515-40d7-babe-e8aafcf03be2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.082122 Jul 11 11:49:02.289986 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-3fcb2776-dc3c-4d08-bc14-0f0326dfd7dc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:49:02.290403 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1420/2830] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:49:02 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:49:02.297737 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-3fcb2776-dc3c-4d08-bc14-0f0326dfd7dc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.147677 Jul 11 11:49:02.298305 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1411/2831] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:49:02 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:49:03.306714 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-d9e809be-d598-4b71-bd92-c95be187d32e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:49:03.307382 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-d9e809be-d598-4b71-bd92-c95be187d32e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:49:03.313600 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-4f0cec41-bc41-4b35-918c-97ad77fffb03 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:49:03.314123 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d9e809be-d598-4b71-bd92-c95be187d32e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:03.314266 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-4f0cec41-bc41-4b35-918c-97ad77fffb03 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:49:03.314364 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d9e809be-d598-4b71-bd92-c95be187d32e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:03.315189 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d9e809be-d598-4b71-bd92-c95be187d32e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:03.315675 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d9e809be-d598-4b71-bd92-c95be187d32e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:03.321008 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4f0cec41-bc41-4b35-918c-97ad77fffb03 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:03.321452 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4f0cec41-bc41-4b35-918c-97ad77fffb03 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:03.322211 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4f0cec41-bc41-4b35-918c-97ad77fffb03 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:03.322904 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-4f0cec41-bc41-4b35-918c-97ad77fffb03 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:03.378265 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-d9e809be-d598-4b71-bd92-c95be187d32e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:49:03.386791 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-d9e809be-d598-4b71-bd92-c95be187d32e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.083366 Jul 11 11:49:03.387408 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1421/2832] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:49:03 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:49:03.546821 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-4f0cec41-bc41-4b35-918c-97ad77fffb03 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:49:03.560980 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-4f0cec41-bc41-4b35-918c-97ad77fffb03 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.250809 Jul 11 11:49:03.561654 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1412/2833] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:49:03 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:49:04.403451 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-e19fb7a3-7376-4ede-b5ed-163a95b7bab9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:49:04.404063 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-e19fb7a3-7376-4ede-b5ed-163a95b7bab9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:49:04.410195 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e19fb7a3-7376-4ede-b5ed-163a95b7bab9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:04.410643 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e19fb7a3-7376-4ede-b5ed-163a95b7bab9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:04.411428 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e19fb7a3-7376-4ede-b5ed-163a95b7bab9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:04.411860 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e19fb7a3-7376-4ede-b5ed-163a95b7bab9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:04.474597 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-e19fb7a3-7376-4ede-b5ed-163a95b7bab9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:49:04.483115 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-e19fb7a3-7376-4ede-b5ed-163a95b7bab9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.084294 Jul 11 11:49:04.483714 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1422/2834] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:49:04 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:49:04.580623 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-64a1e514-b2b8-4c36-8c02-a2c1a46b7fc1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:49:04.581239 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-64a1e514-b2b8-4c36-8c02-a2c1a46b7fc1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:49:04.587767 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-64a1e514-b2b8-4c36-8c02-a2c1a46b7fc1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:04.588218 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-64a1e514-b2b8-4c36-8c02-a2c1a46b7fc1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:04.588978 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-64a1e514-b2b8-4c36-8c02-a2c1a46b7fc1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:04.589412 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-64a1e514-b2b8-4c36-8c02-a2c1a46b7fc1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:04.720083 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-64a1e514-b2b8-4c36-8c02-a2c1a46b7fc1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:49:04.727872 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-64a1e514-b2b8-4c36-8c02-a2c1a46b7fc1 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.151080 Jul 11 11:49:04.734203 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1413/2835] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:49:04 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:49:05.500073 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-9cdd377c-8772-4f8b-a4be-79de0c611981 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:49:05.500682 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-9cdd377c-8772-4f8b-a4be-79de0c611981 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:49:05.507009 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9cdd377c-8772-4f8b-a4be-79de0c611981 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:05.507506 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9cdd377c-8772-4f8b-a4be-79de0c611981 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:05.508256 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9cdd377c-8772-4f8b-a4be-79de0c611981 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:05.508687 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9cdd377c-8772-4f8b-a4be-79de0c611981 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:05.572360 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-9cdd377c-8772-4f8b-a4be-79de0c611981 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:49:05.580478 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-9cdd377c-8772-4f8b-a4be-79de0c611981 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.084342 Jul 11 11:49:05.584391 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1423/2836] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:49:05 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:49:05.749236 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-0422153e-c740-4385-a597-c3b9d32c0642 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:49:05.749849 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-0422153e-c740-4385-a597-c3b9d32c0642 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:49:05.756362 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0422153e-c740-4385-a597-c3b9d32c0642 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:05.756749 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0422153e-c740-4385-a597-c3b9d32c0642 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:05.757503 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0422153e-c740-4385-a597-c3b9d32c0642 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:05.757962 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0422153e-c740-4385-a597-c3b9d32c0642 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:05.888143 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-0422153e-c740-4385-a597-c3b9d32c0642 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:49:05.896004 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-0422153e-c740-4385-a597-c3b9d32c0642 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.150653 Jul 11 11:49:05.896572 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1414/2837] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:49:05 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:49:06.597751 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-6e7112e3-b86f-49b5-a087-7b0e59e03ad1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:49:06.598353 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-6e7112e3-b86f-49b5-a087-7b0e59e03ad1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:49:06.605278 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6e7112e3-b86f-49b5-a087-7b0e59e03ad1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:06.605726 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6e7112e3-b86f-49b5-a087-7b0e59e03ad1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:06.606475 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6e7112e3-b86f-49b5-a087-7b0e59e03ad1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:06.606909 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6e7112e3-b86f-49b5-a087-7b0e59e03ad1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:06.665877 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-6e7112e3-b86f-49b5-a087-7b0e59e03ad1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:49:06.676438 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-6e7112e3-b86f-49b5-a087-7b0e59e03ad1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.082508 Jul 11 11:49:06.677002 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1424/2838] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:49:06 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:49:06.913480 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-306fe68c-806a-4f50-955f-edd36d203812 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:49:06.914061 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-306fe68c-806a-4f50-955f-edd36d203812 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:49:06.920479 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-306fe68c-806a-4f50-955f-edd36d203812 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:06.920936 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-306fe68c-806a-4f50-955f-edd36d203812 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:06.921697 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-306fe68c-806a-4f50-955f-edd36d203812 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:06.922132 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-306fe68c-806a-4f50-955f-edd36d203812 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:07.053331 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-306fe68c-806a-4f50-955f-edd36d203812 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:49:07.061789 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-306fe68c-806a-4f50-955f-edd36d203812 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.152272 Jul 11 11:49:07.062355 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1415/2839] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:49:06 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:49:07.693331 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-08559ccd-5712-41fd-8a6c-155a50f10d34 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:49:07.693945 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-08559ccd-5712-41fd-8a6c-155a50f10d34 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:49:07.700799 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-08559ccd-5712-41fd-8a6c-155a50f10d34 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:07.701251 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-08559ccd-5712-41fd-8a6c-155a50f10d34 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:07.702015 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-08559ccd-5712-41fd-8a6c-155a50f10d34 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:07.702451 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-08559ccd-5712-41fd-8a6c-155a50f10d34 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:07.763054 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-08559ccd-5712-41fd-8a6c-155a50f10d34 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:49:07.770980 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-08559ccd-5712-41fd-8a6c-155a50f10d34 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.081597 Jul 11 11:49:07.771588 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1425/2840] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:49:07 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:49:08.078706 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-48b83fd8-9f76-4487-a021-6a7479adbf8d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:49:08.079338 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-48b83fd8-9f76-4487-a021-6a7479adbf8d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:49:08.085721 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-48b83fd8-9f76-4487-a021-6a7479adbf8d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:08.086162 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-48b83fd8-9f76-4487-a021-6a7479adbf8d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:08.086906 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-48b83fd8-9f76-4487-a021-6a7479adbf8d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:08.087357 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-48b83fd8-9f76-4487-a021-6a7479adbf8d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:08.215956 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-48b83fd8-9f76-4487-a021-6a7479adbf8d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:49:08.223718 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-48b83fd8-9f76-4487-a021-6a7479adbf8d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.148839 Jul 11 11:49:08.224286 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1416/2841] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:49:08 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:49:08.788491 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-3caf0451-84e5-4e49-9a1e-ee5438bcea7f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:49:08.789145 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-3caf0451-84e5-4e49-9a1e-ee5438bcea7f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:49:08.796466 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3caf0451-84e5-4e49-9a1e-ee5438bcea7f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:08.796920 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3caf0451-84e5-4e49-9a1e-ee5438bcea7f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:08.797684 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3caf0451-84e5-4e49-9a1e-ee5438bcea7f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:08.798124 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3caf0451-84e5-4e49-9a1e-ee5438bcea7f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:08.861297 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-3caf0451-84e5-4e49-9a1e-ee5438bcea7f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:49:08.869156 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-3caf0451-84e5-4e49-9a1e-ee5438bcea7f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.084528 Jul 11 11:49:08.869744 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1426/2842] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:49:08 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:49:09.240840 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-2994181b-fb41-4e1e-993d-fa1f9038c898 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:49:09.241447 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-2994181b-fb41-4e1e-993d-fa1f9038c898 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:49:09.248343 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2994181b-fb41-4e1e-993d-fa1f9038c898 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:09.248788 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2994181b-fb41-4e1e-993d-fa1f9038c898 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:09.249543 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2994181b-fb41-4e1e-993d-fa1f9038c898 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:09.249965 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2994181b-fb41-4e1e-993d-fa1f9038c898 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:09.377709 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-2994181b-fb41-4e1e-993d-fa1f9038c898 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:49:09.385459 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-2994181b-fb41-4e1e-993d-fa1f9038c898 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.148448 Jul 11 11:49:09.387486 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1417/2843] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:49:09 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:49:09.890868 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-0fa12f9d-2063-43a5-9073-db20c1c6a738 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:49:09.890868 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-0fa12f9d-2063-43a5-9073-db20c1c6a738 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:49:09.892968 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0fa12f9d-2063-43a5-9073-db20c1c6a738 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:09.893445 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0fa12f9d-2063-43a5-9073-db20c1c6a738 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:09.894202 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0fa12f9d-2063-43a5-9073-db20c1c6a738 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:09.894641 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0fa12f9d-2063-43a5-9073-db20c1c6a738 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:09.956209 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-0fa12f9d-2063-43a5-9073-db20c1c6a738 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:49:09.964481 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-0fa12f9d-2063-43a5-9073-db20c1c6a738 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.081955 Jul 11 11:49:09.965062 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1427/2844] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:49:09 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:49:10.402489 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-dca896ec-68ee-4136-b5ae-e4a34c1daac2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:49:10.403112 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-dca896ec-68ee-4136-b5ae-e4a34c1daac2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:49:10.409491 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-dca896ec-68ee-4136-b5ae-e4a34c1daac2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:10.409933 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-dca896ec-68ee-4136-b5ae-e4a34c1daac2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:10.410682 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-dca896ec-68ee-4136-b5ae-e4a34c1daac2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:10.411115 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-dca896ec-68ee-4136-b5ae-e4a34c1daac2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:10.536984 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-dca896ec-68ee-4136-b5ae-e4a34c1daac2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:49:10.544801 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-dca896ec-68ee-4136-b5ae-e4a34c1daac2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.146814 Jul 11 11:49:10.545364 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1418/2845] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:49:10 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:49:10.981477 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-51f24ade-03ab-4dd7-94a1-b042f6ce949d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:49:10.982097 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-51f24ade-03ab-4dd7-94a1-b042f6ce949d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:49:10.988765 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-51f24ade-03ab-4dd7-94a1-b042f6ce949d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:10.989238 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-51f24ade-03ab-4dd7-94a1-b042f6ce949d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:10.989979 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-51f24ade-03ab-4dd7-94a1-b042f6ce949d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:10.990419 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-51f24ade-03ab-4dd7-94a1-b042f6ce949d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:11.057015 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-51f24ade-03ab-4dd7-94a1-b042f6ce949d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:49:11.064973 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-51f24ade-03ab-4dd7-94a1-b042f6ce949d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.087378 Jul 11 11:49:11.065539 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1428/2846] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:49:10 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:49:11.563220 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-0c43e181-df42-4799-83f0-d2c082cb77ce tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:49:11.563855 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-0c43e181-df42-4799-83f0-d2c082cb77ce tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:49:11.570306 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0c43e181-df42-4799-83f0-d2c082cb77ce tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:11.570752 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0c43e181-df42-4799-83f0-d2c082cb77ce tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:11.571554 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0c43e181-df42-4799-83f0-d2c082cb77ce tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:11.571991 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0c43e181-df42-4799-83f0-d2c082cb77ce tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:11.701317 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-0c43e181-df42-4799-83f0-d2c082cb77ce tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:49:11.709082 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-0c43e181-df42-4799-83f0-d2c082cb77ce tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.151169 Jul 11 11:49:11.709657 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1419/2847] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:49:11 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:49:12.081717 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-6d319261-e506-4a76-9a0a-34762dd4a47f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:49:12.082320 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-6d319261-e506-4a76-9a0a-34762dd4a47f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:49:12.088845 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6d319261-e506-4a76-9a0a-34762dd4a47f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:12.089792 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6d319261-e506-4a76-9a0a-34762dd4a47f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:12.090544 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6d319261-e506-4a76-9a0a-34762dd4a47f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:12.090974 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6d319261-e506-4a76-9a0a-34762dd4a47f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:12.151222 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-6d319261-e506-4a76-9a0a-34762dd4a47f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:49:12.159560 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-6d319261-e506-4a76-9a0a-34762dd4a47f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.081633 Jul 11 11:49:12.160120 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1429/2848] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:49:12 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:49:12.725451 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-9785bcc9-6edd-44c0-a167-a050e2859dc9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:49:12.726065 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-9785bcc9-6edd-44c0-a167-a050e2859dc9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:49:12.733052 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9785bcc9-6edd-44c0-a167-a050e2859dc9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:12.733503 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9785bcc9-6edd-44c0-a167-a050e2859dc9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:12.734254 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9785bcc9-6edd-44c0-a167-a050e2859dc9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:12.734688 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9785bcc9-6edd-44c0-a167-a050e2859dc9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:12.861211 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-9785bcc9-6edd-44c0-a167-a050e2859dc9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:49:12.869177 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-9785bcc9-6edd-44c0-a167-a050e2859dc9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.147577 Jul 11 11:49:12.869921 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1420/2849] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:49:12 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:49:13.176958 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-e30ced65-cbbe-4193-8725-131c17e454f2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:49:13.177572 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-e30ced65-cbbe-4193-8725-131c17e454f2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:49:13.184227 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e30ced65-cbbe-4193-8725-131c17e454f2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:13.184679 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e30ced65-cbbe-4193-8725-131c17e454f2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:13.185478 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e30ced65-cbbe-4193-8725-131c17e454f2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:13.185936 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e30ced65-cbbe-4193-8725-131c17e454f2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:13.250817 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-e30ced65-cbbe-4193-8725-131c17e454f2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:49:13.258615 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-e30ced65-cbbe-4193-8725-131c17e454f2 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.085493 Jul 11 11:49:13.259182 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1430/2850] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:49:13 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:49:13.885856 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-d6414c17-40d2-42ea-a95e-adbdb403a756 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:49:13.886473 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-d6414c17-40d2-42ea-a95e-adbdb403a756 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:49:13.893009 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d6414c17-40d2-42ea-a95e-adbdb403a756 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:13.893453 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d6414c17-40d2-42ea-a95e-adbdb403a756 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:13.894195 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d6414c17-40d2-42ea-a95e-adbdb403a756 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:13.894621 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d6414c17-40d2-42ea-a95e-adbdb403a756 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:14.024995 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-d6414c17-40d2-42ea-a95e-adbdb403a756 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:49:14.033156 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-d6414c17-40d2-42ea-a95e-adbdb403a756 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.151126 Jul 11 11:49:14.034093 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1421/2851] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:49:13 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:49:14.275919 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-932f2748-8384-404c-9e83-e56be7f1dbae tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:49:14.277053 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-932f2748-8384-404c-9e83-e56be7f1dbae tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:49:14.283622 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-932f2748-8384-404c-9e83-e56be7f1dbae tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:14.284069 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-932f2748-8384-404c-9e83-e56be7f1dbae tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:14.284817 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-932f2748-8384-404c-9e83-e56be7f1dbae tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:14.285243 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-932f2748-8384-404c-9e83-e56be7f1dbae tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:14.345783 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-932f2748-8384-404c-9e83-e56be7f1dbae tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:49:14.353537 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-932f2748-8384-404c-9e83-e56be7f1dbae tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 200 len: 1368 microversion: 2.1 time: 0.081445 Jul 11 11:49:14.354102 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1431/2852] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:49:14 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:49:14.370830 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-a0cf1cfe-4a16-4a25-85f7-ea4edade8783 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '.version_select at 0x7fb0102cd790>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:49:14.445128 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-a0cf1cfe-4a16-4a25-85f7-ea4edade8783 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-848852803" status: 202 len: 0 microversion: 2.1 time: 0.078128 Jul 11 11:49:14.445720 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1422/2853] 10.222.0.26 () {58 vars in 1217 bytes} [Mon Jul 11 11:49:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-848852803 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 11:49:15.051735 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-cb524aac-9b33-4073-bbd6-7c2bc23e4b2d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:49:15.052441 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-cb524aac-9b33-4073-bbd6-7c2bc23e4b2d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:49:15.059310 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cb524aac-9b33-4073-bbd6-7c2bc23e4b2d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:15.059760 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cb524aac-9b33-4073-bbd6-7c2bc23e4b2d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:15.060524 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cb524aac-9b33-4073-bbd6-7c2bc23e4b2d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:15.060956 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cb524aac-9b33-4073-bbd6-7c2bc23e4b2d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:15.286145 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-cb524aac-9b33-4073-bbd6-7c2bc23e4b2d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:49:15.295361 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-cb524aac-9b33-4073-bbd6-7c2bc23e4b2d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.247666 Jul 11 11:49:15.295934 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1432/2854] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:49:15 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:49:15.480645 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-9df504a1-6379-446c-ae8a-8a4cd996b4a3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Action: 'create', calling method: .version_select at 0x7fb01001b820>, body: {"keypair": {"name": "tempest-keypair-1587471309", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNFqTjWyvpKiFwaAbweIFSrcPYP877+ivgaP+aXi57E1WtQz9zlws4vRwPgNpI42jfIIuwnoc1tyfB1vp1VvoMT/f+WmG+EXnJacAYbok0umdQF3ql3/sKJdICFCQCCArA=="}} {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:49:15.498322 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.quota [None req-9df504a1-6379-446c-ae8a-8a4cd996b4a3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Getting quotas for project 5779b0ffa2244901a92adbee65b10421. Resources: {'key_pairs'} {{(pid=118321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 11:49:15.502837 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.quota [None req-9df504a1-6379-446c-ae8a-8a4cd996b4a3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Getting quotas for user 15ff2cacb5c1450482597a2f5fa3c8a9 and project 5779b0ffa2244901a92adbee65b10421. Resources: {'key_pairs'} {{(pid=118321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 11:49:15.588240 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-9df504a1-6379-446c-ae8a-8a4cd996b4a3 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.112003 Jul 11 11:49:15.588922 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1423/2855] 10.222.0.26 () {60 vars in 1158 bytes} [Mon Jul 11 11:49:15 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:49:16.316575 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-3069d4d2-b5c8-42dc-be67-364aaa67aed8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:49:16.317193 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-3069d4d2-b5c8-42dc-be67-364aaa67aed8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:49:16.323566 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3069d4d2-b5c8-42dc-be67-364aaa67aed8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:16.324016 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3069d4d2-b5c8-42dc-be67-364aaa67aed8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:16.324777 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3069d4d2-b5c8-42dc-be67-364aaa67aed8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:16.325270 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3069d4d2-b5c8-42dc-be67-364aaa67aed8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:16.515718 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-3069d4d2-b5c8-42dc-be67-364aaa67aed8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:49:16.523645 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-3069d4d2-b5c8-42dc-be67-364aaa67aed8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.210992 Jul 11 11:49:16.524220 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1433/2856] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:49:16 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:49:17.541491 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-e6951d40-20e4-4664-91bd-d71a4c75bdf8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:49:17.542135 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-e6951d40-20e4-4664-91bd-d71a4c75bdf8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:49:17.548560 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e6951d40-20e4-4664-91bd-d71a4c75bdf8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:17.549012 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e6951d40-20e4-4664-91bd-d71a4c75bdf8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:17.549770 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e6951d40-20e4-4664-91bd-d71a4c75bdf8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:17.550205 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e6951d40-20e4-4664-91bd-d71a4c75bdf8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:17.697928 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-e6951d40-20e4-4664-91bd-d71a4c75bdf8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:49:17.706189 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-e6951d40-20e4-4664-91bd-d71a4c75bdf8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.168605 Jul 11 11:49:17.711834 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1424/2857] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:49:17 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:49:17.759301 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-646f6f76-23e5-49b5-8544-5481bdf9f9f1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:49:17.759879 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-646f6f76-23e5-49b5-8544-5481bdf9f9f1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: f4031167-4227-4699-bbcf-d0bec5e3ca8b] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:49:17.766344 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-646f6f76-23e5-49b5-8544-5481bdf9f9f1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:17.766798 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-646f6f76-23e5-49b5-8544-5481bdf9f9f1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:17.767587 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-646f6f76-23e5-49b5-8544-5481bdf9f9f1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:17.768023 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-646f6f76-23e5-49b5-8544-5481bdf9f9f1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:17.789781 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.wsgi [None req-646f6f76-23e5-49b5-8544-5481bdf9f9f1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] HTTP exception thrown: Instance f4031167-4227-4699-bbcf-d0bec5e3ca8b could not be found. Jul 11 11:49:17.792312 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-646f6f76-23e5-49b5-8544-5481bdf9f9f1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Request method failure captured: Jul 11 11:49:17.792312 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: request: DELETE /compute/v2.1/servers/f4031167-4227-4699-bbcf-d0bec5e3ca8b HTTP/1.1 Jul 11 11:49:17.792312 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Accept: application/json Jul 11 11:49:17.792312 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Accept-Encoding: identity Jul 11 11:49:17.792312 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Connection: close Jul 11 11:49:17.792312 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Content-Length: 0 Jul 11 11:49:17.792312 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Content-Type: application/json Jul 11 11:49:17.792312 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Host: 10.222.0.26 Jul 11 11:49:17.792312 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Openstack-System-Scope: None Jul 11 11:49:17.792312 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: User-Agent: python-urllib3/1.26.9 Jul 11 11:49:17.792312 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Auth-Token: gAAAAABizAjGbyj9-EYsdAofFu2CzO2d59ZW9ABUBAbQnLYnllzeEOzy491jQ4HEpM89bbrLUMplN6mcP6HQ3B1WwP6JVkBcg1zkYwnoXWYRasZ-vSNiHWKxPN1ixhfjDreb4HCRJcBhMJ-WtmjdLoAnivFahEDeMkVzqUGoMBW-7rS50fYCH-4 Jul 11 11:49:17.792312 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Domain-Id: None Jul 11 11:49:17.792312 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Domain-Name: None Jul 11 11:49:17.792312 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Identity-Status: Confirmed Jul 11 11:49:17.792312 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Is-Admin-Project: True Jul 11 11:49:17.792312 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Openstack-Nova-Api-Version: 2.20 Jul 11 11:49:17.792312 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Domain-Id: default Jul 11 11:49:17.792312 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Domain-Name: Default Jul 11 11:49:17.792312 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Id: 876864a8f283481a81ee65a1c97d0f4f Jul 11 11:49:17.792312 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-30953492 Jul 11 11:49:17.792312 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Role: member,reader Jul 11 11:49:17.792312 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Roles: member,reader Jul 11 11:49:17.794192 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_876864a8f283481a81ee65a1c97d0f4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/876864a8f283481a81ee65a1c97d0f4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/876864a8f283481a81ee65a1c97d0f4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/876864a8f283481a81ee65a1c97d0f4f"}]}] Jul 11 11:49:17.794192 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Tenant: tempest-AttachVolumeShelveTestJSON-30953492 Jul 11 11:49:17.794192 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Tenant-Id: 876864a8f283481a81ee65a1c97d0f4f Jul 11 11:49:17.794192 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-30953492 Jul 11 11:49:17.794192 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User: tempest-AttachVolumeShelveTestJSON-30953492-project Jul 11 11:49:17.794192 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Domain-Id: default Jul 11 11:49:17.794192 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Domain-Name: Default Jul 11 11:49:17.794192 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Id: 993a59e8746948ab8a0f11d877314e02 Jul 11 11:49:17.794192 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Name: tempest-AttachVolumeShelveTestJSON-30953492-project Jul 11 11:49:17.794192 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: method: > Jul 11 11:49:17.794192 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: exception: Instance f4031167-4227-4699-bbcf-d0bec5e3ca8b could not be found. Jul 11 11:49:17.794192 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: action_args: {'id': 'f4031167-4227-4699-bbcf-d0bec5e3ca8b'} Jul 11 11:49:17.795078 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 11:49:17.795078 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:49:17.795078 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 11:49:17.795078 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 11:49:17.795078 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 11:49:17.795078 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 11:49:17.795078 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 11:49:17.795078 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 11:49:17.795078 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 11:49:17.795078 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 11:49:17.795078 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4031167-4227-4699-bbcf-d0bec5e3ca8b could not be found. Jul 11 11:49:17.795078 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:49:17.795078 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:49:17.795078 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:49:17.795078 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:49:17.795078 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:49:17.795078 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:49:17.795078 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 11:49:17.795078 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 11:49:17.795078 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 11:49:17.796573 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 11:49:17.796573 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 11 11:49:17.796573 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 11 11:49:17.796573 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 11 11:49:17.796573 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 11 11:49:17.796573 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 11:49:17.796573 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 11:49:17.796573 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 11:49:17.796573 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 11:49:17.796573 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4031167-4227-4699-bbcf-d0bec5e3ca8b could not be found. Jul 11 11:49:17.796573 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:49:17.796573 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:49:17.796573 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:49:17.796573 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:49:17.796573 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:49:17.796573 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:49:17.796573 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 11:49:17.796573 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 11:49:17.796573 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4031167-4227-4699-bbcf-d0bec5e3ca8b could not be found. Jul 11 11:49:17.796573 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:49:17.799273 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-646f6f76-23e5-49b5-8544-5481bdf9f9f1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Returning 404 to user: Instance f4031167-4227-4699-bbcf-d0bec5e3ca8b could not be found. {{(pid=118322) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 11:49:17.799273 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-646f6f76-23e5-49b5-8544-5481bdf9f9f1 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f4031167-4227-4699-bbcf-d0bec5e3ca8b" status: 404 len: 111 microversion: 2.20 time: 0.038479 Jul 11 11:49:17.799273 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1434/2858] 10.222.0.26 () {60 vars in 1279 bytes} [Mon Jul 11 11:49:17 2022] DELETE /compute/v2.1/servers/f4031167-4227-4699-bbcf-d0bec5e3ca8b => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 11 11:49:17.804654 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-5f69dc7f-62f8-4bdd-9b26-5f1d891b7e95 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:49:17.805647 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-5f69dc7f-62f8-4bdd-9b26-5f1d891b7e95 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: f4031167-4227-4699-bbcf-d0bec5e3ca8b] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:49:17.816001 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5f69dc7f-62f8-4bdd-9b26-5f1d891b7e95 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:17.816001 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5f69dc7f-62f8-4bdd-9b26-5f1d891b7e95 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:17.816001 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5f69dc7f-62f8-4bdd-9b26-5f1d891b7e95 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:17.816001 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5f69dc7f-62f8-4bdd-9b26-5f1d891b7e95 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:17.830754 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.wsgi [None req-5f69dc7f-62f8-4bdd-9b26-5f1d891b7e95 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] HTTP exception thrown: Instance f4031167-4227-4699-bbcf-d0bec5e3ca8b could not be found. Jul 11 11:49:17.833194 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-5f69dc7f-62f8-4bdd-9b26-5f1d891b7e95 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Request method failure captured: Jul 11 11:49:17.833194 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: request: GET /compute/v2.1/servers/f4031167-4227-4699-bbcf-d0bec5e3ca8b HTTP/1.1 Jul 11 11:49:17.833194 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Accept: application/json Jul 11 11:49:17.833194 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Accept-Encoding: identity Jul 11 11:49:17.833194 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Connection: close Jul 11 11:49:17.833194 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Content-Length: 0 Jul 11 11:49:17.833194 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Content-Type: application/json Jul 11 11:49:17.833194 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Host: 10.222.0.26 Jul 11 11:49:17.833194 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Openstack-System-Scope: None Jul 11 11:49:17.833194 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: User-Agent: python-urllib3/1.26.9 Jul 11 11:49:17.833194 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Auth-Token: gAAAAABizAjGbyj9-EYsdAofFu2CzO2d59ZW9ABUBAbQnLYnllzeEOzy491jQ4HEpM89bbrLUMplN6mcP6HQ3B1WwP6JVkBcg1zkYwnoXWYRasZ-vSNiHWKxPN1ixhfjDreb4HCRJcBhMJ-WtmjdLoAnivFahEDeMkVzqUGoMBW-7rS50fYCH-4 Jul 11 11:49:17.833194 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Domain-Id: None Jul 11 11:49:17.833194 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Domain-Name: None Jul 11 11:49:17.833194 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Identity-Status: Confirmed Jul 11 11:49:17.833194 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Is-Admin-Project: True Jul 11 11:49:17.833194 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Openstack-Nova-Api-Version: 2.20 Jul 11 11:49:17.833194 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Domain-Id: default Jul 11 11:49:17.833194 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Domain-Name: Default Jul 11 11:49:17.833194 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Id: 876864a8f283481a81ee65a1c97d0f4f Jul 11 11:49:17.833194 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-30953492 Jul 11 11:49:17.833194 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Role: member,reader Jul 11 11:49:17.833194 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Roles: member,reader Jul 11 11:49:17.835044 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_876864a8f283481a81ee65a1c97d0f4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/876864a8f283481a81ee65a1c97d0f4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/876864a8f283481a81ee65a1c97d0f4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/876864a8f283481a81ee65a1c97d0f4f"}]}] Jul 11 11:49:17.835044 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Tenant: tempest-AttachVolumeShelveTestJSON-30953492 Jul 11 11:49:17.835044 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Tenant-Id: 876864a8f283481a81ee65a1c97d0f4f Jul 11 11:49:17.835044 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-30953492 Jul 11 11:49:17.835044 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User: tempest-AttachVolumeShelveTestJSON-30953492-project Jul 11 11:49:17.835044 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Domain-Id: default Jul 11 11:49:17.835044 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Domain-Name: Default Jul 11 11:49:17.835044 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Id: 993a59e8746948ab8a0f11d877314e02 Jul 11 11:49:17.835044 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Name: tempest-AttachVolumeShelveTestJSON-30953492-project Jul 11 11:49:17.835044 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: method: > Jul 11 11:49:17.835044 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: exception: Instance f4031167-4227-4699-bbcf-d0bec5e3ca8b could not be found. Jul 11 11:49:17.835044 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: action_args: {'id': 'f4031167-4227-4699-bbcf-d0bec5e3ca8b'} Jul 11 11:49:17.836067 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 11:49:17.836067 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:49:17.836067 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 11:49:17.836067 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 11:49:17.836067 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 11:49:17.836067 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 11:49:17.836067 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 11:49:17.836067 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 11:49:17.836067 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 11:49:17.836067 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 11:49:17.836067 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4031167-4227-4699-bbcf-d0bec5e3ca8b could not be found. Jul 11 11:49:17.836067 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:49:17.836067 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:49:17.836067 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:49:17.836067 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:49:17.836067 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:49:17.836067 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:49:17.836067 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 11:49:17.836067 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 11:49:17.836067 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 11:49:17.837642 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 11:49:17.837642 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 11:49:17.837642 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 11:49:17.837642 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 11:49:17.837642 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 11:49:17.837642 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 11:49:17.837642 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 11:49:17.837642 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4031167-4227-4699-bbcf-d0bec5e3ca8b could not be found. Jul 11 11:49:17.837642 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:49:17.837642 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:49:17.837642 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:49:17.837642 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:49:17.837642 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:49:17.837642 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:49:17.837642 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 11:49:17.837642 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 11:49:17.837642 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4031167-4227-4699-bbcf-d0bec5e3ca8b could not be found. Jul 11 11:49:17.837642 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:49:17.839057 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-5f69dc7f-62f8-4bdd-9b26-5f1d891b7e95 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Returning 404 to user: Instance f4031167-4227-4699-bbcf-d0bec5e3ca8b could not be found. {{(pid=118321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 11:49:17.839057 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-5f69dc7f-62f8-4bdd-9b26-5f1d891b7e95 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/f4031167-4227-4699-bbcf-d0bec5e3ca8b" status: 404 len: 111 microversion: 2.20 time: 0.036358 Jul 11 11:49:17.840331 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1425/2859] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:49:17 2022] GET /compute/v2.1/servers/f4031167-4227-4699-bbcf-d0bec5e3ca8b => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 11 11:49:17.864732 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-146298d4-2ff4-453c-9c92-1ee9b15e685f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-271056565", "imageRef": "1bb93fc1-b713-4e67-8f76-bfec3a96168b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dc5b5fb4-7eaf-48cc-a935-f2b28a6703f4"}], "security_groups": [{"name": "tempest-securitygroup--951266826"}], "key_name": "tempest-keypair-1587471309", "user_data": "}} {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:49:17.965767 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.network.neutron [None req-146298d4-2ff4-453c-9c92-1ee9b15e685f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] validate_networks() for [('dc5b5fb4-7eaf-48cc-a935-f2b28a6703f4', None, None, None, None, None)] {{(pid=118322) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 11:49:18.380417 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.virt.hardware [None req-146298d4-2ff4-453c-9c92-1ee9b15e685f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Flavor limits 0:0:0 {{(pid=118322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 11:49:18.380838 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.virt.hardware [None req-146298d4-2ff4-453c-9c92-1ee9b15e685f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Image limits 0:0:0 {{(pid=118322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 11:49:18.381453 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.virt.hardware [None req-146298d4-2ff4-453c-9c92-1ee9b15e685f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Flavor pref 0:0:0 {{(pid=118322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 11:49:18.381859 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.virt.hardware [None req-146298d4-2ff4-453c-9c92-1ee9b15e685f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Image pref 0:0:0 {{(pid=118322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 11:49:18.382301 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.virt.hardware [None req-146298d4-2ff4-453c-9c92-1ee9b15e685f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 11:49:18.391690 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-146298d4-2ff4-453c-9c92-1ee9b15e685f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:18.395272 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-146298d4-2ff4-453c-9c92-1ee9b15e685f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:18.395272 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-146298d4-2ff4-453c-9c92-1ee9b15e685f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:18.395272 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-146298d4-2ff4-453c-9c92-1ee9b15e685f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:18.410293 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.quota [None req-146298d4-2ff4-453c-9c92-1ee9b15e685f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Getting quotas for project 5779b0ffa2244901a92adbee65b10421. Resources: {'cores', 'ram', 'instances'} {{(pid=118322) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 11:49:18.414298 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.quota [None req-146298d4-2ff4-453c-9c92-1ee9b15e685f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Getting quotas for user 15ff2cacb5c1450482597a2f5fa3c8a9 and project 5779b0ffa2244901a92adbee65b10421. Resources: {'cores', 'ram', 'instances'} {{(pid=118322) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 11:49:18.425163 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-146298d4-2ff4-453c-9c92-1ee9b15e685f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Going to run 1 instances... {{(pid=118322) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 11:49:18.427437 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-146298d4-2ff4-453c-9c92-1ee9b15e685f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 67e104da-8254-4f6d-aed9-c0bbe8f53c80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb93fc1-b713-4e67-8f76-bfec3a96168b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118322) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 11:49:18.521147 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-146298d4-2ff4-453c-9c92-1ee9b15e685f tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.660754 Jul 11 11:49:18.521796 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1435/2860] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jul 11 11:49:17 2022] POST /compute/v2.1/servers => generated 401 bytes in 662 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 11 11:49:18.532072 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-841eff38-6105-475f-a129-94865f017556 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:49:18.532724 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-841eff38-6105-475f-a129-94865f017556 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 67e104da-8254-4f6d-aed9-c0bbe8f53c80] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:49:18.588145 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-841eff38-6105-475f-a129-94865f017556 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:49:18.595332 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-841eff38-6105-475f-a129-94865f017556 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/67e104da-8254-4f6d-aed9-c0bbe8f53c80" status: 200 len: 1237 microversion: 2.1 time: 0.066980 Jul 11 11:49:18.595925 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1426/2861] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:49:18 2022] GET /compute/v2.1/servers/67e104da-8254-4f6d-aed9-c0bbe8f53c80 => generated 1237 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:49:18.726771 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-4740fb66-8f5f-4585-960a-6138b0e11eae tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:49:18.727420 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-4740fb66-8f5f-4585-960a-6138b0e11eae tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:49:18.733509 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4740fb66-8f5f-4585-960a-6138b0e11eae tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:18.733951 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4740fb66-8f5f-4585-960a-6138b0e11eae tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:18.734698 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4740fb66-8f5f-4585-960a-6138b0e11eae tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:18.735125 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4740fb66-8f5f-4585-960a-6138b0e11eae tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:18.738983 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=100 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:49:18.867830 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-4740fb66-8f5f-4585-960a-6138b0e11eae tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:49:18.876645 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-4740fb66-8f5f-4585-960a-6138b0e11eae tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.153647 Jul 11 11:49:18.877244 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1436/2862] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:49:18 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:49:19.612332 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-2272f9cc-89c0-4c34-a2b2-d964e6f0e653 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:49:19.612942 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-2272f9cc-89c0-4c34-a2b2-d964e6f0e653 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 67e104da-8254-4f6d-aed9-c0bbe8f53c80] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:49:19.620839 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2272f9cc-89c0-4c34-a2b2-d964e6f0e653 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:19.621381 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2272f9cc-89c0-4c34-a2b2-d964e6f0e653 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:19.622115 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2272f9cc-89c0-4c34-a2b2-d964e6f0e653 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:19.622552 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2272f9cc-89c0-4c34-a2b2-d964e6f0e653 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:19.684356 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-2272f9cc-89c0-4c34-a2b2-d964e6f0e653 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:49:19.686488 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=100 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:49:19.692378 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-2272f9cc-89c0-4c34-a2b2-d964e6f0e653 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/67e104da-8254-4f6d-aed9-c0bbe8f53c80" status: 200 len: 1241 microversion: 2.1 time: 0.083966 Jul 11 11:49:19.692946 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1427/2863] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:49:19 2022] GET /compute/v2.1/servers/67e104da-8254-4f6d-aed9-c0bbe8f53c80 => generated 1241 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:49:19.895129 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-ac030d1c-e9c7-4894-a4eb-f0c0754df9e4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:49:19.895742 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-ac030d1c-e9c7-4894-a4eb-f0c0754df9e4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:49:19.902155 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ac030d1c-e9c7-4894-a4eb-f0c0754df9e4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:19.902610 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ac030d1c-e9c7-4894-a4eb-f0c0754df9e4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:19.903405 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ac030d1c-e9c7-4894-a4eb-f0c0754df9e4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:19.903863 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ac030d1c-e9c7-4894-a4eb-f0c0754df9e4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:20.031795 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-ac030d1c-e9c7-4894-a4eb-f0c0754df9e4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:49:20.039614 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-ac030d1c-e9c7-4894-a4eb-f0c0754df9e4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.148467 Jul 11 11:49:20.040191 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1437/2864] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:49:19 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:49:20.711001 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-767311ae-e47d-4900-a0c6-5acbf3bf5586 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:49:20.711694 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-767311ae-e47d-4900-a0c6-5acbf3bf5586 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 67e104da-8254-4f6d-aed9-c0bbe8f53c80] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:49:20.719284 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-767311ae-e47d-4900-a0c6-5acbf3bf5586 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:20.719746 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-767311ae-e47d-4900-a0c6-5acbf3bf5586 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:20.720494 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-767311ae-e47d-4900-a0c6-5acbf3bf5586 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:20.720926 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-767311ae-e47d-4900-a0c6-5acbf3bf5586 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:20.811474 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-767311ae-e47d-4900-a0c6-5acbf3bf5586 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:49:20.818793 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-767311ae-e47d-4900-a0c6-5acbf3bf5586 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/67e104da-8254-4f6d-aed9-c0bbe8f53c80" status: 200 len: 1295 microversion: 2.1 time: 0.112688 Jul 11 11:49:20.819383 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1428/2865] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:49:20 2022] GET /compute/v2.1/servers/67e104da-8254-4f6d-aed9-c0bbe8f53c80 => generated 1295 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:49:21.059614 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-d84e466b-9d77-440d-9211-51eb2b9d75ac tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:49:21.060203 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-d84e466b-9d77-440d-9211-51eb2b9d75ac tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:49:21.066409 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d84e466b-9d77-440d-9211-51eb2b9d75ac tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:21.066860 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d84e466b-9d77-440d-9211-51eb2b9d75ac tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:21.067654 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d84e466b-9d77-440d-9211-51eb2b9d75ac tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:21.068081 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d84e466b-9d77-440d-9211-51eb2b9d75ac tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:21.213611 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-d84e466b-9d77-440d-9211-51eb2b9d75ac tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:49:21.221918 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-d84e466b-9d77-440d-9211-51eb2b9d75ac tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.166970 Jul 11 11:49:21.222686 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1438/2866] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:49:21 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:49:21.836747 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-890f30ac-7499-405d-a74c-129d32708e63 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:49:21.837374 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-890f30ac-7499-405d-a74c-129d32708e63 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 67e104da-8254-4f6d-aed9-c0bbe8f53c80] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:49:21.844398 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-890f30ac-7499-405d-a74c-129d32708e63 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:21.844846 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-890f30ac-7499-405d-a74c-129d32708e63 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:21.845618 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-890f30ac-7499-405d-a74c-129d32708e63 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:21.846083 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-890f30ac-7499-405d-a74c-129d32708e63 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:21.991403 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-890f30ac-7499-405d-a74c-129d32708e63 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:49:21.999429 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-890f30ac-7499-405d-a74c-129d32708e63 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/67e104da-8254-4f6d-aed9-c0bbe8f53c80" status: 200 len: 1362 microversion: 2.1 time: 0.166826 Jul 11 11:49:22.000011 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1429/2867] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:49:21 2022] GET /compute/v2.1/servers/67e104da-8254-4f6d-aed9-c0bbe8f53c80 => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:49:22.105742 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [req-63c57775-3ee4-4e47-ba53-c901a8d0cb82 req-87ee9265-739a-4016-9271-9cd220ca7663 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67e104da-8254-4f6d-aed9-c0bbe8f53c80", "tag": "b78a7de4-f8cd-483a-b39f-9dc04c733e23"}]} {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:49:22.114500 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [req-63c57775-3ee4-4e47-ba53-c901a8d0cb82 req-87ee9265-739a-4016-9271-9cd220ca7663 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:22.114972 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [req-63c57775-3ee4-4e47-ba53-c901a8d0cb82 req-87ee9265-739a-4016-9271-9cd220ca7663 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:22.126214 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.compute.server_external_events [req-63c57775-3ee4-4e47-ba53-c901a8d0cb82 req-87ee9265-739a-4016-9271-9cd220ca7663 service nova] Creating event network-changed:b78a7de4-f8cd-483a-b39f-9dc04c733e23 for instance 67e104da-8254-4f6d-aed9-c0bbe8f53c80 on hv-cinder-84842 Jul 11 11:49:22.129653 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR oslo.messaging._drivers.impl_rabbit [req-63c57775-3ee4-4e47-ba53-c901a8d0cb82 req-87ee9265-739a-4016-9271-9cd220ca7663 service nova] [d5bc59c0-32cd-49ae-8368-816867580e55] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 11 11:49:22.239225 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-97192728-dea5-4de9-8d3d-f7291dd7e261 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:49:22.239859 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-97192728-dea5-4de9-8d3d-f7291dd7e261 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:49:22.245818 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-97192728-dea5-4de9-8d3d-f7291dd7e261 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:22.246261 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-97192728-dea5-4de9-8d3d-f7291dd7e261 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:22.247012 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-97192728-dea5-4de9-8d3d-f7291dd7e261 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:22.247469 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-97192728-dea5-4de9-8d3d-f7291dd7e261 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:22.468950 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-97192728-dea5-4de9-8d3d-f7291dd7e261 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:49:22.476881 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-97192728-dea5-4de9-8d3d-f7291dd7e261 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 200 len: 1730 microversion: 2.1 time: 0.241422 Jul 11 11:49:22.479368 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1430/2868] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:49:22 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 1730 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:49:22.493566 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-de5d04af-6dbd-4187-8a2d-ea9f7c2e26df tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '.version_select at 0x7fb01001b8b0>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:49:22.569886 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-de5d04af-6dbd-4187-8a2d-ea9f7c2e26df tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1812882260" status: 202 len: 0 microversion: 2.1 time: 0.079993 Jul 11 11:49:22.570590 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1431/2869] 10.222.0.26 () {58 vars in 1220 bytes} [Mon Jul 11 11:49:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1812882260 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 11 11:49:22.696965 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-01dc1e28-1cbf-4acd-9683-8274ec842849 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:49:22.699283 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-01dc1e28-1cbf-4acd-9683-8274ec842849 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 1df1a34e-6645-4776-ac7a-a03a47edeebe] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:49:22.705031 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-01dc1e28-1cbf-4acd-9683-8274ec842849 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:22.705481 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-01dc1e28-1cbf-4acd-9683-8274ec842849 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:22.706379 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-01dc1e28-1cbf-4acd-9683-8274ec842849 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:22.706812 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-01dc1e28-1cbf-4acd-9683-8274ec842849 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:22.741104 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-01dc1e28-1cbf-4acd-9683-8274ec842849 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 1df1a34e-6645-4776-ac7a-a03a47edeebe] Going to try to terminate instance {{(pid=118321) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 11:49:22.963345 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-01dc1e28-1cbf-4acd-9683-8274ec842849 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "DELETE /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe" status: 204 len: 0 microversion: 2.1 time: 0.270108 Jul 11 11:49:22.964027 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1432/2870] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 11 11:49:22 2022] DELETE /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 11 11:49:22.975564 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-7038bbb2-10b3-493b-bc06-1f3e01a68831 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:49:22.976270 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-7038bbb2-10b3-493b-bc06-1f3e01a68831 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 1df1a34e-6645-4776-ac7a-a03a47edeebe] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:49:22.982751 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7038bbb2-10b3-493b-bc06-1f3e01a68831 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:22.983201 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7038bbb2-10b3-493b-bc06-1f3e01a68831 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:22.984085 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7038bbb2-10b3-493b-bc06-1f3e01a68831 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:22.984520 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7038bbb2-10b3-493b-bc06-1f3e01a68831 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:23.136318 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO oslo.messaging._drivers.impl_rabbit [req-63c57775-3ee4-4e47-ba53-c901a8d0cb82 req-87ee9265-739a-4016-9271-9cd220ca7663 service nova] [d5bc59c0-32cd-49ae-8368-816867580e55] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 47506. Jul 11 11:49:23.140806 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [req-63c57775-3ee4-4e47-ba53-c901a8d0cb82 req-87ee9265-739a-4016-9271-9cd220ca7663 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.099911 Jul 11 11:49:23.141426 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1439/2871] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 11:49:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:49:23.146870 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-b902870e-7cf6-4c38-a8a3-2e3baa779bb9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:49:23.147597 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-b902870e-7cf6-4c38-a8a3-2e3baa779bb9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 67e104da-8254-4f6d-aed9-c0bbe8f53c80] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:49:23.150093 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-7038bbb2-10b3-493b-bc06-1f3e01a68831 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:49:23.153939 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b902870e-7cf6-4c38-a8a3-2e3baa779bb9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:23.154392 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b902870e-7cf6-4c38-a8a3-2e3baa779bb9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:23.156905 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b902870e-7cf6-4c38-a8a3-2e3baa779bb9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:23.156905 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b902870e-7cf6-4c38-a8a3-2e3baa779bb9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:23.159618 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-7038bbb2-10b3-493b-bc06-1f3e01a68831 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe" status: 200 len: 1507 microversion: 2.1 time: 0.188168 Jul 11 11:49:23.160190 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1433/2872] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:49:22 2022] GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe => generated 1507 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:49:23.290563 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-b902870e-7cf6-4c38-a8a3-2e3baa779bb9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:49:23.298702 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-b902870e-7cf6-4c38-a8a3-2e3baa779bb9 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/67e104da-8254-4f6d-aed9-c0bbe8f53c80" status: 200 len: 1362 microversion: 2.1 time: 0.155988 Jul 11 11:49:23.299292 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1440/2873] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:49:23 2022] GET /compute/v2.1/servers/67e104da-8254-4f6d-aed9-c0bbe8f53c80 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:49:24.177343 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-bf491b00-7497-455c-b4b6-51cbc482e60c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:49:24.178094 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-bf491b00-7497-455c-b4b6-51cbc482e60c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 1df1a34e-6645-4776-ac7a-a03a47edeebe] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:49:24.196037 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-b9ca0e0b-85f4-40ed-90ca-91604dc059aa tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Action: 'create', calling method: .version_select at 0x7fb01049c1f0>, body: {"keypair": {"name": "tempest-keypair-1713052200", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOUhCL23VIXMmarTDGQqam7keA9QjCzO8AQrNHGPfX+6pVkd2KeNz+EpufcnByeyR9osVnqA2btXW98eKBqsRl965Y2iryf5Oj3HBo8O2/N2tCCHqa6Vky1DkWuxCnygvQ=="}} {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:49:24.196644 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bf491b00-7497-455c-b4b6-51cbc482e60c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:24.196777 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bf491b00-7497-455c-b4b6-51cbc482e60c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:24.197823 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bf491b00-7497-455c-b4b6-51cbc482e60c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:24.198824 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bf491b00-7497-455c-b4b6-51cbc482e60c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:24.213928 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.quota [None req-b9ca0e0b-85f4-40ed-90ca-91604dc059aa tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Getting quotas for project 1328a510264f4374baabad7b5243d8c2. Resources: {'key_pairs'} {{(pid=118322) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 11:49:24.218812 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.quota [None req-b9ca0e0b-85f4-40ed-90ca-91604dc059aa tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Getting quotas for user cbcc15c786fb43669ac34a4897735c1d and project 1328a510264f4374baabad7b5243d8c2. Resources: {'key_pairs'} {{(pid=118322) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 11:49:24.319576 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-b9ca0e0b-85f4-40ed-90ca-91604dc059aa tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.127852 Jul 11 11:49:24.320846 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1441/2874] 10.222.0.26 () {60 vars in 1158 bytes} [Mon Jul 11 11:49:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:49:24.326574 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-54563114-07d4-430a-b561-639bf87b128d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:49:24.328017 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-54563114-07d4-430a-b561-639bf87b128d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 67e104da-8254-4f6d-aed9-c0bbe8f53c80] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:49:24.335541 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-54563114-07d4-430a-b561-639bf87b128d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:24.336307 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-54563114-07d4-430a-b561-639bf87b128d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:24.337335 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-54563114-07d4-430a-b561-639bf87b128d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:24.338057 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-54563114-07d4-430a-b561-639bf87b128d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:24.582872 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-bf491b00-7497-455c-b4b6-51cbc482e60c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:49:24.593369 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-bf491b00-7497-455c-b4b6-51cbc482e60c tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe" status: 200 len: 1507 microversion: 2.1 time: 0.419173 Jul 11 11:49:24.603158 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1434/2875] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:49:24 2022] GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe => generated 1507 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:49:24.767587 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-54563114-07d4-430a-b561-639bf87b128d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:49:24.775190 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-54563114-07d4-430a-b561-639bf87b128d tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/67e104da-8254-4f6d-aed9-c0bbe8f53c80" status: 200 len: 1362 microversion: 2.1 time: 0.453069 Jul 11 11:49:24.775743 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1442/2876] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:49:24 2022] GET /compute/v2.1/servers/67e104da-8254-4f6d-aed9-c0bbe8f53c80 => generated 1362 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:49:25.155229 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [req-f1638f40-b54f-42ab-b903-aad6115e2ebc req-5279d684-f0e2-4d65-a338-7fb710e20397 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ae01e39-7148-4e87-9ae0-a95832b38101", "tag": "b54d0e28-6ca3-4d14-ab22-34f6f328aee6"}, {"server_uuid": "1df1a34e-6645-4776-ac7a-a03a47edeebe", "name": "network-vif-deleted", "tag": "65cc413d-9788-4b74-9e0d-f6d26d9bc4f5"}]} {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:49:25.164385 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [req-f1638f40-b54f-42ab-b903-aad6115e2ebc req-5279d684-f0e2-4d65-a338-7fb710e20397 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:25.164819 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [req-f1638f40-b54f-42ab-b903-aad6115e2ebc req-5279d684-f0e2-4d65-a338-7fb710e20397 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:25.177548 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.compute.server_external_events [req-f1638f40-b54f-42ab-b903-aad6115e2ebc req-5279d684-f0e2-4d65-a338-7fb710e20397 service nova] Creating event network-changed:b54d0e28-6ca3-4d14-ab22-34f6f328aee6 for instance 3ae01e39-7148-4e87-9ae0-a95832b38101 on hv-cinder-84842 Jul 11 11:49:25.178144 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.compute.server_external_events [req-f1638f40-b54f-42ab-b903-aad6115e2ebc req-5279d684-f0e2-4d65-a338-7fb710e20397 service nova] Creating event network-vif-deleted:65cc413d-9788-4b74-9e0d-f6d26d9bc4f5 for instance 1df1a34e-6645-4776-ac7a-a03a47edeebe on hv-cinder-84842 Jul 11 11:49:25.184643 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [req-f1638f40-b54f-42ab-b903-aad6115e2ebc req-5279d684-f0e2-4d65-a338-7fb710e20397 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.033726 Jul 11 11:49:25.185317 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1435/2877] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 11:49:25 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:49:25.610379 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-a4f31028-db9d-48b2-89cf-7d00e8ae2798 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:49:25.611133 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-a4f31028-db9d-48b2-89cf-7d00e8ae2798 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 1df1a34e-6645-4776-ac7a-a03a47edeebe] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:49:25.623993 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a4f31028-db9d-48b2-89cf-7d00e8ae2798 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:25.623993 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a4f31028-db9d-48b2-89cf-7d00e8ae2798 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:25.624474 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a4f31028-db9d-48b2-89cf-7d00e8ae2798 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:25.625295 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a4f31028-db9d-48b2-89cf-7d00e8ae2798 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:25.660612 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a4f31028-db9d-48b2-89cf-7d00e8ae2798 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:25.661073 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a4f31028-db9d-48b2-89cf-7d00e8ae2798 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:25.661531 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.objects.instance [None req-a4f31028-db9d-48b2-89cf-7d00e8ae2798 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lazy-loading 'fault' on Instance uuid 1df1a34e-6645-4776-ac7a-a03a47edeebe {{(pid=118322) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 11:49:25.703833 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-a4f31028-db9d-48b2-89cf-7d00e8ae2798 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:49:25.711431 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-a4f31028-db9d-48b2-89cf-7d00e8ae2798 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe" status: 200 len: 1311 microversion: 2.1 time: 0.105072 Jul 11 11:49:25.712010 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1443/2878] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:49:25 2022] GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe => generated 1311 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:49:25.793329 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-874ce8b9-eafa-4e57-a452-9e3762007ea6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:49:25.794020 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-874ce8b9-eafa-4e57-a452-9e3762007ea6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 67e104da-8254-4f6d-aed9-c0bbe8f53c80] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:49:25.797229 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=2,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:49:25.811141 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-874ce8b9-eafa-4e57-a452-9e3762007ea6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:25.812602 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-874ce8b9-eafa-4e57-a452-9e3762007ea6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:25.813597 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-874ce8b9-eafa-4e57-a452-9e3762007ea6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:25.814200 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-874ce8b9-eafa-4e57-a452-9e3762007ea6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:25.988170 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-874ce8b9-eafa-4e57-a452-9e3762007ea6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:49:26.000382 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-874ce8b9-eafa-4e57-a452-9e3762007ea6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/67e104da-8254-4f6d-aed9-c0bbe8f53c80" status: 200 len: 1362 microversion: 2.1 time: 0.211039 Jul 11 11:49:26.001097 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1436/2879] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:49:25 2022] GET /compute/v2.1/servers/67e104da-8254-4f6d-aed9-c0bbe8f53c80 => generated 1362 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:49:26.727586 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-fb4d8f13-aa21-4105-a029-0ed134ce23ee tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:49:26.728207 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-fb4d8f13-aa21-4105-a029-0ed134ce23ee tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: 1df1a34e-6645-4776-ac7a-a03a47edeebe] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:49:26.734760 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fb4d8f13-aa21-4105-a029-0ed134ce23ee tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:26.735214 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fb4d8f13-aa21-4105-a029-0ed134ce23ee tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:26.736004 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fb4d8f13-aa21-4105-a029-0ed134ce23ee tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:26.736447 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fb4d8f13-aa21-4105-a029-0ed134ce23ee tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:26.749467 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.wsgi [None req-fb4d8f13-aa21-4105-a029-0ed134ce23ee tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] HTTP exception thrown: Instance 1df1a34e-6645-4776-ac7a-a03a47edeebe could not be found. Jul 11 11:49:26.751182 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-fb4d8f13-aa21-4105-a029-0ed134ce23ee tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Request method failure captured: Jul 11 11:49:26.751182 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: request: GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe HTTP/1.1 Jul 11 11:49:26.751182 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Accept: application/json Jul 11 11:49:26.751182 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Accept-Encoding: identity Jul 11 11:49:26.751182 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Connection: close Jul 11 11:49:26.751182 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Content-Length: 0 Jul 11 11:49:26.751182 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Content-Type: application/json Jul 11 11:49:26.751182 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Host: 10.222.0.26 Jul 11 11:49:26.751182 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Openstack-System-Scope: None Jul 11 11:49:26.751182 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: User-Agent: python-urllib3/1.26.9 Jul 11 11:49:26.751182 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Auth-Token: gAAAAABizAjAB3ee8Wpq3XhXwIMo2dwj2c7BxlbTsH6D1jW0nrqmMRQaO1vU3fERsJZs92pezfPAJ7yky9TGgSL8Gjc0VXr5ooj5myVwUGnwGNo7XkymuXwDtzAqNhHC0FClHxOsBHOXLYTrPKsTv6dRXKtOUTvNzViNUOSi1yXruxQCnGLZpsY Jul 11 11:49:26.751182 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Domain-Id: None Jul 11 11:49:26.751182 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Domain-Name: None Jul 11 11:49:26.751182 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Identity-Status: Confirmed Jul 11 11:49:26.751182 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Is-Admin-Project: True Jul 11 11:49:26.751182 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Domain-Id: default Jul 11 11:49:26.751182 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Domain-Name: Default Jul 11 11:49:26.751182 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Id: c8639f8c836d4ad79d147b855d9017f8 Jul 11 11:49:26.751182 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-187934667 Jul 11 11:49:26.751182 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Role: member,reader Jul 11 11:49:26.751182 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Roles: member,reader Jul 11 11:49:26.752934 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c8639f8c836d4ad79d147b855d9017f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c8639f8c836d4ad79d147b855d9017f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c8639f8c836d4ad79d147b855d9017f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c8639f8c836d4ad79d147b855d9017f8"}]}] Jul 11 11:49:26.752934 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Tenant: tempest-ServerRescueNegativeTestJSON-187934667 Jul 11 11:49:26.752934 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Tenant-Id: c8639f8c836d4ad79d147b855d9017f8 Jul 11 11:49:26.752934 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-187934667 Jul 11 11:49:26.752934 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User: tempest-ServerRescueNegativeTestJSON-187934667-project Jul 11 11:49:26.752934 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Domain-Id: default Jul 11 11:49:26.752934 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Domain-Name: Default Jul 11 11:49:26.752934 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Id: e47c365946cf4264a2d2205ace04379d Jul 11 11:49:26.752934 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Name: tempest-ServerRescueNegativeTestJSON-187934667-project Jul 11 11:49:26.752934 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: method: > Jul 11 11:49:26.752934 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: exception: Instance 1df1a34e-6645-4776-ac7a-a03a47edeebe could not be found. Jul 11 11:49:26.752934 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: action_args: {'id': '1df1a34e-6645-4776-ac7a-a03a47edeebe'} Jul 11 11:49:26.754178 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 11:49:26.754178 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:49:26.754178 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 11:49:26.754178 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 11:49:26.754178 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 11:49:26.754178 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 11:49:26.754178 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 11:49:26.754178 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 11:49:26.754178 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 11:49:26.754178 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 11:49:26.754178 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1df1a34e-6645-4776-ac7a-a03a47edeebe could not be found. Jul 11 11:49:26.754178 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:49:26.754178 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:49:26.754178 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:49:26.754178 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:49:26.754178 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:49:26.754178 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:49:26.754178 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 11:49:26.754178 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 11:49:26.754178 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 11:49:26.755992 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 11:49:26.755992 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 11:49:26.755992 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 11:49:26.755992 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 11:49:26.755992 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 11:49:26.755992 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 11:49:26.755992 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 11:49:26.755992 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1df1a34e-6645-4776-ac7a-a03a47edeebe could not be found. Jul 11 11:49:26.755992 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:49:26.755992 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:49:26.755992 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:49:26.755992 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:49:26.755992 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:49:26.755992 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:49:26.755992 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 11:49:26.755992 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 11:49:26.755992 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1df1a34e-6645-4776-ac7a-a03a47edeebe could not be found. Jul 11 11:49:26.755992 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:49:26.757465 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-fb4d8f13-aa21-4105-a029-0ed134ce23ee tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Returning 404 to user: Instance 1df1a34e-6645-4776-ac7a-a03a47edeebe could not be found. {{(pid=118322) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 11:49:26.757465 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-fb4d8f13-aa21-4105-a029-0ed134ce23ee tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe" status: 404 len: 111 microversion: 2.1 time: 0.028994 Jul 11 11:49:26.757465 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1444/2880] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:49:26 2022] GET /compute/v2.1/servers/1df1a34e-6645-4776-ac7a-a03a47edeebe => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 11:49:26.761934 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-54cfbb3a-8118-4fe3-b8f7-34453ee0befe tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:49:26.762446 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-54cfbb3a-8118-4fe3-b8f7-34453ee0befe tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: b39fbe8d-e6a4-4482-981f-ac21c2b52176] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:49:26.768651 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-54cfbb3a-8118-4fe3-b8f7-34453ee0befe tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:26.769108 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-54cfbb3a-8118-4fe3-b8f7-34453ee0befe tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:26.769868 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-54cfbb3a-8118-4fe3-b8f7-34453ee0befe tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:26.770308 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-54cfbb3a-8118-4fe3-b8f7-34453ee0befe tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:26.795129 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-54cfbb3a-8118-4fe3-b8f7-34453ee0befe tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: b39fbe8d-e6a4-4482-981f-ac21c2b52176] Going to try to terminate instance {{(pid=118321) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 11:49:26.849991 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-efac9aae-9e84-43e9-b0bd-b0cbd3eac364 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-404509959", "imageRef": "1bb93fc1-b713-4e67-8f76-bfec3a96168b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "415c4ce2-00a4-4e63-ad18-4153e0b2d10b"}], "security_groups": [{"name": "tempest-securitygroup--22246950"}], "key_name": "tempest-keypair-1713052200", "user_data": "}} {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:49:26.856526 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=4 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:49:26.958081 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.network.neutron [None req-efac9aae-9e84-43e9-b0bd-b0cbd3eac364 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] validate_networks() for [('415c4ce2-00a4-4e63-ad18-4153e0b2d10b', None, None, None, None, None)] {{(pid=118322) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 11:49:27.073311 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-54cfbb3a-8118-4fe3-b8f7-34453ee0befe tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b39fbe8d-e6a4-4482-981f-ac21c2b52176" status: 204 len: 0 microversion: 2.1 time: 0.315336 Jul 11 11:49:27.074021 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1437/2881] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 11 11:49:26 2022] DELETE /compute/v2.1/servers/b39fbe8d-e6a4-4482-981f-ac21c2b52176 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 11 11:49:27.080237 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-d9302baa-dde8-4316-bd1c-a609de503b3b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:49:27.080943 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-d9302baa-dde8-4316-bd1c-a609de503b3b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 67e104da-8254-4f6d-aed9-c0bbe8f53c80] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:49:27.087030 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d9302baa-dde8-4316-bd1c-a609de503b3b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:27.087537 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d9302baa-dde8-4316-bd1c-a609de503b3b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:27.088508 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d9302baa-dde8-4316-bd1c-a609de503b3b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:27.088945 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d9302baa-dde8-4316-bd1c-a609de503b3b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:27.223761 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-d9302baa-dde8-4316-bd1c-a609de503b3b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:49:27.231092 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-d9302baa-dde8-4316-bd1c-a609de503b3b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/67e104da-8254-4f6d-aed9-c0bbe8f53c80" status: 200 len: 1362 microversion: 2.1 time: 0.155608 Jul 11 11:49:27.231693 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1438/2882] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:49:27 2022] GET /compute/v2.1/servers/67e104da-8254-4f6d-aed9-c0bbe8f53c80 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:49:27.236409 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-a0538644-fe31-4cdd-ac3c-df54876069c9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:49:27.240305 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-a0538644-fe31-4cdd-ac3c-df54876069c9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: b39fbe8d-e6a4-4482-981f-ac21c2b52176] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:49:27.242571 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a0538644-fe31-4cdd-ac3c-df54876069c9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:27.243014 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a0538644-fe31-4cdd-ac3c-df54876069c9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:27.243787 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a0538644-fe31-4cdd-ac3c-df54876069c9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:27.244219 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a0538644-fe31-4cdd-ac3c-df54876069c9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:27.346199 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.virt.hardware [None req-efac9aae-9e84-43e9-b0bd-b0cbd3eac364 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Flavor limits 0:0:0 {{(pid=118322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 11:49:27.346634 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.virt.hardware [None req-efac9aae-9e84-43e9-b0bd-b0cbd3eac364 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Image limits 0:0:0 {{(pid=118322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 11:49:27.347113 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.virt.hardware [None req-efac9aae-9e84-43e9-b0bd-b0cbd3eac364 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Flavor pref 0:0:0 {{(pid=118322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 11:49:27.347573 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.virt.hardware [None req-efac9aae-9e84-43e9-b0bd-b0cbd3eac364 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Image pref 0:0:0 {{(pid=118322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 11:49:27.347989 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.virt.hardware [None req-efac9aae-9e84-43e9-b0bd-b0cbd3eac364 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 11:49:27.357440 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-efac9aae-9e84-43e9-b0bd-b0cbd3eac364 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:27.357891 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-efac9aae-9e84-43e9-b0bd-b0cbd3eac364 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:27.358691 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-efac9aae-9e84-43e9-b0bd-b0cbd3eac364 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:27.359130 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-efac9aae-9e84-43e9-b0bd-b0cbd3eac364 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:27.374882 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-a0538644-fe31-4cdd-ac3c-df54876069c9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:49:27.380556 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.quota [None req-efac9aae-9e84-43e9-b0bd-b0cbd3eac364 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Getting quotas for project 1328a510264f4374baabad7b5243d8c2. Resources: {'cores', 'ram', 'instances'} {{(pid=118322) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 11:49:27.382545 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-a0538644-fe31-4cdd-ac3c-df54876069c9 tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/b39fbe8d-e6a4-4482-981f-ac21c2b52176" status: 200 len: 1521 microversion: 2.1 time: 0.149887 Jul 11 11:49:27.383410 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1439/2883] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:49:27 2022] GET /compute/v2.1/servers/b39fbe8d-e6a4-4482-981f-ac21c2b52176 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:49:27.385384 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.quota [None req-efac9aae-9e84-43e9-b0bd-b0cbd3eac364 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Getting quotas for user cbcc15c786fb43669ac34a4897735c1d and project 1328a510264f4374baabad7b5243d8c2. Resources: {'cores', 'ram', 'instances'} {{(pid=118322) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 11:49:27.396627 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-efac9aae-9e84-43e9-b0bd-b0cbd3eac364 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Going to run 1 instances... {{(pid=118322) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 11:49:27.398930 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-efac9aae-9e84-43e9-b0bd-b0cbd3eac364 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 44d404ef-3afd-41b2-8f49-8912a6434af5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb93fc1-b713-4e67-8f76-bfec3a96168b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118322) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 11:49:27.532268 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-efac9aae-9e84-43e9-b0bd-b0cbd3eac364 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.686507 Jul 11 11:49:27.537932 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1445/2884] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jul 11 11:49:26 2022] POST /compute/v2.1/servers => generated 400 bytes in 688 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 11 11:49:27.543904 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-82472f2f-03d3-4136-a72f-ef7450fa3e1e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:49:27.544488 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-82472f2f-03d3-4136-a72f-ef7450fa3e1e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 44d404ef-3afd-41b2-8f49-8912a6434af5] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:49:27.608708 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-82472f2f-03d3-4136-a72f-ef7450fa3e1e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:49:27.626011 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-82472f2f-03d3-4136-a72f-ef7450fa3e1e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/44d404ef-3afd-41b2-8f49-8912a6434af5" status: 200 len: 1241 microversion: 2.1 time: 0.076302 Jul 11 11:49:27.626011 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1440/2885] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:49:27 2022] GET /compute/v2.1/servers/44d404ef-3afd-41b2-8f49-8912a6434af5 => generated 1241 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:49:27.772032 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [req-95a2dba6-41d5-4aaa-91f5-42ab34147592 req-0de62f62-676d-4b22-89db-d0e7e4e545b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67e104da-8254-4f6d-aed9-c0bbe8f53c80", "name": "network-vif-plugged", "status": "completed", "tag": "b78a7de4-f8cd-483a-b39f-9dc04c733e23"}]} {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:49:27.780979 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [req-95a2dba6-41d5-4aaa-91f5-42ab34147592 req-0de62f62-676d-4b22-89db-d0e7e4e545b0 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:27.781422 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [req-95a2dba6-41d5-4aaa-91f5-42ab34147592 req-0de62f62-676d-4b22-89db-d0e7e4e545b0 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:27.792505 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.compute.server_external_events [req-95a2dba6-41d5-4aaa-91f5-42ab34147592 req-0de62f62-676d-4b22-89db-d0e7e4e545b0 service nova] Creating event network-vif-plugged:b78a7de4-f8cd-483a-b39f-9dc04c733e23 for instance 67e104da-8254-4f6d-aed9-c0bbe8f53c80 on hv-cinder-84842 Jul 11 11:49:27.800771 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [req-95a2dba6-41d5-4aaa-91f5-42ab34147592 req-0de62f62-676d-4b22-89db-d0e7e4e545b0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101027 Jul 11 11:49:27.801604 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1446/2886] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 11:49:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:49:28.051712 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [req-a90e9418-a61e-4419-9bd8-18de105675f9 req-3d85e70e-f7cb-44dc-b8c5-6bd2538544e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b39fbe8d-e6a4-4482-981f-ac21c2b52176", "name": "network-vif-deleted", "tag": "62a32eb2-256e-45ce-bcbf-411a778027d2"}]} {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:49:28.062432 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [req-a90e9418-a61e-4419-9bd8-18de105675f9 req-3d85e70e-f7cb-44dc-b8c5-6bd2538544e4 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:28.062962 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [req-a90e9418-a61e-4419-9bd8-18de105675f9 req-3d85e70e-f7cb-44dc-b8c5-6bd2538544e4 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:28.075616 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.compute.server_external_events [req-a90e9418-a61e-4419-9bd8-18de105675f9 req-3d85e70e-f7cb-44dc-b8c5-6bd2538544e4 service nova] Creating event network-vif-deleted:62a32eb2-256e-45ce-bcbf-411a778027d2 for instance b39fbe8d-e6a4-4482-981f-ac21c2b52176 on hv-cinder-84842 Jul 11 11:49:28.081872 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [req-a90e9418-a61e-4419-9bd8-18de105675f9 req-3d85e70e-f7cb-44dc-b8c5-6bd2538544e4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034759 Jul 11 11:49:28.082913 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1441/2887] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 11:49:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:49:28.248165 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-8082e0c4-1dc4-467e-9c43-7672cd95386b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:49:28.248858 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-8082e0c4-1dc4-467e-9c43-7672cd95386b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 67e104da-8254-4f6d-aed9-c0bbe8f53c80] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:49:28.255034 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8082e0c4-1dc4-467e-9c43-7672cd95386b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:28.255461 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8082e0c4-1dc4-467e-9c43-7672cd95386b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:28.256218 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8082e0c4-1dc4-467e-9c43-7672cd95386b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:28.256644 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-8082e0c4-1dc4-467e-9c43-7672cd95386b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:28.400568 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-75b5234c-37fb-49f8-993b-dda6fcb931aa tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:49:28.401857 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-75b5234c-37fb-49f8-993b-dda6fcb931aa tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: b39fbe8d-e6a4-4482-981f-ac21c2b52176] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:49:28.407532 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-8082e0c4-1dc4-467e-9c43-7672cd95386b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:49:28.417932 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-8082e0c4-1dc4-467e-9c43-7672cd95386b tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/67e104da-8254-4f6d-aed9-c0bbe8f53c80" status: 200 len: 1362 microversion: 2.1 time: 0.174058 Jul 11 11:49:28.419197 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1447/2888] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:49:28 2022] GET /compute/v2.1/servers/67e104da-8254-4f6d-aed9-c0bbe8f53c80 => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:49:28.419588 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-75b5234c-37fb-49f8-993b-dda6fcb931aa tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:28.420045 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-75b5234c-37fb-49f8-993b-dda6fcb931aa tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:28.420902 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-75b5234c-37fb-49f8-993b-dda6fcb931aa tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:28.421245 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-75b5234c-37fb-49f8-993b-dda6fcb931aa tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:28.494430 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-75b5234c-37fb-49f8-993b-dda6fcb931aa tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:49:28.502923 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-75b5234c-37fb-49f8-993b-dda6fcb931aa tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/b39fbe8d-e6a4-4482-981f-ac21c2b52176" status: 200 len: 1306 microversion: 2.1 time: 0.106664 Jul 11 11:49:28.503862 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1442/2889] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:49:28 2022] GET /compute/v2.1/servers/b39fbe8d-e6a4-4482-981f-ac21c2b52176 => generated 1306 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:49:28.636397 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-17896140-c99b-4442-b761-d13925a1d0e9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:49:28.636907 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-17896140-c99b-4442-b761-d13925a1d0e9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 44d404ef-3afd-41b2-8f49-8912a6434af5] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:49:28.642872 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-17896140-c99b-4442-b761-d13925a1d0e9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:28.643361 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-17896140-c99b-4442-b761-d13925a1d0e9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:28.644245 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-17896140-c99b-4442-b761-d13925a1d0e9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:28.644685 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-17896140-c99b-4442-b761-d13925a1d0e9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:28.705140 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-17896140-c99b-4442-b761-d13925a1d0e9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:49:28.712550 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-17896140-c99b-4442-b761-d13925a1d0e9 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/44d404ef-3afd-41b2-8f49-8912a6434af5" status: 200 len: 1245 microversion: 2.1 time: 0.083411 Jul 11 11:49:28.713109 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1448/2890] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:49:28 2022] GET /compute/v2.1/servers/44d404ef-3afd-41b2-8f49-8912a6434af5 => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:49:29.434881 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-0ebf4f56-64a7-465a-8d76-0bf25b2e34de tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:49:29.435546 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-0ebf4f56-64a7-465a-8d76-0bf25b2e34de tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 67e104da-8254-4f6d-aed9-c0bbe8f53c80] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:49:29.441978 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0ebf4f56-64a7-465a-8d76-0bf25b2e34de tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:29.442423 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0ebf4f56-64a7-465a-8d76-0bf25b2e34de tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:29.443176 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0ebf4f56-64a7-465a-8d76-0bf25b2e34de tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:29.443637 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0ebf4f56-64a7-465a-8d76-0bf25b2e34de tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:29.520307 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-9dc66ed7-f1c9-4c5b-bd40-9e284990f15f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:49:29.520933 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-9dc66ed7-f1c9-4c5b-bd40-9e284990f15f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: b39fbe8d-e6a4-4482-981f-ac21c2b52176] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:49:29.527894 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9dc66ed7-f1c9-4c5b-bd40-9e284990f15f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:29.528336 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9dc66ed7-f1c9-4c5b-bd40-9e284990f15f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:29.529092 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9dc66ed7-f1c9-4c5b-bd40-9e284990f15f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:29.529531 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9dc66ed7-f1c9-4c5b-bd40-9e284990f15f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:29.561474 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9dc66ed7-f1c9-4c5b-bd40-9e284990f15f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:29.561927 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9dc66ed7-f1c9-4c5b-bd40-9e284990f15f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:29.562372 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.objects.instance [None req-9dc66ed7-f1c9-4c5b-bd40-9e284990f15f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lazy-loading 'fault' on Instance uuid b39fbe8d-e6a4-4482-981f-ac21c2b52176 {{(pid=118322) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 11:49:29.571760 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-0ebf4f56-64a7-465a-8d76-0bf25b2e34de tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:49:29.579457 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-0ebf4f56-64a7-465a-8d76-0bf25b2e34de tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/67e104da-8254-4f6d-aed9-c0bbe8f53c80" status: 200 len: 1548 microversion: 2.1 time: 0.148390 Jul 11 11:49:29.580031 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1443/2891] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:49:29 2022] GET /compute/v2.1/servers/67e104da-8254-4f6d-aed9-c0bbe8f53c80 => generated 1548 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:49:29.597028 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-d035fd26-ee5b-4a2d-b092-3802cca70418 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:49:29.597527 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-d035fd26-ee5b-4a2d-b092-3802cca70418 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 67e104da-8254-4f6d-aed9-c0bbe8f53c80] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:49:29.605228 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-9dc66ed7-f1c9-4c5b-bd40-9e284990f15f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47c365946cf4264a2d2205ace04379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8639f8c836d4ad79d147b855d9017f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:49:29.606168 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d035fd26-ee5b-4a2d-b092-3802cca70418 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:29.606825 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d035fd26-ee5b-4a2d-b092-3802cca70418 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:29.607828 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d035fd26-ee5b-4a2d-b092-3802cca70418 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:29.608265 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d035fd26-ee5b-4a2d-b092-3802cca70418 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:29.612925 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-9dc66ed7-f1c9-4c5b-bd40-9e284990f15f tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/b39fbe8d-e6a4-4482-981f-ac21c2b52176" status: 200 len: 1311 microversion: 2.1 time: 0.096380 Jul 11 11:49:29.622438 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1449/2892] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:49:29 2022] GET /compute/v2.1/servers/b39fbe8d-e6a4-4482-981f-ac21c2b52176 => generated 1311 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:49:29.622895 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:49:29.706923 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-d035fd26-ee5b-4a2d-b092-3802cca70418 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/67e104da-8254-4f6d-aed9-c0bbe8f53c80/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.113857 Jul 11 11:49:29.707549 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1444/2893] 10.222.0.26 () {58 vars in 1274 bytes} [Mon Jul 11 11:49:29 2022] GET /compute/v2.1/servers/67e104da-8254-4f6d-aed9-c0bbe8f53c80/os-interface => generated 284 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 11:49:29.729539 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-5630e2d4-5323-409c-8246-6dda930b114b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:49:29.734081 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-5630e2d4-5323-409c-8246-6dda930b114b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 44d404ef-3afd-41b2-8f49-8912a6434af5] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:49:29.736269 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5630e2d4-5323-409c-8246-6dda930b114b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:29.736727 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5630e2d4-5323-409c-8246-6dda930b114b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:29.737495 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5630e2d4-5323-409c-8246-6dda930b114b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:29.737935 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5630e2d4-5323-409c-8246-6dda930b114b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:29.849767 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-5630e2d4-5323-409c-8246-6dda930b114b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:49:29.860002 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-5630e2d4-5323-409c-8246-6dda930b114b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/44d404ef-3afd-41b2-8f49-8912a6434af5" status: 200 len: 1293 microversion: 2.1 time: 0.134475 Jul 11 11:49:29.860593 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1450/2894] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:49:29 2022] GET /compute/v2.1/servers/44d404ef-3afd-41b2-8f49-8912a6434af5 => generated 1293 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:49:30.630664 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-cb6b0e3b-626b-4e52-bfd0-c7f9b7c7513d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:49:30.631598 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-cb6b0e3b-626b-4e52-bfd0-c7f9b7c7513d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] [instance: b39fbe8d-e6a4-4482-981f-ac21c2b52176] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:49:30.639033 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-cb6b0e3b-626b-4e52-bfd0-c7f9b7c7513d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:30.640088 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-cb6b0e3b-626b-4e52-bfd0-c7f9b7c7513d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:30.640830 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-cb6b0e3b-626b-4e52-bfd0-c7f9b7c7513d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:30.641298 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-cb6b0e3b-626b-4e52-bfd0-c7f9b7c7513d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:30.655220 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.wsgi [None req-cb6b0e3b-626b-4e52-bfd0-c7f9b7c7513d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] HTTP exception thrown: Instance b39fbe8d-e6a4-4482-981f-ac21c2b52176 could not be found. Jul 11 11:49:30.656965 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-cb6b0e3b-626b-4e52-bfd0-c7f9b7c7513d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Request method failure captured: Jul 11 11:49:30.656965 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: request: GET /compute/v2.1/servers/b39fbe8d-e6a4-4482-981f-ac21c2b52176 HTTP/1.1 Jul 11 11:49:30.656965 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Accept: application/json Jul 11 11:49:30.656965 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Accept-Encoding: identity Jul 11 11:49:30.656965 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Connection: close Jul 11 11:49:30.656965 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Content-Length: 0 Jul 11 11:49:30.656965 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Content-Type: application/json Jul 11 11:49:30.656965 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Host: 10.222.0.26 Jul 11 11:49:30.656965 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Openstack-System-Scope: None Jul 11 11:49:30.656965 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: User-Agent: python-urllib3/1.26.9 Jul 11 11:49:30.656965 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Auth-Token: gAAAAABizAjAB3ee8Wpq3XhXwIMo2dwj2c7BxlbTsH6D1jW0nrqmMRQaO1vU3fERsJZs92pezfPAJ7yky9TGgSL8Gjc0VXr5ooj5myVwUGnwGNo7XkymuXwDtzAqNhHC0FClHxOsBHOXLYTrPKsTv6dRXKtOUTvNzViNUOSi1yXruxQCnGLZpsY Jul 11 11:49:30.656965 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Domain-Id: None Jul 11 11:49:30.656965 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Domain-Name: None Jul 11 11:49:30.656965 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Identity-Status: Confirmed Jul 11 11:49:30.656965 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Is-Admin-Project: True Jul 11 11:49:30.656965 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Domain-Id: default Jul 11 11:49:30.656965 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Domain-Name: Default Jul 11 11:49:30.656965 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Id: c8639f8c836d4ad79d147b855d9017f8 Jul 11 11:49:30.656965 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-187934667 Jul 11 11:49:30.656965 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Role: member,reader Jul 11 11:49:30.656965 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Roles: member,reader Jul 11 11:49:30.658481 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c8639f8c836d4ad79d147b855d9017f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c8639f8c836d4ad79d147b855d9017f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c8639f8c836d4ad79d147b855d9017f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c8639f8c836d4ad79d147b855d9017f8"}]}] Jul 11 11:49:30.658481 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Tenant: tempest-ServerRescueNegativeTestJSON-187934667 Jul 11 11:49:30.658481 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Tenant-Id: c8639f8c836d4ad79d147b855d9017f8 Jul 11 11:49:30.658481 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-187934667 Jul 11 11:49:30.658481 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User: tempest-ServerRescueNegativeTestJSON-187934667-project Jul 11 11:49:30.658481 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Domain-Id: default Jul 11 11:49:30.658481 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Domain-Name: Default Jul 11 11:49:30.658481 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Id: e47c365946cf4264a2d2205ace04379d Jul 11 11:49:30.658481 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Name: tempest-ServerRescueNegativeTestJSON-187934667-project Jul 11 11:49:30.658481 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: method: > Jul 11 11:49:30.658481 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: exception: Instance b39fbe8d-e6a4-4482-981f-ac21c2b52176 could not be found. Jul 11 11:49:30.658481 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: action_args: {'id': 'b39fbe8d-e6a4-4482-981f-ac21c2b52176'} Jul 11 11:49:30.659572 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 11:49:30.659572 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:49:30.659572 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 11:49:30.659572 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 11:49:30.659572 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 11:49:30.659572 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 11:49:30.659572 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 11:49:30.659572 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 11:49:30.659572 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 11:49:30.659572 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 11:49:30.659572 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b39fbe8d-e6a4-4482-981f-ac21c2b52176 could not be found. Jul 11 11:49:30.659572 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:49:30.659572 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:49:30.659572 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:49:30.659572 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:49:30.659572 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:49:30.659572 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:49:30.659572 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 11:49:30.659572 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 11:49:30.659572 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 11:49:30.661268 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 11:49:30.661268 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 11:49:30.661268 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 11:49:30.661268 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 11:49:30.661268 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 11:49:30.661268 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 11:49:30.661268 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 11:49:30.661268 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b39fbe8d-e6a4-4482-981f-ac21c2b52176 could not be found. Jul 11 11:49:30.661268 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:49:30.661268 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:49:30.661268 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:49:30.661268 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:49:30.661268 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:49:30.661268 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:49:30.661268 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 11:49:30.661268 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 11:49:30.661268 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b39fbe8d-e6a4-4482-981f-ac21c2b52176 could not be found. Jul 11 11:49:30.661268 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:49:30.662913 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-cb6b0e3b-626b-4e52-bfd0-c7f9b7c7513d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] Returning 404 to user: Instance b39fbe8d-e6a4-4482-981f-ac21c2b52176 could not be found. {{(pid=118321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 11:49:30.662913 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-cb6b0e3b-626b-4e52-bfd0-c7f9b7c7513d tempest-ServerRescueNegativeTestJSON-187934667 tempest-ServerRescueNegativeTestJSON-187934667-project] 10.222.0.26 "GET /compute/v2.1/servers/b39fbe8d-e6a4-4482-981f-ac21c2b52176" status: 404 len: 111 microversion: 2.1 time: 0.032821 Jul 11 11:49:30.662913 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1445/2895] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:49:30 2022] GET /compute/v2.1/servers/b39fbe8d-e6a4-4482-981f-ac21c2b52176 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 11:49:30.844281 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [req-ce389045-d7d8-4fd1-8b03-36c8d56d77b5 req-4e6bea73-9496-46bd-83dc-9f346a1142db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67e104da-8254-4f6d-aed9-c0bbe8f53c80", "tag": "b78a7de4-f8cd-483a-b39f-9dc04c733e23"}]} {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:49:30.858421 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [req-ce389045-d7d8-4fd1-8b03-36c8d56d77b5 req-4e6bea73-9496-46bd-83dc-9f346a1142db service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:30.858421 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [req-ce389045-d7d8-4fd1-8b03-36c8d56d77b5 req-4e6bea73-9496-46bd-83dc-9f346a1142db service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:30.878375 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-eea77edf-8c6d-48c0-a3fe-da9d0dcc72b5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:49:30.879395 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-eea77edf-8c6d-48c0-a3fe-da9d0dcc72b5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 44d404ef-3afd-41b2-8f49-8912a6434af5] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:49:30.891398 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-eea77edf-8c6d-48c0-a3fe-da9d0dcc72b5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:30.892158 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-eea77edf-8c6d-48c0-a3fe-da9d0dcc72b5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:30.893485 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-eea77edf-8c6d-48c0-a3fe-da9d0dcc72b5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:30.895285 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.compute.server_external_events [req-ce389045-d7d8-4fd1-8b03-36c8d56d77b5 req-4e6bea73-9496-46bd-83dc-9f346a1142db service nova] Creating event network-changed:b78a7de4-f8cd-483a-b39f-9dc04c733e23 for instance 67e104da-8254-4f6d-aed9-c0bbe8f53c80 on hv-cinder-84842 Jul 11 11:49:30.895988 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-eea77edf-8c6d-48c0-a3fe-da9d0dcc72b5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:30.907223 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [req-ce389045-d7d8-4fd1-8b03-36c8d56d77b5 req-4e6bea73-9496-46bd-83dc-9f346a1142db service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129820 Jul 11 11:49:30.908668 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1451/2896] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 11:49:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:49:31.261459 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-eea77edf-8c6d-48c0-a3fe-da9d0dcc72b5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:49:31.271234 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-eea77edf-8c6d-48c0-a3fe-da9d0dcc72b5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/44d404ef-3afd-41b2-8f49-8912a6434af5" status: 200 len: 1365 microversion: 2.1 time: 0.397886 Jul 11 11:49:31.290598 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1446/2897] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:49:30 2022] GET /compute/v2.1/servers/44d404ef-3afd-41b2-8f49-8912a6434af5 => generated 1365 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:49:32.302210 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-7abf0c4f-8b66-4aac-ab5f-101fe6d7cda4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:49:32.304629 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-7abf0c4f-8b66-4aac-ab5f-101fe6d7cda4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 44d404ef-3afd-41b2-8f49-8912a6434af5] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:49:32.320011 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7abf0c4f-8b66-4aac-ab5f-101fe6d7cda4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:32.324678 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7abf0c4f-8b66-4aac-ab5f-101fe6d7cda4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:32.325859 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7abf0c4f-8b66-4aac-ab5f-101fe6d7cda4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:32.326470 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7abf0c4f-8b66-4aac-ab5f-101fe6d7cda4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:32.475064 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [req-deae4d6a-afd1-47f0-a987-2b868a5c066d req-1fb29d53-6a83-487a-b23f-1edc14d329cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44d404ef-3afd-41b2-8f49-8912a6434af5", "tag": "d5691174-9c58-4711-9af7-9d6c6cbb63ce"}]} {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:49:32.499932 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [req-deae4d6a-afd1-47f0-a987-2b868a5c066d req-1fb29d53-6a83-487a-b23f-1edc14d329cd service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:32.500775 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [req-deae4d6a-afd1-47f0-a987-2b868a5c066d req-1fb29d53-6a83-487a-b23f-1edc14d329cd service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:32.514983 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.compute.server_external_events [req-deae4d6a-afd1-47f0-a987-2b868a5c066d req-1fb29d53-6a83-487a-b23f-1edc14d329cd service nova] Creating event network-changed:d5691174-9c58-4711-9af7-9d6c6cbb63ce for instance 44d404ef-3afd-41b2-8f49-8912a6434af5 on hv-cinder-84842 Jul 11 11:49:32.525283 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [req-deae4d6a-afd1-47f0-a987-2b868a5c066d req-1fb29d53-6a83-487a-b23f-1edc14d329cd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052938 Jul 11 11:49:32.525283 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1447/2898] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 11:49:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:49:32.577870 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-7abf0c4f-8b66-4aac-ab5f-101fe6d7cda4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:49:32.589397 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-7abf0c4f-8b66-4aac-ab5f-101fe6d7cda4 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/44d404ef-3afd-41b2-8f49-8912a6434af5" status: 200 len: 1365 microversion: 2.1 time: 0.293610 Jul 11 11:49:32.590610 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1452/2899] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:49:32 2022] GET /compute/v2.1/servers/44d404ef-3afd-41b2-8f49-8912a6434af5 => generated 1365 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:49:33.607021 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-44ec3178-96bf-4d42-8a7b-bd35ead84bbe tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:49:33.607868 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-44ec3178-96bf-4d42-8a7b-bd35ead84bbe tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 44d404ef-3afd-41b2-8f49-8912a6434af5] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:49:33.614645 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-44ec3178-96bf-4d42-8a7b-bd35ead84bbe tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:33.615095 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-44ec3178-96bf-4d42-8a7b-bd35ead84bbe tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:33.615894 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-44ec3178-96bf-4d42-8a7b-bd35ead84bbe tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:33.616332 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-44ec3178-96bf-4d42-8a7b-bd35ead84bbe tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:33.757990 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-44ec3178-96bf-4d42-8a7b-bd35ead84bbe tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:49:33.765617 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-44ec3178-96bf-4d42-8a7b-bd35ead84bbe tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/44d404ef-3afd-41b2-8f49-8912a6434af5" status: 200 len: 1365 microversion: 2.1 time: 0.163404 Jul 11 11:49:33.772913 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1448/2900] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:49:33 2022] GET /compute/v2.1/servers/44d404ef-3afd-41b2-8f49-8912a6434af5 => generated 1365 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:49:34.788161 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-5abd5514-ca70-405b-991e-2c3cb12a5972 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:49:34.789417 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-5abd5514-ca70-405b-991e-2c3cb12a5972 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 44d404ef-3afd-41b2-8f49-8912a6434af5] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:49:34.796799 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5abd5514-ca70-405b-991e-2c3cb12a5972 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:34.797456 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5abd5514-ca70-405b-991e-2c3cb12a5972 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:34.798228 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5abd5514-ca70-405b-991e-2c3cb12a5972 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:34.798844 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5abd5514-ca70-405b-991e-2c3cb12a5972 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:34.952044 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-5abd5514-ca70-405b-991e-2c3cb12a5972 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:49:34.958125 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-5abd5514-ca70-405b-991e-2c3cb12a5972 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/44d404ef-3afd-41b2-8f49-8912a6434af5" status: 200 len: 1365 microversion: 2.1 time: 0.173774 Jul 11 11:49:34.959345 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1453/2901] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:49:34 2022] GET /compute/v2.1/servers/44d404ef-3afd-41b2-8f49-8912a6434af5 => generated 1365 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:49:35.975577 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-35ebef07-2e1f-428c-885f-e48bff5e7d09 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:49:35.976131 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-35ebef07-2e1f-428c-885f-e48bff5e7d09 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 44d404ef-3afd-41b2-8f49-8912a6434af5] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:49:35.982689 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-35ebef07-2e1f-428c-885f-e48bff5e7d09 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:35.983750 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-35ebef07-2e1f-428c-885f-e48bff5e7d09 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:35.983983 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-35ebef07-2e1f-428c-885f-e48bff5e7d09 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:35.984417 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-35ebef07-2e1f-428c-885f-e48bff5e7d09 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:36.145768 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-35ebef07-2e1f-428c-885f-e48bff5e7d09 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:49:36.153122 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-35ebef07-2e1f-428c-885f-e48bff5e7d09 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/44d404ef-3afd-41b2-8f49-8912a6434af5" status: 200 len: 1365 microversion: 2.1 time: 0.181451 Jul 11 11:49:36.153692 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1449/2902] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:49:35 2022] GET /compute/v2.1/servers/44d404ef-3afd-41b2-8f49-8912a6434af5 => generated 1365 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:49:37.169714 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-fa1b0b78-b940-4e5a-8c08-4d589b487e2f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:49:37.170327 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-fa1b0b78-b940-4e5a-8c08-4d589b487e2f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 44d404ef-3afd-41b2-8f49-8912a6434af5] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:49:37.177020 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fa1b0b78-b940-4e5a-8c08-4d589b487e2f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:37.177547 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fa1b0b78-b940-4e5a-8c08-4d589b487e2f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:37.178237 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fa1b0b78-b940-4e5a-8c08-4d589b487e2f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:37.178675 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fa1b0b78-b940-4e5a-8c08-4d589b487e2f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:37.305960 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-fa1b0b78-b940-4e5a-8c08-4d589b487e2f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:49:37.313267 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-fa1b0b78-b940-4e5a-8c08-4d589b487e2f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/44d404ef-3afd-41b2-8f49-8912a6434af5" status: 200 len: 1365 microversion: 2.1 time: 0.147425 Jul 11 11:49:37.313836 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1454/2903] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:49:37 2022] GET /compute/v2.1/servers/44d404ef-3afd-41b2-8f49-8912a6434af5 => generated 1365 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:49:37.721233 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [req-254503b6-552a-4d96-9d59-5a0c7d55dc38 req-dc9d9cc6-5448-4f68-9056-7481ff316b49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44d404ef-3afd-41b2-8f49-8912a6434af5", "name": "network-vif-plugged", "status": "completed", "tag": "d5691174-9c58-4711-9af7-9d6c6cbb63ce"}]} {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:49:37.725283 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell0:SELECT=8 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:49:37.730536 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [req-254503b6-552a-4d96-9d59-5a0c7d55dc38 req-dc9d9cc6-5448-4f68-9056-7481ff316b49 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:37.730980 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [req-254503b6-552a-4d96-9d59-5a0c7d55dc38 req-dc9d9cc6-5448-4f68-9056-7481ff316b49 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:37.741628 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.compute.server_external_events [req-254503b6-552a-4d96-9d59-5a0c7d55dc38 req-dc9d9cc6-5448-4f68-9056-7481ff316b49 service nova] Creating event network-vif-plugged:d5691174-9c58-4711-9af7-9d6c6cbb63ce for instance 44d404ef-3afd-41b2-8f49-8912a6434af5 on hv-cinder-84842 Jul 11 11:49:37.747115 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [req-254503b6-552a-4d96-9d59-5a0c7d55dc38 req-dc9d9cc6-5448-4f68-9056-7481ff316b49 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029531 Jul 11 11:49:37.749898 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1450/2904] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 11:49:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:49:38.330287 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-ec218d4f-1f4f-4d78-a7fc-d39d5a215d66 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:49:38.330827 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-ec218d4f-1f4f-4d78-a7fc-d39d5a215d66 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 44d404ef-3afd-41b2-8f49-8912a6434af5] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:49:38.332796 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell0:SELECT=4 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:49:38.333439 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell0:SELECT=16 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:49:38.339160 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ec218d4f-1f4f-4d78-a7fc-d39d5a215d66 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:38.340525 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ec218d4f-1f4f-4d78-a7fc-d39d5a215d66 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:38.341654 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ec218d4f-1f4f-4d78-a7fc-d39d5a215d66 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:38.342093 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ec218d4f-1f4f-4d78-a7fc-d39d5a215d66 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:38.475714 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-ec218d4f-1f4f-4d78-a7fc-d39d5a215d66 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:49:38.483816 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-ec218d4f-1f4f-4d78-a7fc-d39d5a215d66 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/44d404ef-3afd-41b2-8f49-8912a6434af5" status: 200 len: 1365 microversion: 2.1 time: 0.157730 Jul 11 11:49:38.484720 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1455/2905] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:49:38 2022] GET /compute/v2.1/servers/44d404ef-3afd-41b2-8f49-8912a6434af5 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:49:39.502362 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-06ef179d-eb94-49cf-a404-df9a9675aeea tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:49:39.503060 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-06ef179d-eb94-49cf-a404-df9a9675aeea tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 44d404ef-3afd-41b2-8f49-8912a6434af5] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:49:39.509577 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-06ef179d-eb94-49cf-a404-df9a9675aeea tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:39.510026 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-06ef179d-eb94-49cf-a404-df9a9675aeea tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:39.510781 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-06ef179d-eb94-49cf-a404-df9a9675aeea tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:39.511214 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-06ef179d-eb94-49cf-a404-df9a9675aeea tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:39.641690 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-06ef179d-eb94-49cf-a404-df9a9675aeea tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:49:39.649224 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-06ef179d-eb94-49cf-a404-df9a9675aeea tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/44d404ef-3afd-41b2-8f49-8912a6434af5" status: 200 len: 1365 microversion: 2.1 time: 0.151623 Jul 11 11:49:39.649792 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1451/2906] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:49:39 2022] GET /compute/v2.1/servers/44d404ef-3afd-41b2-8f49-8912a6434af5 => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:49:40.665534 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-0b6ee829-7889-499c-a85d-57baf489e2dc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:49:40.666122 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-0b6ee829-7889-499c-a85d-57baf489e2dc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 44d404ef-3afd-41b2-8f49-8912a6434af5] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:49:40.672725 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0b6ee829-7889-499c-a85d-57baf489e2dc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:40.673114 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0b6ee829-7889-499c-a85d-57baf489e2dc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:40.673867 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0b6ee829-7889-499c-a85d-57baf489e2dc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:40.674301 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0b6ee829-7889-499c-a85d-57baf489e2dc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:40.689166 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=100 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:49:40.799175 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-0b6ee829-7889-499c-a85d-57baf489e2dc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:49:40.806482 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-0b6ee829-7889-499c-a85d-57baf489e2dc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/44d404ef-3afd-41b2-8f49-8912a6434af5" status: 200 len: 1556 microversion: 2.1 time: 0.144832 Jul 11 11:49:40.807587 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1456/2907] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:49:40 2022] GET /compute/v2.1/servers/44d404ef-3afd-41b2-8f49-8912a6434af5 => generated 1556 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:49:40.823690 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-3e5584ca-197d-4bf8-ac63-357f3bcc0a08 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:49:40.824211 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-3e5584ca-197d-4bf8-ac63-357f3bcc0a08 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 44d404ef-3afd-41b2-8f49-8912a6434af5] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:49:40.830555 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3e5584ca-197d-4bf8-ac63-357f3bcc0a08 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:40.830994 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3e5584ca-197d-4bf8-ac63-357f3bcc0a08 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:40.831777 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3e5584ca-197d-4bf8-ac63-357f3bcc0a08 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:40.832202 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3e5584ca-197d-4bf8-ac63-357f3bcc0a08 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:40.906935 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-3e5584ca-197d-4bf8-ac63-357f3bcc0a08 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/44d404ef-3afd-41b2-8f49-8912a6434af5/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.087745 Jul 11 11:49:40.907578 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1452/2908] 10.222.0.26 () {58 vars in 1274 bytes} [Mon Jul 11 11:49:40 2022] GET /compute/v2.1/servers/44d404ef-3afd-41b2-8f49-8912a6434af5/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:49:42.135643 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [req-15eb40b0-91ba-4036-94bf-64087a42f972 req-a78631f1-faf5-484e-bbc5-98003689f151 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44d404ef-3afd-41b2-8f49-8912a6434af5", "tag": "d5691174-9c58-4711-9af7-9d6c6cbb63ce"}]} {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:49:42.144150 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [req-15eb40b0-91ba-4036-94bf-64087a42f972 req-a78631f1-faf5-484e-bbc5-98003689f151 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:49:42.144596 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [req-15eb40b0-91ba-4036-94bf-64087a42f972 req-a78631f1-faf5-484e-bbc5-98003689f151 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:49:42.156130 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.compute.server_external_events [req-15eb40b0-91ba-4036-94bf-64087a42f972 req-a78631f1-faf5-484e-bbc5-98003689f151 service nova] Creating event network-changed:d5691174-9c58-4711-9af7-9d6c6cbb63ce for instance 44d404ef-3afd-41b2-8f49-8912a6434af5 on hv-cinder-84842 Jul 11 11:49:42.161187 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [req-15eb40b0-91ba-4036-94bf-64087a42f972 req-a78631f1-faf5-484e-bbc5-98003689f151 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029839 Jul 11 11:49:42.161799 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1457/2909] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 11:49:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:50:05.984034 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:50:05.984813 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=35 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:50:05.988638 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-a2359281-246a-4298-8401-d3e358282b0a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:50:05.989124 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-a2359281-246a-4298-8401-d3e358282b0a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 67e104da-8254-4f6d-aed9-c0bbe8f53c80] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:50:05.997352 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a2359281-246a-4298-8401-d3e358282b0a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:50:05.998136 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a2359281-246a-4298-8401-d3e358282b0a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:50:05.999679 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a2359281-246a-4298-8401-d3e358282b0a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:50:06.000113 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a2359281-246a-4298-8401-d3e358282b0a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:50:06.024349 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-a2359281-246a-4298-8401-d3e358282b0a tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/67e104da-8254-4f6d-aed9-c0bbe8f53c80/ips" status: 200 len: 145 microversion: 2.1 time: 0.042508 Jul 11 11:50:06.024971 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1453/2910] 10.222.0.26 () {58 vars in 1247 bytes} [Mon Jul 11 11:50:05 2022] GET /compute/v2.1/servers/67e104da-8254-4f6d-aed9-c0bbe8f53c80/ips => generated 145 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:50:18.192052 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:50:18.192826 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=5 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:50:18.196921 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-2277e746-7de3-4bb8-a90d-dd19830e0eb2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:50:18.197774 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-2277e746-7de3-4bb8-a90d-dd19830e0eb2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 44d404ef-3afd-41b2-8f49-8912a6434af5] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:50:18.204579 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2277e746-7de3-4bb8-a90d-dd19830e0eb2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:50:18.206477 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2277e746-7de3-4bb8-a90d-dd19830e0eb2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:50:18.206477 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2277e746-7de3-4bb8-a90d-dd19830e0eb2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:50:18.206477 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2277e746-7de3-4bb8-a90d-dd19830e0eb2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:50:18.229388 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-2277e746-7de3-4bb8-a90d-dd19830e0eb2 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/44d404ef-3afd-41b2-8f49-8912a6434af5/ips" status: 200 len: 151 microversion: 2.1 time: 0.042923 Jul 11 11:50:18.234754 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1458/2911] 10.222.0.26 () {58 vars in 1247 bytes} [Mon Jul 11 11:50:18 2022] GET /compute/v2.1/servers/44d404ef-3afd-41b2-8f49-8912a6434af5/ips => generated 151 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:50:58.406119 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 11:50:58.406752 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Mon Jul 11 11:50:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 11:51:06.100682 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-56c410ac-1f6f-44c8-9665-a5b9242020cc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:51:06.101336 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-56c410ac-1f6f-44c8-9665-a5b9242020cc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 67e104da-8254-4f6d-aed9-c0bbe8f53c80] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:51:06.107370 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-56c410ac-1f6f-44c8-9665-a5b9242020cc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:51:06.107821 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-56c410ac-1f6f-44c8-9665-a5b9242020cc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:51:06.108575 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-56c410ac-1f6f-44c8-9665-a5b9242020cc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:51:06.109008 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-56c410ac-1f6f-44c8-9665-a5b9242020cc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:51:06.133975 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-56c410ac-1f6f-44c8-9665-a5b9242020cc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 67e104da-8254-4f6d-aed9-c0bbe8f53c80] Going to try to terminate instance {{(pid=118321) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 11:51:06.389518 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-56c410ac-1f6f-44c8-9665-a5b9242020cc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "DELETE /compute/v2.1/servers/67e104da-8254-4f6d-aed9-c0bbe8f53c80" status: 204 len: 0 microversion: 2.1 time: 0.294508 Jul 11 11:51:06.390121 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1454/2912] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 11 11:51:06 2022] DELETE /compute/v2.1/servers/67e104da-8254-4f6d-aed9-c0bbe8f53c80 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 11 11:51:06.398617 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-d40004f1-c0cb-4a29-a9e5-c3bbdbd0d24c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:51:06.399517 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-d40004f1-c0cb-4a29-a9e5-c3bbdbd0d24c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 67e104da-8254-4f6d-aed9-c0bbe8f53c80] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:51:06.406113 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d40004f1-c0cb-4a29-a9e5-c3bbdbd0d24c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:51:06.406575 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d40004f1-c0cb-4a29-a9e5-c3bbdbd0d24c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:51:06.407370 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d40004f1-c0cb-4a29-a9e5-c3bbdbd0d24c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:51:06.407814 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d40004f1-c0cb-4a29-a9e5-c3bbdbd0d24c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:51:06.552166 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-d40004f1-c0cb-4a29-a9e5-c3bbdbd0d24c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:51:06.559525 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-d40004f1-c0cb-4a29-a9e5-c3bbdbd0d24c tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/67e104da-8254-4f6d-aed9-c0bbe8f53c80" status: 200 len: 1672 microversion: 2.1 time: 0.165237 Jul 11 11:51:06.560096 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1459/2913] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:51:06 2022] GET /compute/v2.1/servers/67e104da-8254-4f6d-aed9-c0bbe8f53c80 => generated 1672 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:51:07.578017 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-5d91bc66-3efb-4d61-90f5-45ce33569726 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:51:07.578773 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-5d91bc66-3efb-4d61-90f5-45ce33569726 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 67e104da-8254-4f6d-aed9-c0bbe8f53c80] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:51:07.585972 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5d91bc66-3efb-4d61-90f5-45ce33569726 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:51:07.586423 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5d91bc66-3efb-4d61-90f5-45ce33569726 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:51:07.587185 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5d91bc66-3efb-4d61-90f5-45ce33569726 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:51:07.587652 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5d91bc66-3efb-4d61-90f5-45ce33569726 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:51:07.717613 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-5d91bc66-3efb-4d61-90f5-45ce33569726 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:51:07.725585 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-5d91bc66-3efb-4d61-90f5-45ce33569726 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/67e104da-8254-4f6d-aed9-c0bbe8f53c80" status: 200 len: 1672 microversion: 2.1 time: 0.151853 Jul 11 11:51:07.726396 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1455/2914] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:51:07 2022] GET /compute/v2.1/servers/67e104da-8254-4f6d-aed9-c0bbe8f53c80 => generated 1672 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:51:08.781726 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-19f950e7-8887-492b-83e1-1ba91d731617 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:51:08.781726 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-19f950e7-8887-492b-83e1-1ba91d731617 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 67e104da-8254-4f6d-aed9-c0bbe8f53c80] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:51:08.781726 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-19f950e7-8887-492b-83e1-1ba91d731617 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:51:08.781726 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-19f950e7-8887-492b-83e1-1ba91d731617 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:51:08.782642 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-19f950e7-8887-492b-83e1-1ba91d731617 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:51:08.782642 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-19f950e7-8887-492b-83e1-1ba91d731617 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:51:08.813537 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-19f950e7-8887-492b-83e1-1ba91d731617 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:51:08.821525 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-19f950e7-8887-492b-83e1-1ba91d731617 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/67e104da-8254-4f6d-aed9-c0bbe8f53c80" status: 200 len: 1605 microversion: 2.1 time: 0.082456 Jul 11 11:51:08.822088 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1460/2915] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:51:08 2022] GET /compute/v2.1/servers/67e104da-8254-4f6d-aed9-c0bbe8f53c80 => generated 1605 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:51:08.991646 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [req-c8c1211c-766c-436f-a847-3fec7d8897b9 req-c221ba12-dd1f-4af5-9f80-2021acc95c50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67e104da-8254-4f6d-aed9-c0bbe8f53c80", "name": "network-vif-deleted", "tag": "b78a7de4-f8cd-483a-b39f-9dc04c733e23"}]} {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:51:09.001166 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [req-c8c1211c-766c-436f-a847-3fec7d8897b9 req-c221ba12-dd1f-4af5-9f80-2021acc95c50 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:51:09.004535 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [req-c8c1211c-766c-436f-a847-3fec7d8897b9 req-c221ba12-dd1f-4af5-9f80-2021acc95c50 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:51:09.013313 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.compute.server_external_events [req-c8c1211c-766c-436f-a847-3fec7d8897b9 req-c221ba12-dd1f-4af5-9f80-2021acc95c50 service nova] Creating event network-vif-deleted:b78a7de4-f8cd-483a-b39f-9dc04c733e23 for instance 67e104da-8254-4f6d-aed9-c0bbe8f53c80 on hv-cinder-84842 Jul 11 11:51:09.018393 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [req-c8c1211c-766c-436f-a847-3fec7d8897b9 req-c221ba12-dd1f-4af5-9f80-2021acc95c50 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030485 Jul 11 11:51:09.019102 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1456/2916] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 11:51:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:51:09.839545 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-29e6c2d8-ed22-4bb0-80d3-4669f7c93732 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:51:09.840156 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-29e6c2d8-ed22-4bb0-80d3-4669f7c93732 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 67e104da-8254-4f6d-aed9-c0bbe8f53c80] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:51:09.846638 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-29e6c2d8-ed22-4bb0-80d3-4669f7c93732 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:51:09.847088 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-29e6c2d8-ed22-4bb0-80d3-4669f7c93732 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:51:09.848530 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-29e6c2d8-ed22-4bb0-80d3-4669f7c93732 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:51:09.848959 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-29e6c2d8-ed22-4bb0-80d3-4669f7c93732 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:51:09.881923 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-29e6c2d8-ed22-4bb0-80d3-4669f7c93732 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:51:09.882383 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-29e6c2d8-ed22-4bb0-80d3-4669f7c93732 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:51:09.882827 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.objects.instance [None req-29e6c2d8-ed22-4bb0-80d3-4669f7c93732 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lazy-loading 'fault' on Instance uuid 67e104da-8254-4f6d-aed9-c0bbe8f53c80 {{(pid=118322) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 11:51:09.926592 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-29e6c2d8-ed22-4bb0-80d3-4669f7c93732 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ff2cacb5c1450482597a2f5fa3c8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779b0ffa2244901a92adbee65b10421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:51:09.933609 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-29e6c2d8-ed22-4bb0-80d3-4669f7c93732 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/67e104da-8254-4f6d-aed9-c0bbe8f53c80" status: 200 len: 1327 microversion: 2.1 time: 0.098053 Jul 11 11:51:09.934204 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1461/2917] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:51:09 2022] GET /compute/v2.1/servers/67e104da-8254-4f6d-aed9-c0bbe8f53c80 => generated 1327 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:51:10.954523 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-515aee10-3ce1-4f77-b462-f392c541cdcc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:51:10.955206 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-515aee10-3ce1-4f77-b462-f392c541cdcc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 67e104da-8254-4f6d-aed9-c0bbe8f53c80] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:51:10.961358 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-515aee10-3ce1-4f77-b462-f392c541cdcc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:51:10.961801 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-515aee10-3ce1-4f77-b462-f392c541cdcc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:51:10.962542 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-515aee10-3ce1-4f77-b462-f392c541cdcc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:51:10.962968 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-515aee10-3ce1-4f77-b462-f392c541cdcc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:51:10.976257 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.wsgi [None req-515aee10-3ce1-4f77-b462-f392c541cdcc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] HTTP exception thrown: Instance 67e104da-8254-4f6d-aed9-c0bbe8f53c80 could not be found. Jul 11 11:51:10.988650 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-515aee10-3ce1-4f77-b462-f392c541cdcc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Request method failure captured: Jul 11 11:51:10.988650 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: request: GET /compute/v2.1/servers/67e104da-8254-4f6d-aed9-c0bbe8f53c80 HTTP/1.1 Jul 11 11:51:10.988650 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Accept: application/json Jul 11 11:51:10.988650 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Accept-Encoding: identity Jul 11 11:51:10.988650 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Connection: close Jul 11 11:51:10.988650 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Content-Length: 0 Jul 11 11:51:10.988650 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Content-Type: application/json Jul 11 11:51:10.988650 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Host: 10.222.0.26 Jul 11 11:51:10.988650 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Openstack-System-Scope: None Jul 11 11:51:10.988650 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: User-Agent: python-urllib3/1.26.9 Jul 11 11:51:10.988650 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Auth-Token: gAAAAABizAjLO4PGFFyBld15DDnMmjOMiyTfdUbsyF5cUuFMKWxHvKhrCVTk7XeaeLJ6AedivEPaw_nguZ4-p4LDjB7T9a0W-yQx3Oeh_u82CdhrQ3J4zLhwezdPpzDSPXg3rjqJkU6X-m1m244kVxKJfdBOeXkvji1jVYDzL1HD6pHDIVJaMlQ Jul 11 11:51:10.988650 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Domain-Id: None Jul 11 11:51:10.988650 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Domain-Name: None Jul 11 11:51:10.988650 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Identity-Status: Confirmed Jul 11 11:51:10.988650 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Is-Admin-Project: True Jul 11 11:51:10.988650 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Domain-Id: default Jul 11 11:51:10.988650 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Domain-Name: Default Jul 11 11:51:10.988650 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Id: 5779b0ffa2244901a92adbee65b10421 Jul 11 11:51:10.988650 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Name: tempest-AttachVolumeTestJSON-1070974935 Jul 11 11:51:10.988650 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Role: member,reader Jul 11 11:51:10.988650 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Roles: member,reader Jul 11 11:51:10.990539 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5779b0ffa2244901a92adbee65b10421"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5779b0ffa2244901a92adbee65b10421"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5779b0ffa2244901a92adbee65b10421"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5779b0ffa2244901a92adbee65b10421"}]}] Jul 11 11:51:10.990539 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Tenant: tempest-AttachVolumeTestJSON-1070974935 Jul 11 11:51:10.990539 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Tenant-Id: 5779b0ffa2244901a92adbee65b10421 Jul 11 11:51:10.990539 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1070974935 Jul 11 11:51:10.990539 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User: tempest-AttachVolumeTestJSON-1070974935-project Jul 11 11:51:10.990539 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Domain-Id: default Jul 11 11:51:10.990539 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Domain-Name: Default Jul 11 11:51:10.990539 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Id: 15ff2cacb5c1450482597a2f5fa3c8a9 Jul 11 11:51:10.990539 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Name: tempest-AttachVolumeTestJSON-1070974935-project Jul 11 11:51:10.990539 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: method: > Jul 11 11:51:10.990539 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: exception: Instance 67e104da-8254-4f6d-aed9-c0bbe8f53c80 could not be found. Jul 11 11:51:10.990539 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: action_args: {'id': '67e104da-8254-4f6d-aed9-c0bbe8f53c80'} Jul 11 11:51:10.991671 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 11:51:10.991671 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:51:10.991671 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 11:51:10.991671 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 11:51:10.991671 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 11:51:10.991671 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 11:51:10.991671 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 11:51:10.991671 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 11:51:10.991671 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 11:51:10.991671 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 11:51:10.991671 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67e104da-8254-4f6d-aed9-c0bbe8f53c80 could not be found. Jul 11 11:51:10.991671 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:51:10.991671 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:51:10.991671 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:51:10.991671 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:51:10.991671 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:51:10.991671 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:51:10.991671 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 11:51:10.991671 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 11:51:10.991671 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 11:51:10.993427 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 11:51:10.993427 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 11:51:10.993427 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 11:51:10.993427 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 11:51:10.993427 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 11:51:10.993427 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 11:51:10.993427 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 11:51:10.993427 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67e104da-8254-4f6d-aed9-c0bbe8f53c80 could not be found. Jul 11 11:51:10.993427 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:51:10.993427 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:51:10.993427 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:51:10.993427 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:51:10.993427 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:51:10.993427 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:51:10.993427 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 11:51:10.993427 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 11:51:10.993427 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67e104da-8254-4f6d-aed9-c0bbe8f53c80 could not be found. Jul 11 11:51:10.993427 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:51:10.995017 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-515aee10-3ce1-4f77-b462-f392c541cdcc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Returning 404 to user: Instance 67e104da-8254-4f6d-aed9-c0bbe8f53c80 could not be found. {{(pid=118321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 11:51:10.995017 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-515aee10-3ce1-4f77-b462-f392c541cdcc tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/67e104da-8254-4f6d-aed9-c0bbe8f53c80" status: 404 len: 111 microversion: 2.1 time: 0.029315 Jul 11 11:51:10.995017 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1457/2918] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:51:10 2022] GET /compute/v2.1/servers/67e104da-8254-4f6d-aed9-c0bbe8f53c80 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 11:51:10.995341 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-2dd86b73-53f6-42f5-9b54-f1d5953daa63 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '.version_select at 0x7fb0102e78b0>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:51:11.053371 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-2dd86b73-53f6-42f5-9b54-f1d5953daa63 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1587471309" status: 202 len: 0 microversion: 2.1 time: 0.069207 Jul 11 11:51:11.053952 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1462/2919] 10.222.0.26 () {58 vars in 1220 bytes} [Mon Jul 11 11:51:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1587471309 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 11:51:11.767529 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-b250c1a5-1460-47fa-9c2e-825f7d3f62c6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:51:11.768025 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-b250c1a5-1460-47fa-9c2e-825f7d3f62c6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 67e104da-8254-4f6d-aed9-c0bbe8f53c80] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:51:11.774276 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b250c1a5-1460-47fa-9c2e-825f7d3f62c6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:51:11.774727 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b250c1a5-1460-47fa-9c2e-825f7d3f62c6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:51:11.775526 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b250c1a5-1460-47fa-9c2e-825f7d3f62c6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:51:11.775986 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b250c1a5-1460-47fa-9c2e-825f7d3f62c6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:51:11.790013 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.wsgi [None req-b250c1a5-1460-47fa-9c2e-825f7d3f62c6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] HTTP exception thrown: Instance 67e104da-8254-4f6d-aed9-c0bbe8f53c80 could not be found. Jul 11 11:51:11.791625 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-b250c1a5-1460-47fa-9c2e-825f7d3f62c6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Request method failure captured: Jul 11 11:51:11.791625 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: request: DELETE /compute/v2.1/servers/67e104da-8254-4f6d-aed9-c0bbe8f53c80 HTTP/1.1 Jul 11 11:51:11.791625 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Accept: application/json Jul 11 11:51:11.791625 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Accept-Encoding: identity Jul 11 11:51:11.791625 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Connection: close Jul 11 11:51:11.791625 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Content-Length: 0 Jul 11 11:51:11.791625 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Content-Type: application/json Jul 11 11:51:11.791625 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Host: 10.222.0.26 Jul 11 11:51:11.791625 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Openstack-System-Scope: None Jul 11 11:51:11.791625 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: User-Agent: python-urllib3/1.26.9 Jul 11 11:51:11.791625 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Auth-Token: gAAAAABizAjLO4PGFFyBld15DDnMmjOMiyTfdUbsyF5cUuFMKWxHvKhrCVTk7XeaeLJ6AedivEPaw_nguZ4-p4LDjB7T9a0W-yQx3Oeh_u82CdhrQ3J4zLhwezdPpzDSPXg3rjqJkU6X-m1m244kVxKJfdBOeXkvji1jVYDzL1HD6pHDIVJaMlQ Jul 11 11:51:11.791625 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Domain-Id: None Jul 11 11:51:11.791625 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Domain-Name: None Jul 11 11:51:11.791625 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Identity-Status: Confirmed Jul 11 11:51:11.791625 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Is-Admin-Project: True Jul 11 11:51:11.791625 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Domain-Id: default Jul 11 11:51:11.791625 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Domain-Name: Default Jul 11 11:51:11.791625 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Id: 5779b0ffa2244901a92adbee65b10421 Jul 11 11:51:11.791625 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Name: tempest-AttachVolumeTestJSON-1070974935 Jul 11 11:51:11.791625 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Role: member,reader Jul 11 11:51:11.791625 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Roles: member,reader Jul 11 11:51:11.793410 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5779b0ffa2244901a92adbee65b10421"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5779b0ffa2244901a92adbee65b10421"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5779b0ffa2244901a92adbee65b10421"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5779b0ffa2244901a92adbee65b10421"}]}] Jul 11 11:51:11.793410 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Tenant: tempest-AttachVolumeTestJSON-1070974935 Jul 11 11:51:11.793410 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Tenant-Id: 5779b0ffa2244901a92adbee65b10421 Jul 11 11:51:11.793410 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1070974935 Jul 11 11:51:11.793410 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User: tempest-AttachVolumeTestJSON-1070974935-project Jul 11 11:51:11.793410 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Domain-Id: default Jul 11 11:51:11.793410 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Domain-Name: Default Jul 11 11:51:11.793410 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Id: 15ff2cacb5c1450482597a2f5fa3c8a9 Jul 11 11:51:11.793410 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Name: tempest-AttachVolumeTestJSON-1070974935-project Jul 11 11:51:11.793410 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: method: > Jul 11 11:51:11.793410 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: exception: Instance 67e104da-8254-4f6d-aed9-c0bbe8f53c80 could not be found. Jul 11 11:51:11.793410 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: action_args: {'id': '67e104da-8254-4f6d-aed9-c0bbe8f53c80'} Jul 11 11:51:11.794379 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 11:51:11.794379 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:51:11.794379 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 11:51:11.794379 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 11:51:11.794379 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 11:51:11.794379 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 11:51:11.794379 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 11:51:11.794379 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 11:51:11.794379 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 11:51:11.794379 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 11:51:11.794379 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67e104da-8254-4f6d-aed9-c0bbe8f53c80 could not be found. Jul 11 11:51:11.794379 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:51:11.794379 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:51:11.794379 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:51:11.794379 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:51:11.794379 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:51:11.794379 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:51:11.794379 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 11:51:11.794379 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 11:51:11.794379 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 11:51:11.795841 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 11:51:11.795841 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 11 11:51:11.795841 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 11 11:51:11.795841 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 11 11:51:11.795841 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 11 11:51:11.795841 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 11:51:11.795841 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 11:51:11.795841 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 11:51:11.795841 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 11:51:11.795841 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67e104da-8254-4f6d-aed9-c0bbe8f53c80 could not be found. Jul 11 11:51:11.795841 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:51:11.795841 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:51:11.795841 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:51:11.795841 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:51:11.795841 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:51:11.795841 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:51:11.795841 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 11:51:11.795841 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 11:51:11.795841 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67e104da-8254-4f6d-aed9-c0bbe8f53c80 could not be found. Jul 11 11:51:11.795841 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:51:11.797317 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-b250c1a5-1460-47fa-9c2e-825f7d3f62c6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Returning 404 to user: Instance 67e104da-8254-4f6d-aed9-c0bbe8f53c80 could not be found. {{(pid=118321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 11:51:11.797317 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-b250c1a5-1460-47fa-9c2e-825f7d3f62c6 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "DELETE /compute/v2.1/servers/67e104da-8254-4f6d-aed9-c0bbe8f53c80" status: 404 len: 111 microversion: 2.1 time: 0.029342 Jul 11 11:51:11.797317 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1458/2920] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 11 11:51:11 2022] DELETE /compute/v2.1/servers/67e104da-8254-4f6d-aed9-c0bbe8f53c80 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 11:51:11.801412 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-94332d62-6b4b-452d-8f39-a0296b66c54e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:51:11.802691 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-94332d62-6b4b-452d-8f39-a0296b66c54e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 67e104da-8254-4f6d-aed9-c0bbe8f53c80] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:51:11.808669 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-94332d62-6b4b-452d-8f39-a0296b66c54e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:51:11.809137 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-94332d62-6b4b-452d-8f39-a0296b66c54e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:51:11.809876 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-94332d62-6b4b-452d-8f39-a0296b66c54e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:51:11.810336 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-94332d62-6b4b-452d-8f39-a0296b66c54e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:51:11.823531 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.wsgi [None req-94332d62-6b4b-452d-8f39-a0296b66c54e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] HTTP exception thrown: Instance 67e104da-8254-4f6d-aed9-c0bbe8f53c80 could not be found. Jul 11 11:51:11.825189 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-94332d62-6b4b-452d-8f39-a0296b66c54e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Request method failure captured: Jul 11 11:51:11.825189 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: request: GET /compute/v2.1/servers/67e104da-8254-4f6d-aed9-c0bbe8f53c80 HTTP/1.1 Jul 11 11:51:11.825189 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Accept: application/json Jul 11 11:51:11.825189 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Accept-Encoding: identity Jul 11 11:51:11.825189 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Connection: close Jul 11 11:51:11.825189 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Content-Length: 0 Jul 11 11:51:11.825189 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Content-Type: application/json Jul 11 11:51:11.825189 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Host: 10.222.0.26 Jul 11 11:51:11.825189 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Openstack-System-Scope: None Jul 11 11:51:11.825189 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: User-Agent: python-urllib3/1.26.9 Jul 11 11:51:11.825189 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Auth-Token: gAAAAABizAjLO4PGFFyBld15DDnMmjOMiyTfdUbsyF5cUuFMKWxHvKhrCVTk7XeaeLJ6AedivEPaw_nguZ4-p4LDjB7T9a0W-yQx3Oeh_u82CdhrQ3J4zLhwezdPpzDSPXg3rjqJkU6X-m1m244kVxKJfdBOeXkvji1jVYDzL1HD6pHDIVJaMlQ Jul 11 11:51:11.825189 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Domain-Id: None Jul 11 11:51:11.825189 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Domain-Name: None Jul 11 11:51:11.825189 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Identity-Status: Confirmed Jul 11 11:51:11.825189 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Is-Admin-Project: True Jul 11 11:51:11.825189 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Domain-Id: default Jul 11 11:51:11.825189 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Domain-Name: Default Jul 11 11:51:11.825189 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Id: 5779b0ffa2244901a92adbee65b10421 Jul 11 11:51:11.825189 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Name: tempest-AttachVolumeTestJSON-1070974935 Jul 11 11:51:11.825189 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Role: member,reader Jul 11 11:51:11.825189 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Roles: member,reader Jul 11 11:51:11.826922 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5779b0ffa2244901a92adbee65b10421"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5779b0ffa2244901a92adbee65b10421"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5779b0ffa2244901a92adbee65b10421"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5779b0ffa2244901a92adbee65b10421"}]}] Jul 11 11:51:11.826922 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Tenant: tempest-AttachVolumeTestJSON-1070974935 Jul 11 11:51:11.826922 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Tenant-Id: 5779b0ffa2244901a92adbee65b10421 Jul 11 11:51:11.826922 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1070974935 Jul 11 11:51:11.826922 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User: tempest-AttachVolumeTestJSON-1070974935-project Jul 11 11:51:11.826922 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Domain-Id: default Jul 11 11:51:11.826922 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Domain-Name: Default Jul 11 11:51:11.826922 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Id: 15ff2cacb5c1450482597a2f5fa3c8a9 Jul 11 11:51:11.826922 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Name: tempest-AttachVolumeTestJSON-1070974935-project Jul 11 11:51:11.826922 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: method: > Jul 11 11:51:11.826922 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: exception: Instance 67e104da-8254-4f6d-aed9-c0bbe8f53c80 could not be found. Jul 11 11:51:11.826922 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: action_args: {'id': '67e104da-8254-4f6d-aed9-c0bbe8f53c80'} Jul 11 11:51:11.827944 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 11:51:11.827944 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:51:11.827944 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 11:51:11.827944 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 11:51:11.827944 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 11:51:11.827944 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 11:51:11.827944 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 11:51:11.827944 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 11:51:11.827944 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 11:51:11.827944 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 11:51:11.827944 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67e104da-8254-4f6d-aed9-c0bbe8f53c80 could not be found. Jul 11 11:51:11.827944 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:51:11.827944 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:51:11.827944 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:51:11.827944 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:51:11.827944 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:51:11.827944 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:51:11.827944 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 11:51:11.827944 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 11:51:11.827944 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 11:51:11.829579 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 11:51:11.829579 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 11:51:11.829579 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 11:51:11.829579 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 11:51:11.829579 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 11:51:11.829579 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 11:51:11.829579 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 11:51:11.829579 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67e104da-8254-4f6d-aed9-c0bbe8f53c80 could not be found. Jul 11 11:51:11.829579 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:51:11.829579 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:51:11.829579 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:51:11.829579 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:51:11.829579 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:51:11.829579 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:51:11.829579 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 11:51:11.829579 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 11:51:11.829579 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67e104da-8254-4f6d-aed9-c0bbe8f53c80 could not be found. Jul 11 11:51:11.829579 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:51:11.831015 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-94332d62-6b4b-452d-8f39-a0296b66c54e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Returning 404 to user: Instance 67e104da-8254-4f6d-aed9-c0bbe8f53c80 could not be found. {{(pid=118322) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 11:51:11.831015 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-94332d62-6b4b-452d-8f39-a0296b66c54e tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/67e104da-8254-4f6d-aed9-c0bbe8f53c80" status: 404 len: 111 microversion: 2.1 time: 0.028988 Jul 11 11:51:11.831015 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1463/2921] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:51:11 2022] GET /compute/v2.1/servers/67e104da-8254-4f6d-aed9-c0bbe8f53c80 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 11:51:18.476874 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-760f8c11-d7ad-4047-bb0e-6123523bfe27 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:51:18.477448 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-760f8c11-d7ad-4047-bb0e-6123523bfe27 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 44d404ef-3afd-41b2-8f49-8912a6434af5] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:51:18.484616 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-760f8c11-d7ad-4047-bb0e-6123523bfe27 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:51:18.494140 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-760f8c11-d7ad-4047-bb0e-6123523bfe27 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:51:18.494140 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-760f8c11-d7ad-4047-bb0e-6123523bfe27 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:51:18.494140 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-760f8c11-d7ad-4047-bb0e-6123523bfe27 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:51:18.511460 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-760f8c11-d7ad-4047-bb0e-6123523bfe27 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 44d404ef-3afd-41b2-8f49-8912a6434af5] Going to try to terminate instance {{(pid=118321) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 11:51:18.835176 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-760f8c11-d7ad-4047-bb0e-6123523bfe27 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "DELETE /compute/v2.1/servers/44d404ef-3afd-41b2-8f49-8912a6434af5" status: 204 len: 0 microversion: 2.1 time: 0.537879 Jul 11 11:51:18.835799 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1459/2922] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 11 11:51:18 2022] DELETE /compute/v2.1/servers/44d404ef-3afd-41b2-8f49-8912a6434af5 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 11 11:51:18.844066 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-83fe5c33-544e-4088-b095-b0e719c9275c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:51:18.845892 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-83fe5c33-544e-4088-b095-b0e719c9275c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 44d404ef-3afd-41b2-8f49-8912a6434af5] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:51:18.850899 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-83fe5c33-544e-4088-b095-b0e719c9275c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:51:18.851381 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-83fe5c33-544e-4088-b095-b0e719c9275c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:51:18.852142 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-83fe5c33-544e-4088-b095-b0e719c9275c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:51:18.852583 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-83fe5c33-544e-4088-b095-b0e719c9275c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:51:19.095788 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-83fe5c33-544e-4088-b095-b0e719c9275c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:51:19.102830 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-83fe5c33-544e-4088-b095-b0e719c9275c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/44d404ef-3afd-41b2-8f49-8912a6434af5" status: 200 len: 1681 microversion: 2.1 time: 0.262743 Jul 11 11:51:19.103466 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1464/2923] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:51:18 2022] GET /compute/v2.1/servers/44d404ef-3afd-41b2-8f49-8912a6434af5 => generated 1681 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:51:20.120139 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-23842f86-c152-4fb3-b336-33bddaba2e2d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:51:20.120862 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-23842f86-c152-4fb3-b336-33bddaba2e2d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 44d404ef-3afd-41b2-8f49-8912a6434af5] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:51:20.127370 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-23842f86-c152-4fb3-b336-33bddaba2e2d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:51:20.127813 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-23842f86-c152-4fb3-b336-33bddaba2e2d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:51:20.128560 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-23842f86-c152-4fb3-b336-33bddaba2e2d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:51:20.128997 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-23842f86-c152-4fb3-b336-33bddaba2e2d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:51:20.419571 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-23842f86-c152-4fb3-b336-33bddaba2e2d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:51:20.427894 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-23842f86-c152-4fb3-b336-33bddaba2e2d tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/44d404ef-3afd-41b2-8f49-8912a6434af5" status: 200 len: 1681 microversion: 2.1 time: 0.312092 Jul 11 11:51:20.428475 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1460/2924] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:51:20 2022] GET /compute/v2.1/servers/44d404ef-3afd-41b2-8f49-8912a6434af5 => generated 1681 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:51:21.334698 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [req-2a3dcbf8-3c9b-40f6-b5e2-e391377b0178 req-7d83b0d8-25ea-4723-857d-8e9cd3421b10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44d404ef-3afd-41b2-8f49-8912a6434af5", "name": "network-vif-deleted", "tag": "d5691174-9c58-4711-9af7-9d6c6cbb63ce"}]} {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:51:21.353642 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [req-2a3dcbf8-3c9b-40f6-b5e2-e391377b0178 req-7d83b0d8-25ea-4723-857d-8e9cd3421b10 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:51:21.353642 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [req-2a3dcbf8-3c9b-40f6-b5e2-e391377b0178 req-7d83b0d8-25ea-4723-857d-8e9cd3421b10 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:51:21.356189 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.compute.server_external_events [req-2a3dcbf8-3c9b-40f6-b5e2-e391377b0178 req-7d83b0d8-25ea-4723-857d-8e9cd3421b10 service nova] Creating event network-vif-deleted:d5691174-9c58-4711-9af7-9d6c6cbb63ce for instance 44d404ef-3afd-41b2-8f49-8912a6434af5 on hv-cinder-84842 Jul 11 11:51:21.361119 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [req-2a3dcbf8-3c9b-40f6-b5e2-e391377b0178 req-7d83b0d8-25ea-4723-857d-8e9cd3421b10 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030742 Jul 11 11:51:21.361708 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1465/2925] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 11:51:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:51:21.445853 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-637b3261-78fd-41ec-9513-90ad4bb1223e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:51:21.447805 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-637b3261-78fd-41ec-9513-90ad4bb1223e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 44d404ef-3afd-41b2-8f49-8912a6434af5] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:51:21.455317 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-637b3261-78fd-41ec-9513-90ad4bb1223e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:51:21.456058 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-637b3261-78fd-41ec-9513-90ad4bb1223e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:51:21.457193 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-637b3261-78fd-41ec-9513-90ad4bb1223e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:51:21.458419 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-637b3261-78fd-41ec-9513-90ad4bb1223e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:51:21.543672 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-637b3261-78fd-41ec-9513-90ad4bb1223e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:51:21.553436 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-637b3261-78fd-41ec-9513-90ad4bb1223e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/44d404ef-3afd-41b2-8f49-8912a6434af5" status: 200 len: 1615 microversion: 2.1 time: 0.112166 Jul 11 11:51:21.556148 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1461/2926] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:51:21 2022] GET /compute/v2.1/servers/44d404ef-3afd-41b2-8f49-8912a6434af5 => generated 1615 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:51:22.572174 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-19f2cd36-5f6e-41c5-9b5d-570659ab2054 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:51:22.573121 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-19f2cd36-5f6e-41c5-9b5d-570659ab2054 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 44d404ef-3afd-41b2-8f49-8912a6434af5] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:51:22.579237 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-19f2cd36-5f6e-41c5-9b5d-570659ab2054 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:51:22.579712 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-19f2cd36-5f6e-41c5-9b5d-570659ab2054 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:51:22.580458 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-19f2cd36-5f6e-41c5-9b5d-570659ab2054 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:51:22.580934 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-19f2cd36-5f6e-41c5-9b5d-570659ab2054 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:51:22.593693 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.wsgi [None req-19f2cd36-5f6e-41c5-9b5d-570659ab2054 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] HTTP exception thrown: Instance 44d404ef-3afd-41b2-8f49-8912a6434af5 could not be found. Jul 11 11:51:22.595285 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-19f2cd36-5f6e-41c5-9b5d-570659ab2054 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Request method failure captured: Jul 11 11:51:22.595285 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: request: GET /compute/v2.1/servers/44d404ef-3afd-41b2-8f49-8912a6434af5 HTTP/1.1 Jul 11 11:51:22.595285 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Accept: application/json Jul 11 11:51:22.595285 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Accept-Encoding: identity Jul 11 11:51:22.595285 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Connection: close Jul 11 11:51:22.595285 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Content-Length: 0 Jul 11 11:51:22.595285 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Content-Type: application/json Jul 11 11:51:22.595285 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Host: 10.222.0.26 Jul 11 11:51:22.595285 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Openstack-System-Scope: None Jul 11 11:51:22.595285 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: User-Agent: python-urllib3/1.26.9 Jul 11 11:51:22.595285 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Auth-Token: gAAAAABizAjKhZCKBRh_2i_ADibIvclpyQsJlC0Pm2ZTkb1jefgGS4P1r24evggFjxf1wK4Yv07Vbp7P1Zyv4wsuAQZPiSvMMxoEP8Q4ky7m10lr9iMNQTD4S9hixFXxSjWxJNmm7W7ummIraXw3SPwDOPKNnCr7rjbMh-sv9HcW6WLSiPnZrFU Jul 11 11:51:22.595285 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Domain-Id: None Jul 11 11:51:22.595285 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Domain-Name: None Jul 11 11:51:22.595285 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Identity-Status: Confirmed Jul 11 11:51:22.595285 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Is-Admin-Project: True Jul 11 11:51:22.595285 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Domain-Id: default Jul 11 11:51:22.595285 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Domain-Name: Default Jul 11 11:51:22.595285 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Id: 1328a510264f4374baabad7b5243d8c2 Jul 11 11:51:22.595285 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Name: tempest-AttachVolumeNegativeTest-1544092161 Jul 11 11:51:22.595285 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Role: member,reader Jul 11 11:51:22.595285 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Roles: member,reader Jul 11 11:51:22.597080 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1328a510264f4374baabad7b5243d8c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1328a510264f4374baabad7b5243d8c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1328a510264f4374baabad7b5243d8c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1328a510264f4374baabad7b5243d8c2"}]}] Jul 11 11:51:22.597080 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Tenant: tempest-AttachVolumeNegativeTest-1544092161 Jul 11 11:51:22.597080 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Tenant-Id: 1328a510264f4374baabad7b5243d8c2 Jul 11 11:51:22.597080 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1544092161 Jul 11 11:51:22.597080 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User: tempest-AttachVolumeNegativeTest-1544092161-project Jul 11 11:51:22.597080 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Domain-Id: default Jul 11 11:51:22.597080 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Domain-Name: Default Jul 11 11:51:22.597080 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Id: cbcc15c786fb43669ac34a4897735c1d Jul 11 11:51:22.597080 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Name: tempest-AttachVolumeNegativeTest-1544092161-project Jul 11 11:51:22.597080 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: method: > Jul 11 11:51:22.597080 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: exception: Instance 44d404ef-3afd-41b2-8f49-8912a6434af5 could not be found. Jul 11 11:51:22.597080 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: action_args: {'id': '44d404ef-3afd-41b2-8f49-8912a6434af5'} Jul 11 11:51:22.598095 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 11:51:22.598095 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:51:22.598095 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 11:51:22.598095 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 11:51:22.598095 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 11:51:22.598095 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 11:51:22.598095 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 11:51:22.598095 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 11:51:22.598095 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 11:51:22.598095 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 11:51:22.598095 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44d404ef-3afd-41b2-8f49-8912a6434af5 could not be found. Jul 11 11:51:22.598095 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:51:22.598095 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:51:22.598095 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:51:22.598095 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:51:22.598095 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:51:22.598095 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:51:22.598095 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 11:51:22.598095 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 11:51:22.598095 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 11:51:22.601477 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 11:51:22.601477 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 11:51:22.601477 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 11:51:22.601477 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 11:51:22.601477 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 11:51:22.601477 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 11:51:22.601477 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 11:51:22.601477 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44d404ef-3afd-41b2-8f49-8912a6434af5 could not be found. Jul 11 11:51:22.601477 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:51:22.601477 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:51:22.601477 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:51:22.601477 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:51:22.601477 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:51:22.601477 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:51:22.601477 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 11:51:22.601477 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 11:51:22.601477 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44d404ef-3afd-41b2-8f49-8912a6434af5 could not be found. Jul 11 11:51:22.601477 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:51:22.602932 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-19f2cd36-5f6e-41c5-9b5d-570659ab2054 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Returning 404 to user: Instance 44d404ef-3afd-41b2-8f49-8912a6434af5 could not be found. {{(pid=118322) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 11:51:22.602932 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-19f2cd36-5f6e-41c5-9b5d-570659ab2054 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/44d404ef-3afd-41b2-8f49-8912a6434af5" status: 404 len: 111 microversion: 2.1 time: 0.029777 Jul 11 11:51:22.602932 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1466/2927] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:51:22 2022] GET /compute/v2.1/servers/44d404ef-3afd-41b2-8f49-8912a6434af5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 11:51:22.608162 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-96fe7681-0039-4826-9d40-5e817875797e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '.version_select at 0x7fb010490310>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:51:22.708581 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-96fe7681-0039-4826-9d40-5e817875797e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1713052200" status: 202 len: 0 microversion: 2.1 time: 0.104106 Jul 11 11:51:22.709151 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1462/2928] 10.222.0.26 () {58 vars in 1220 bytes} [Mon Jul 11 11:51:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1713052200 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 11:51:22.901718 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-4986a33f-9f02-457a-98bd-6f0ba9dc50ee tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:51:22.902219 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-4986a33f-9f02-457a-98bd-6f0ba9dc50ee tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] [instance: cedf9f3b-4453-41d4-aa67-547bff886542] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:51:22.908309 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4986a33f-9f02-457a-98bd-6f0ba9dc50ee tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:51:22.908758 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4986a33f-9f02-457a-98bd-6f0ba9dc50ee tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:51:22.909577 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4986a33f-9f02-457a-98bd-6f0ba9dc50ee tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:51:22.910031 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-4986a33f-9f02-457a-98bd-6f0ba9dc50ee tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:51:22.935391 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-4986a33f-9f02-457a-98bd-6f0ba9dc50ee tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] [instance: cedf9f3b-4453-41d4-aa67-547bff886542] Going to try to terminate instance {{(pid=118322) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 11:51:23.234931 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-4986a33f-9f02-457a-98bd-6f0ba9dc50ee tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] 10.222.0.26 "DELETE /compute/v2.1/servers/cedf9f3b-4453-41d4-aa67-547bff886542" status: 204 len: 0 microversion: 2.1 time: 0.336714 Jul 11 11:51:23.235474 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1467/2929] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 11 11:51:22 2022] DELETE /compute/v2.1/servers/cedf9f3b-4453-41d4-aa67-547bff886542 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 11 11:51:23.244741 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-427027d3-d7d6-48a3-8b2c-bb611c48c538 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:51:23.245469 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-427027d3-d7d6-48a3-8b2c-bb611c48c538 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] [instance: cedf9f3b-4453-41d4-aa67-547bff886542] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:51:23.251472 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-427027d3-d7d6-48a3-8b2c-bb611c48c538 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:51:23.251918 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-427027d3-d7d6-48a3-8b2c-bb611c48c538 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:51:23.252660 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-427027d3-d7d6-48a3-8b2c-bb611c48c538 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:51:23.253108 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-427027d3-d7d6-48a3-8b2c-bb611c48c538 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:51:23.398531 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-427027d3-d7d6-48a3-8b2c-bb611c48c538 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559a564c171f4dd1abb3e4af27987bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a461d4496f4015969f2683af43afa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:51:23.406061 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-427027d3-d7d6-48a3-8b2c-bb611c48c538 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] 10.222.0.26 "GET /compute/v2.1/servers/cedf9f3b-4453-41d4-aa67-547bff886542" status: 200 len: 1554 microversion: 2.1 time: 0.165549 Jul 11 11:51:23.406639 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1463/2930] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:51:23 2022] GET /compute/v2.1/servers/cedf9f3b-4453-41d4-aa67-547bff886542 => generated 1554 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:51:23.534928 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-8e17fc90-f180-4c6d-9729-a5b3fdd4677c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Action: 'create', calling method: .version_select at 0x7fb010291550>, body: {"keypair": {"name": "tempest-keypair-593229138", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP37/B3kUMQIHlEol5EXGJiBxiF0FRmXZYnattmZ0p79LrRwCCcRt0HdfeDkrz20+JPTskRKg1Gha6G8gakYnooCtuUA3XOuwOlHL8zTyUhpjft7DvqDdW5pCFOBLDPC0g=="}} {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:51:23.549437 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.quota [None req-8e17fc90-f180-4c6d-9729-a5b3fdd4677c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Getting quotas for project 1328a510264f4374baabad7b5243d8c2. Resources: {'key_pairs'} {{(pid=118322) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 11:51:23.553373 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.quota [None req-8e17fc90-f180-4c6d-9729-a5b3fdd4677c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Getting quotas for user cbcc15c786fb43669ac34a4897735c1d and project 1328a510264f4374baabad7b5243d8c2. Resources: {'key_pairs'} {{(pid=118322) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 11:51:23.642283 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-8e17fc90-f180-4c6d-9729-a5b3fdd4677c tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.111494 Jul 11 11:51:23.642994 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1468/2931] 10.222.0.26 () {60 vars in 1158 bytes} [Mon Jul 11 11:51:23 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:51:24.160421 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [req-ead96f23-0ad0-4c97-84d4-719c0bcd031f req-850ed4fc-ec26-4ace-a2af-baa578233706 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cedf9f3b-4453-41d4-aa67-547bff886542", "name": "network-vif-deleted", "tag": "d54240af-33ee-4d7a-a812-19b21e1319d6"}]} {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:51:24.170218 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [req-ead96f23-0ad0-4c97-84d4-719c0bcd031f req-850ed4fc-ec26-4ace-a2af-baa578233706 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:51:24.170667 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [req-ead96f23-0ad0-4c97-84d4-719c0bcd031f req-850ed4fc-ec26-4ace-a2af-baa578233706 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:51:24.182438 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.compute.server_external_events [req-ead96f23-0ad0-4c97-84d4-719c0bcd031f req-850ed4fc-ec26-4ace-a2af-baa578233706 service nova] Creating event network-vif-deleted:d54240af-33ee-4d7a-a812-19b21e1319d6 for instance cedf9f3b-4453-41d4-aa67-547bff886542 on hv-cinder-84842 Jul 11 11:51:24.187577 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [req-ead96f23-0ad0-4c97-84d4-719c0bcd031f req-850ed4fc-ec26-4ace-a2af-baa578233706 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030703 Jul 11 11:51:24.188178 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1464/2932] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 11:51:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:51:24.424196 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-093765be-e098-457d-b62a-a47164600ba3 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:51:24.424923 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-093765be-e098-457d-b62a-a47164600ba3 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] [instance: cedf9f3b-4453-41d4-aa67-547bff886542] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:51:24.432009 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-093765be-e098-457d-b62a-a47164600ba3 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:51:24.432501 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-093765be-e098-457d-b62a-a47164600ba3 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:51:24.433276 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-093765be-e098-457d-b62a-a47164600ba3 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:51:24.433718 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-093765be-e098-457d-b62a-a47164600ba3 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:51:24.466739 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-093765be-e098-457d-b62a-a47164600ba3 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:51:24.467193 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-093765be-e098-457d-b62a-a47164600ba3 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:51:24.467699 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.objects.instance [None req-093765be-e098-457d-b62a-a47164600ba3 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lazy-loading 'fault' on Instance uuid cedf9f3b-4453-41d4-aa67-547bff886542 {{(pid=118322) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 11:51:24.512175 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-093765be-e098-457d-b62a-a47164600ba3 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559a564c171f4dd1abb3e4af27987bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a461d4496f4015969f2683af43afa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:51:24.521000 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-093765be-e098-457d-b62a-a47164600ba3 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] 10.222.0.26 "GET /compute/v2.1/servers/cedf9f3b-4453-41d4-aa67-547bff886542" status: 200 len: 1349 microversion: 2.1 time: 0.100940 Jul 11 11:51:24.522256 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1469/2933] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:51:24 2022] GET /compute/v2.1/servers/cedf9f3b-4453-41d4-aa67-547bff886542 => generated 1349 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:51:25.540164 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-37b1f14c-f56d-410f-8082-1d501ead039e tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:51:25.540872 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-37b1f14c-f56d-410f-8082-1d501ead039e tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] [instance: cedf9f3b-4453-41d4-aa67-547bff886542] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:51:25.547027 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-37b1f14c-f56d-410f-8082-1d501ead039e tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:51:25.547504 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-37b1f14c-f56d-410f-8082-1d501ead039e tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:51:25.548272 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-37b1f14c-f56d-410f-8082-1d501ead039e tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:51:25.548707 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-37b1f14c-f56d-410f-8082-1d501ead039e tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:51:25.562370 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.wsgi [None req-37b1f14c-f56d-410f-8082-1d501ead039e tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] HTTP exception thrown: Instance cedf9f3b-4453-41d4-aa67-547bff886542 could not be found. Jul 11 11:51:25.564041 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-37b1f14c-f56d-410f-8082-1d501ead039e tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Request method failure captured: Jul 11 11:51:25.564041 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: request: GET /compute/v2.1/servers/cedf9f3b-4453-41d4-aa67-547bff886542 HTTP/1.1 Jul 11 11:51:25.564041 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Accept: application/json Jul 11 11:51:25.564041 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Accept-Encoding: identity Jul 11 11:51:25.564041 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Connection: close Jul 11 11:51:25.564041 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Content-Length: 0 Jul 11 11:51:25.564041 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Content-Type: application/json Jul 11 11:51:25.564041 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Host: 10.222.0.26 Jul 11 11:51:25.564041 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Openstack-System-Scope: None Jul 11 11:51:25.564041 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: User-Agent: python-urllib3/1.26.9 Jul 11 11:51:25.564041 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Auth-Token: gAAAAABizAt3E1t4iB--PtxLCw6hduswyoJ1uqUzv7F8zSO1yFSlQFGRSLGfNF96NPUWs3wJ3RlykfbJoapmdWRbUvFtZXEqmPAD0eQa2Q7iQZf-Y10GFkLx7B9gqCD6kqVSBLwFccmzqBdQSsGs97AX6iwq4GwyuNVkQ50cOmkHllRw7P4togI Jul 11 11:51:25.564041 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Domain-Id: None Jul 11 11:51:25.564041 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Domain-Name: None Jul 11 11:51:25.564041 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Identity-Status: Confirmed Jul 11 11:51:25.564041 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Is-Admin-Project: True Jul 11 11:51:25.564041 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Domain-Id: default Jul 11 11:51:25.564041 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Domain-Name: Default Jul 11 11:51:25.564041 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Id: 72a461d4496f4015969f2683af43afa7 Jul 11 11:51:25.564041 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Name: tempest-TestMinimumBasicScenario-1527037439 Jul 11 11:51:25.564041 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Role: member,reader Jul 11 11:51:25.564041 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Roles: member,reader Jul 11 11:51:25.565944 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_72a461d4496f4015969f2683af43afa7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/72a461d4496f4015969f2683af43afa7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/72a461d4496f4015969f2683af43afa7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/72a461d4496f4015969f2683af43afa7"}]}] Jul 11 11:51:25.565944 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Tenant: tempest-TestMinimumBasicScenario-1527037439 Jul 11 11:51:25.565944 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Tenant-Id: 72a461d4496f4015969f2683af43afa7 Jul 11 11:51:25.565944 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1527037439 Jul 11 11:51:25.565944 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User: tempest-TestMinimumBasicScenario-1527037439-project Jul 11 11:51:25.565944 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Domain-Id: default Jul 11 11:51:25.565944 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Domain-Name: Default Jul 11 11:51:25.565944 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Id: 559a564c171f4dd1abb3e4af27987bbd Jul 11 11:51:25.565944 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Name: tempest-TestMinimumBasicScenario-1527037439-project Jul 11 11:51:25.565944 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: method: > Jul 11 11:51:25.565944 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: exception: Instance cedf9f3b-4453-41d4-aa67-547bff886542 could not be found. Jul 11 11:51:25.565944 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: action_args: {'id': 'cedf9f3b-4453-41d4-aa67-547bff886542'} Jul 11 11:51:25.567149 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 11:51:25.567149 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:51:25.567149 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 11:51:25.567149 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 11:51:25.567149 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 11:51:25.567149 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 11:51:25.567149 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 11:51:25.567149 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 11:51:25.567149 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 11:51:25.567149 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 11:51:25.567149 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cedf9f3b-4453-41d4-aa67-547bff886542 could not be found. Jul 11 11:51:25.567149 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:51:25.567149 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:51:25.567149 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:51:25.567149 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:51:25.567149 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:51:25.567149 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:51:25.567149 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 11:51:25.567149 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 11:51:25.567149 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 11:51:25.568860 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 11:51:25.568860 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 11:51:25.568860 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 11:51:25.568860 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 11:51:25.568860 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 11:51:25.568860 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 11:51:25.568860 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 11:51:25.568860 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cedf9f3b-4453-41d4-aa67-547bff886542 could not be found. Jul 11 11:51:25.568860 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:51:25.568860 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:51:25.568860 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:51:25.568860 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:51:25.568860 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:51:25.568860 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:51:25.568860 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 11:51:25.568860 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 11:51:25.568860 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cedf9f3b-4453-41d4-aa67-547bff886542 could not be found. Jul 11 11:51:25.568860 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:51:25.570458 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-37b1f14c-f56d-410f-8082-1d501ead039e tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Returning 404 to user: Instance cedf9f3b-4453-41d4-aa67-547bff886542 could not be found. {{(pid=118321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 11:51:25.570458 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-37b1f14c-f56d-410f-8082-1d501ead039e tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] 10.222.0.26 "GET /compute/v2.1/servers/cedf9f3b-4453-41d4-aa67-547bff886542" status: 404 len: 111 microversion: 2.1 time: 0.030830 Jul 11 11:51:25.570458 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1465/2934] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:51:25 2022] GET /compute/v2.1/servers/cedf9f3b-4453-41d4-aa67-547bff886542 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 11:51:25.574363 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-965e415f-b75e-4c8c-ad35-a833ac8ee8b7 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] Calling method '.version_select at 0x7fb01007ab80>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:51:25.670431 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-965e415f-b75e-4c8c-ad35-a833ac8ee8b7 tempest-TestMinimumBasicScenario-1527037439 tempest-TestMinimumBasicScenario-1527037439-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1214071285" status: 202 len: 0 microversion: 2.1 time: 0.100007 Jul 11 11:51:25.671051 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1470/2935] 10.222.0.26 () {58 vars in 1271 bytes} [Mon Jul 11 11:51:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1214071285 => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 11 11:51:26.128501 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-eee30249-270f-4b83-be6f-8d178df306e6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-612137977", "imageRef": "1bb93fc1-b713-4e67-8f76-bfec3a96168b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "415c4ce2-00a4-4e63-ad18-4153e0b2d10b"}], "security_groups": [{"name": "tempest-securitygroup--2030260096"}], "key_name": "tempest-keypair-593229138", "user_data": "}} {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:51:26.232877 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.network.neutron [None req-eee30249-270f-4b83-be6f-8d178df306e6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] validate_networks() for [('415c4ce2-00a4-4e63-ad18-4153e0b2d10b', None, None, None, None, None)] {{(pid=118321) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 11:51:26.658754 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.virt.hardware [None req-eee30249-270f-4b83-be6f-8d178df306e6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Flavor limits 0:0:0 {{(pid=118321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 11:51:26.659433 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.virt.hardware [None req-eee30249-270f-4b83-be6f-8d178df306e6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Image limits 0:0:0 {{(pid=118321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 11:51:26.659729 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.virt.hardware [None req-eee30249-270f-4b83-be6f-8d178df306e6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Flavor pref 0:0:0 {{(pid=118321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 11:51:26.660141 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.virt.hardware [None req-eee30249-270f-4b83-be6f-8d178df306e6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Image pref 0:0:0 {{(pid=118321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 11:51:26.660553 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.virt.hardware [None req-eee30249-270f-4b83-be6f-8d178df306e6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 11:51:26.669908 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-eee30249-270f-4b83-be6f-8d178df306e6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:51:26.670364 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-eee30249-270f-4b83-be6f-8d178df306e6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:51:26.671162 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-eee30249-270f-4b83-be6f-8d178df306e6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:51:26.671645 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-eee30249-270f-4b83-be6f-8d178df306e6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:51:26.689412 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.quota [None req-eee30249-270f-4b83-be6f-8d178df306e6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Getting quotas for project 1328a510264f4374baabad7b5243d8c2. Resources: {'cores', 'ram', 'instances'} {{(pid=118321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 11:51:26.693682 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.quota [None req-eee30249-270f-4b83-be6f-8d178df306e6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Getting quotas for user cbcc15c786fb43669ac34a4897735c1d and project 1328a510264f4374baabad7b5243d8c2. Resources: {'cores', 'ram', 'instances'} {{(pid=118321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 11:51:26.704687 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-eee30249-270f-4b83-be6f-8d178df306e6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Going to run 1 instances... {{(pid=118321) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 11:51:26.706929 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-eee30249-270f-4b83-be6f-8d178df306e6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 6bbaa171-17c3-4169-a99b-0d7c803e66e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb93fc1-b713-4e67-8f76-bfec3a96168b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118321) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 11:51:26.838144 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-eee30249-270f-4b83-be6f-8d178df306e6 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.713810 Jul 11 11:51:26.838885 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1466/2936] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jul 11 11:51:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 715 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 11 11:51:26.850146 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-cb62154a-13f9-41bb-b329-2d0ce6328e1a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:51:26.851411 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-cb62154a-13f9-41bb-b329-2d0ce6328e1a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 6bbaa171-17c3-4169-a99b-0d7c803e66e4] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:51:26.907812 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-cb62154a-13f9-41bb-b329-2d0ce6328e1a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:51:26.915038 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-cb62154a-13f9-41bb-b329-2d0ce6328e1a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/6bbaa171-17c3-4169-a99b-0d7c803e66e4" status: 200 len: 1240 microversion: 2.1 time: 0.070179 Jul 11 11:51:26.915643 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1471/2937] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:51:26 2022] GET /compute/v2.1/servers/6bbaa171-17c3-4169-a99b-0d7c803e66e4 => generated 1240 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:51:27.934952 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-018532a8-5d2e-4941-bf72-0ef925247493 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:51:27.935681 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-018532a8-5d2e-4941-bf72-0ef925247493 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 6bbaa171-17c3-4169-a99b-0d7c803e66e4] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:51:27.942789 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-018532a8-5d2e-4941-bf72-0ef925247493 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:51:27.943812 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-018532a8-5d2e-4941-bf72-0ef925247493 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:51:27.944647 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-018532a8-5d2e-4941-bf72-0ef925247493 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:51:27.945191 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-018532a8-5d2e-4941-bf72-0ef925247493 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:51:28.012318 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-018532a8-5d2e-4941-bf72-0ef925247493 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:51:28.019636 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-018532a8-5d2e-4941-bf72-0ef925247493 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/6bbaa171-17c3-4169-a99b-0d7c803e66e4" status: 200 len: 1236 microversion: 2.1 time: 0.090907 Jul 11 11:51:28.020339 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1467/2938] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:51:27 2022] GET /compute/v2.1/servers/6bbaa171-17c3-4169-a99b-0d7c803e66e4 => generated 1236 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:51:29.043983 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-d76e3281-c09c-4d2a-892d-b787fdec9dfd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:51:29.047839 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-d76e3281-c09c-4d2a-892d-b787fdec9dfd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 6bbaa171-17c3-4169-a99b-0d7c803e66e4] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:51:29.057940 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d76e3281-c09c-4d2a-892d-b787fdec9dfd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:51:29.059045 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d76e3281-c09c-4d2a-892d-b787fdec9dfd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:51:29.060166 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d76e3281-c09c-4d2a-892d-b787fdec9dfd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:51:29.060831 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d76e3281-c09c-4d2a-892d-b787fdec9dfd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:51:29.158865 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-d76e3281-c09c-4d2a-892d-b787fdec9dfd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:51:29.170933 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-d76e3281-c09c-4d2a-892d-b787fdec9dfd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/6bbaa171-17c3-4169-a99b-0d7c803e66e4" status: 200 len: 1298 microversion: 2.1 time: 0.135604 Jul 11 11:51:29.171799 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1472/2939] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:51:29 2022] GET /compute/v2.1/servers/6bbaa171-17c3-4169-a99b-0d7c803e66e4 => generated 1298 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:51:30.193469 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-c862bc96-bf5d-44d8-9d98-7856cd15790e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:51:30.195319 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-c862bc96-bf5d-44d8-9d98-7856cd15790e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 6bbaa171-17c3-4169-a99b-0d7c803e66e4] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:51:30.204506 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c862bc96-bf5d-44d8-9d98-7856cd15790e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:51:30.205210 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c862bc96-bf5d-44d8-9d98-7856cd15790e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:51:30.206961 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c862bc96-bf5d-44d8-9d98-7856cd15790e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:51:30.207798 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c862bc96-bf5d-44d8-9d98-7856cd15790e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:51:30.514508 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-c862bc96-bf5d-44d8-9d98-7856cd15790e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:51:30.531126 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-c862bc96-bf5d-44d8-9d98-7856cd15790e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/6bbaa171-17c3-4169-a99b-0d7c803e66e4" status: 200 len: 1366 microversion: 2.1 time: 0.343398 Jul 11 11:51:30.539153 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1468/2940] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:51:30 2022] GET /compute/v2.1/servers/6bbaa171-17c3-4169-a99b-0d7c803e66e4 => generated 1366 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:51:31.026350 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [req-807ba3ab-e5ee-45e5-933d-18623fd945c2 req-7f252cb5-980c-4806-856d-eeeecaa5b930 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bbaa171-17c3-4169-a99b-0d7c803e66e4", "tag": "6001114a-1028-4d57-9739-ea5d53ab51d4"}]} {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:51:31.053911 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [req-807ba3ab-e5ee-45e5-933d-18623fd945c2 req-7f252cb5-980c-4806-856d-eeeecaa5b930 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:51:31.055599 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [req-807ba3ab-e5ee-45e5-933d-18623fd945c2 req-7f252cb5-980c-4806-856d-eeeecaa5b930 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:51:31.073487 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.compute.server_external_events [req-807ba3ab-e5ee-45e5-933d-18623fd945c2 req-7f252cb5-980c-4806-856d-eeeecaa5b930 service nova] Creating event network-changed:6001114a-1028-4d57-9739-ea5d53ab51d4 for instance 6bbaa171-17c3-4169-a99b-0d7c803e66e4 on hv-cinder-84842 Jul 11 11:51:31.078495 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [req-807ba3ab-e5ee-45e5-933d-18623fd945c2 req-7f252cb5-980c-4806-856d-eeeecaa5b930 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055911 Jul 11 11:51:31.079089 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1473/2941] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 11:51:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:51:31.556902 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-7199ef9b-d17a-46b2-abde-6a7afd22ab7e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:51:31.558427 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-7199ef9b-d17a-46b2-abde-6a7afd22ab7e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 6bbaa171-17c3-4169-a99b-0d7c803e66e4] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:51:31.564227 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7199ef9b-d17a-46b2-abde-6a7afd22ab7e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:51:31.564793 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7199ef9b-d17a-46b2-abde-6a7afd22ab7e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:51:31.565964 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7199ef9b-d17a-46b2-abde-6a7afd22ab7e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:51:31.566499 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7199ef9b-d17a-46b2-abde-6a7afd22ab7e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:51:31.785830 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-7199ef9b-d17a-46b2-abde-6a7afd22ab7e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:51:31.795778 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-7199ef9b-d17a-46b2-abde-6a7afd22ab7e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/6bbaa171-17c3-4169-a99b-0d7c803e66e4" status: 200 len: 1366 microversion: 2.1 time: 0.243498 Jul 11 11:51:31.804978 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1469/2942] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:51:31 2022] GET /compute/v2.1/servers/6bbaa171-17c3-4169-a99b-0d7c803e66e4 => generated 1366 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:51:32.813365 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-45b8aa7c-f267-4ff5-80e5-11ee910afd53 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:51:32.814075 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-45b8aa7c-f267-4ff5-80e5-11ee910afd53 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 6bbaa171-17c3-4169-a99b-0d7c803e66e4] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:51:32.822009 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-45b8aa7c-f267-4ff5-80e5-11ee910afd53 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:51:32.822723 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-45b8aa7c-f267-4ff5-80e5-11ee910afd53 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:51:32.823754 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-45b8aa7c-f267-4ff5-80e5-11ee910afd53 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:51:32.824194 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-45b8aa7c-f267-4ff5-80e5-11ee910afd53 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:51:33.001371 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-45b8aa7c-f267-4ff5-80e5-11ee910afd53 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:51:33.008898 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-45b8aa7c-f267-4ff5-80e5-11ee910afd53 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/6bbaa171-17c3-4169-a99b-0d7c803e66e4" status: 200 len: 1366 microversion: 2.1 time: 0.199903 Jul 11 11:51:33.009489 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1474/2943] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:51:32 2022] GET /compute/v2.1/servers/6bbaa171-17c3-4169-a99b-0d7c803e66e4 => generated 1366 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:51:34.031911 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-b7b30e43-e48d-4fa7-a4d6-f1efbf1e312e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:51:34.032530 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-b7b30e43-e48d-4fa7-a4d6-f1efbf1e312e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 6bbaa171-17c3-4169-a99b-0d7c803e66e4] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:51:34.040015 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b7b30e43-e48d-4fa7-a4d6-f1efbf1e312e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:51:34.049594 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b7b30e43-e48d-4fa7-a4d6-f1efbf1e312e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:51:34.050705 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b7b30e43-e48d-4fa7-a4d6-f1efbf1e312e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:51:34.051372 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b7b30e43-e48d-4fa7-a4d6-f1efbf1e312e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:51:34.304699 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-b7b30e43-e48d-4fa7-a4d6-f1efbf1e312e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:51:34.314552 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-b7b30e43-e48d-4fa7-a4d6-f1efbf1e312e tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/6bbaa171-17c3-4169-a99b-0d7c803e66e4" status: 200 len: 1366 microversion: 2.1 time: 0.286305 Jul 11 11:51:34.316042 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1470/2944] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:51:34 2022] GET /compute/v2.1/servers/6bbaa171-17c3-4169-a99b-0d7c803e66e4 => generated 1366 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:51:35.331907 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-fa4a2910-2c49-4171-933e-853619a922cf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:51:35.332470 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-fa4a2910-2c49-4171-933e-853619a922cf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 6bbaa171-17c3-4169-a99b-0d7c803e66e4] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:51:35.339729 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fa4a2910-2c49-4171-933e-853619a922cf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:51:35.340207 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fa4a2910-2c49-4171-933e-853619a922cf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:51:35.340974 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fa4a2910-2c49-4171-933e-853619a922cf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:51:35.341409 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-fa4a2910-2c49-4171-933e-853619a922cf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:51:35.478928 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-fa4a2910-2c49-4171-933e-853619a922cf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:51:35.486235 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-fa4a2910-2c49-4171-933e-853619a922cf tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/6bbaa171-17c3-4169-a99b-0d7c803e66e4" status: 200 len: 1366 microversion: 2.1 time: 0.158225 Jul 11 11:51:35.488532 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1475/2945] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:51:35 2022] GET /compute/v2.1/servers/6bbaa171-17c3-4169-a99b-0d7c803e66e4 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:51:36.223733 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [req-a60e136f-dc6d-4cdc-baa4-51ac871bf39e req-d39a5abf-1450-46d9-83f4-7971a8a4256f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bbaa171-17c3-4169-a99b-0d7c803e66e4", "name": "network-vif-plugged", "status": "completed", "tag": "6001114a-1028-4d57-9739-ea5d53ab51d4"}]} {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:51:36.223733 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:51:36.226920 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [req-a60e136f-dc6d-4cdc-baa4-51ac871bf39e req-d39a5abf-1450-46d9-83f4-7971a8a4256f service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:51:36.227398 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [req-a60e136f-dc6d-4cdc-baa4-51ac871bf39e req-d39a5abf-1450-46d9-83f4-7971a8a4256f service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:51:36.231000 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:51:36.238000 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.compute.server_external_events [req-a60e136f-dc6d-4cdc-baa4-51ac871bf39e req-d39a5abf-1450-46d9-83f4-7971a8a4256f service nova] Creating event network-vif-plugged:6001114a-1028-4d57-9739-ea5d53ab51d4 for instance 6bbaa171-17c3-4169-a99b-0d7c803e66e4 on hv-cinder-84842 Jul 11 11:51:36.243436 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [req-a60e136f-dc6d-4cdc-baa4-51ac871bf39e req-d39a5abf-1450-46d9-83f4-7971a8a4256f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029935 Jul 11 11:51:36.244293 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1471/2946] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 11:51:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:51:36.503424 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-6ea81b0f-c468-47d6-be7d-2562544a1cc8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:51:36.504257 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-6ea81b0f-c468-47d6-be7d-2562544a1cc8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 6bbaa171-17c3-4169-a99b-0d7c803e66e4] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:51:36.507080 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_api:SELECT=59,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:51:36.512190 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6ea81b0f-c468-47d6-be7d-2562544a1cc8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:51:36.513228 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6ea81b0f-c468-47d6-be7d-2562544a1cc8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:51:36.514809 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6ea81b0f-c468-47d6-be7d-2562544a1cc8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:51:36.515694 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6ea81b0f-c468-47d6-be7d-2562544a1cc8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:51:36.523108 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:51:36.653905 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-6ea81b0f-c468-47d6-be7d-2562544a1cc8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:51:36.662202 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-6ea81b0f-c468-47d6-be7d-2562544a1cc8 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/6bbaa171-17c3-4169-a99b-0d7c803e66e4" status: 200 len: 1366 microversion: 2.1 time: 0.161759 Jul 11 11:51:36.662790 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1476/2947] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:51:36 2022] GET /compute/v2.1/servers/6bbaa171-17c3-4169-a99b-0d7c803e66e4 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:51:37.677388 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell0:SELECT=2 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:51:37.678519 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell0:SELECT=6 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:51:37.683962 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-94ff77d4-ed94-4034-9f66-087ce61ec5fd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:51:37.684676 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-94ff77d4-ed94-4034-9f66-087ce61ec5fd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 6bbaa171-17c3-4169-a99b-0d7c803e66e4] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:51:37.691691 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-94ff77d4-ed94-4034-9f66-087ce61ec5fd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:51:37.692138 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-94ff77d4-ed94-4034-9f66-087ce61ec5fd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:51:37.692951 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-94ff77d4-ed94-4034-9f66-087ce61ec5fd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:51:37.693383 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-94ff77d4-ed94-4034-9f66-087ce61ec5fd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:51:37.828203 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-94ff77d4-ed94-4034-9f66-087ce61ec5fd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:51:37.836172 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-94ff77d4-ed94-4034-9f66-087ce61ec5fd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/6bbaa171-17c3-4169-a99b-0d7c803e66e4" status: 200 len: 1366 microversion: 2.1 time: 0.160274 Jul 11 11:51:37.836788 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1472/2948] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:51:37 2022] GET /compute/v2.1/servers/6bbaa171-17c3-4169-a99b-0d7c803e66e4 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:51:38.853958 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-df6b4830-d49a-4c8d-b887-52c3b0766f53 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:51:38.854528 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-df6b4830-d49a-4c8d-b887-52c3b0766f53 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 6bbaa171-17c3-4169-a99b-0d7c803e66e4] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:51:38.856665 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell0:SELECT=6 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:51:38.862775 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-df6b4830-d49a-4c8d-b887-52c3b0766f53 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:51:38.863226 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-df6b4830-d49a-4c8d-b887-52c3b0766f53 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:51:38.864005 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-df6b4830-d49a-4c8d-b887-52c3b0766f53 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:51:38.865117 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-df6b4830-d49a-4c8d-b887-52c3b0766f53 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:51:38.993203 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-df6b4830-d49a-4c8d-b887-52c3b0766f53 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:51:39.001107 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-df6b4830-d49a-4c8d-b887-52c3b0766f53 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/6bbaa171-17c3-4169-a99b-0d7c803e66e4" status: 200 len: 1557 microversion: 2.1 time: 0.151472 Jul 11 11:51:39.001666 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1477/2949] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:51:38 2022] GET /compute/v2.1/servers/6bbaa171-17c3-4169-a99b-0d7c803e66e4 => generated 1557 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:51:39.017857 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-c415ed89-e25a-499c-8456-648622c78440 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:51:39.021965 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-c415ed89-e25a-499c-8456-648622c78440 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 6bbaa171-17c3-4169-a99b-0d7c803e66e4] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:51:39.026680 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c415ed89-e25a-499c-8456-648622c78440 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:51:39.027128 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c415ed89-e25a-499c-8456-648622c78440 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:51:39.027917 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c415ed89-e25a-499c-8456-648622c78440 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:51:39.028358 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c415ed89-e25a-499c-8456-648622c78440 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:51:39.103774 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-c415ed89-e25a-499c-8456-648622c78440 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/6bbaa171-17c3-4169-a99b-0d7c803e66e4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090577 Jul 11 11:51:39.104415 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1473/2950] 10.222.0.26 () {58 vars in 1274 bytes} [Mon Jul 11 11:51:39 2022] GET /compute/v2.1/servers/6bbaa171-17c3-4169-a99b-0d7c803e66e4/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:51:40.082952 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [req-e713933e-f900-486b-afdd-6da4e71ee41d req-63c0914b-011b-49cc-8091-dff54885615c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bbaa171-17c3-4169-a99b-0d7c803e66e4", "tag": "6001114a-1028-4d57-9739-ea5d53ab51d4"}]} {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:51:40.091851 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [req-e713933e-f900-486b-afdd-6da4e71ee41d req-63c0914b-011b-49cc-8091-dff54885615c service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:51:40.092289 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [req-e713933e-f900-486b-afdd-6da4e71ee41d req-63c0914b-011b-49cc-8091-dff54885615c service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:51:40.103593 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.compute.server_external_events [req-e713933e-f900-486b-afdd-6da4e71ee41d req-63c0914b-011b-49cc-8091-dff54885615c service nova] Creating event network-changed:6001114a-1028-4d57-9739-ea5d53ab51d4 for instance 6bbaa171-17c3-4169-a99b-0d7c803e66e4 on hv-cinder-84842 Jul 11 11:51:40.108621 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [req-e713933e-f900-486b-afdd-6da4e71ee41d req-63c0914b-011b-49cc-8091-dff54885615c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029677 Jul 11 11:51:40.109454 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1478/2951] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 11:51:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:52:13.812795 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=11 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:52:13.816863 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-76dacd39-6a80-432a-931c-e5f0ec419b48 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:52:13.821411 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-76dacd39-6a80-432a-931c-e5f0ec419b48 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 6bbaa171-17c3-4169-a99b-0d7c803e66e4] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:52:13.824456 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-76dacd39-6a80-432a-931c-e5f0ec419b48 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:52:13.824903 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-76dacd39-6a80-432a-931c-e5f0ec419b48 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:52:13.825665 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-76dacd39-6a80-432a-931c-e5f0ec419b48 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:52:13.826101 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-76dacd39-6a80-432a-931c-e5f0ec419b48 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:52:13.849277 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-76dacd39-6a80-432a-931c-e5f0ec419b48 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/6bbaa171-17c3-4169-a99b-0d7c803e66e4/ips" status: 200 len: 150 microversion: 2.1 time: 0.037947 Jul 11 11:52:13.849840 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1474/2952] 10.222.0.26 () {58 vars in 1247 bytes} [Mon Jul 11 11:52:13 2022] GET /compute/v2.1/servers/6bbaa171-17c3-4169-a99b-0d7c803e66e4/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:52:41.947126 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 11:52:41.948057 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Mon Jul 11 11:52:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 11:53:13.920333 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_api:SELECT=5 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:53:13.921071 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=13 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:53:13.925079 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-c2eb690b-780e-4b44-800d-2cd24382990b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:53:13.925660 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-c2eb690b-780e-4b44-800d-2cd24382990b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 6bbaa171-17c3-4169-a99b-0d7c803e66e4] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:53:13.931730 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c2eb690b-780e-4b44-800d-2cd24382990b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:53:13.934861 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c2eb690b-780e-4b44-800d-2cd24382990b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:53:13.934861 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c2eb690b-780e-4b44-800d-2cd24382990b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:53:13.934861 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c2eb690b-780e-4b44-800d-2cd24382990b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:53:13.958811 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-c2eb690b-780e-4b44-800d-2cd24382990b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 6bbaa171-17c3-4169-a99b-0d7c803e66e4] Going to try to terminate instance {{(pid=118322) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 11:53:14.283491 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-c2eb690b-780e-4b44-800d-2cd24382990b tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6bbaa171-17c3-4169-a99b-0d7c803e66e4" status: 204 len: 0 microversion: 2.1 time: 0.364720 Jul 11 11:53:14.284094 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1479/2953] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 11 11:53:13 2022] DELETE /compute/v2.1/servers/6bbaa171-17c3-4169-a99b-0d7c803e66e4 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 11 11:53:14.290365 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=4 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:53:14.295870 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-d8886f99-59a8-452b-9a69-19c73e267b6f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:53:14.295870 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-d8886f99-59a8-452b-9a69-19c73e267b6f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 6bbaa171-17c3-4169-a99b-0d7c803e66e4] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:53:14.301051 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d8886f99-59a8-452b-9a69-19c73e267b6f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:53:14.302026 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d8886f99-59a8-452b-9a69-19c73e267b6f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:53:14.302786 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d8886f99-59a8-452b-9a69-19c73e267b6f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:53:14.303225 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d8886f99-59a8-452b-9a69-19c73e267b6f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:53:14.429447 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-d8886f99-59a8-452b-9a69-19c73e267b6f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:53:14.436822 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-d8886f99-59a8-452b-9a69-19c73e267b6f tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/6bbaa171-17c3-4169-a99b-0d7c803e66e4" status: 200 len: 1681 microversion: 2.1 time: 0.148445 Jul 11 11:53:14.437660 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1475/2954] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:53:14 2022] GET /compute/v2.1/servers/6bbaa171-17c3-4169-a99b-0d7c803e66e4 => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 11:53:15.455298 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-e611f56f-7bc2-42cc-9eb7-3b4fd3883eaa tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:53:15.455993 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-e611f56f-7bc2-42cc-9eb7-3b4fd3883eaa tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 6bbaa171-17c3-4169-a99b-0d7c803e66e4] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:53:15.463130 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e611f56f-7bc2-42cc-9eb7-3b4fd3883eaa tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:53:15.463610 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e611f56f-7bc2-42cc-9eb7-3b4fd3883eaa tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:53:15.464367 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e611f56f-7bc2-42cc-9eb7-3b4fd3883eaa tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:53:15.464803 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e611f56f-7bc2-42cc-9eb7-3b4fd3883eaa tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:53:15.599043 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-e611f56f-7bc2-42cc-9eb7-3b4fd3883eaa tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:53:15.606567 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-e611f56f-7bc2-42cc-9eb7-3b4fd3883eaa tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/6bbaa171-17c3-4169-a99b-0d7c803e66e4" status: 200 len: 1681 microversion: 2.1 time: 0.155469 Jul 11 11:53:15.607163 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1480/2955] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:53:15 2022] GET /compute/v2.1/servers/6bbaa171-17c3-4169-a99b-0d7c803e66e4 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:53:16.553697 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [req-910e6b24-5e1c-4c8b-a548-236647be5f65 req-09b35e58-1ec9-4f71-bef9-4f9e7ea862b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bbaa171-17c3-4169-a99b-0d7c803e66e4", "name": "network-vif-deleted", "tag": "6001114a-1028-4d57-9739-ea5d53ab51d4"}]} {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:53:16.567776 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [req-910e6b24-5e1c-4c8b-a548-236647be5f65 req-09b35e58-1ec9-4f71-bef9-4f9e7ea862b8 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:53:16.569428 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [req-910e6b24-5e1c-4c8b-a548-236647be5f65 req-09b35e58-1ec9-4f71-bef9-4f9e7ea862b8 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:53:16.580887 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.compute.server_external_events [req-910e6b24-5e1c-4c8b-a548-236647be5f65 req-09b35e58-1ec9-4f71-bef9-4f9e7ea862b8 service nova] Creating event network-vif-deleted:6001114a-1028-4d57-9739-ea5d53ab51d4 for instance 6bbaa171-17c3-4169-a99b-0d7c803e66e4 on hv-cinder-84842 Jul 11 11:53:16.587103 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [req-910e6b24-5e1c-4c8b-a548-236647be5f65 req-09b35e58-1ec9-4f71-bef9-4f9e7ea862b8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036892 Jul 11 11:53:16.587791 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1476/2956] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 11:53:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:53:16.626632 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-6c75cf28-61ec-47db-b30f-e750e4fc9c7a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:53:16.628349 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-6c75cf28-61ec-47db-b30f-e750e4fc9c7a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 6bbaa171-17c3-4169-a99b-0d7c803e66e4] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:53:16.635091 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6c75cf28-61ec-47db-b30f-e750e4fc9c7a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:53:16.635567 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6c75cf28-61ec-47db-b30f-e750e4fc9c7a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:53:16.636548 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6c75cf28-61ec-47db-b30f-e750e4fc9c7a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:53:16.637131 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-6c75cf28-61ec-47db-b30f-e750e4fc9c7a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:53:16.713341 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-6c75cf28-61ec-47db-b30f-e750e4fc9c7a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcc15c786fb43669ac34a4897735c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328a510264f4374baabad7b5243d8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:53:16.717369 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-6c75cf28-61ec-47db-b30f-e750e4fc9c7a tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/6bbaa171-17c3-4169-a99b-0d7c803e66e4" status: 200 len: 1613 microversion: 2.1 time: 0.096636 Jul 11 11:53:16.718746 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1481/2957] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:53:16 2022] GET /compute/v2.1/servers/6bbaa171-17c3-4169-a99b-0d7c803e66e4 => generated 1613 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:53:17.736224 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-bfa05664-ef30-4a0b-ba8c-7120432f8c84 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:53:17.736951 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-bfa05664-ef30-4a0b-ba8c-7120432f8c84 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 6bbaa171-17c3-4169-a99b-0d7c803e66e4] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:53:17.743220 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bfa05664-ef30-4a0b-ba8c-7120432f8c84 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:53:17.743698 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bfa05664-ef30-4a0b-ba8c-7120432f8c84 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:53:17.744456 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bfa05664-ef30-4a0b-ba8c-7120432f8c84 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:53:17.744892 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bfa05664-ef30-4a0b-ba8c-7120432f8c84 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:53:17.758414 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.wsgi [None req-bfa05664-ef30-4a0b-ba8c-7120432f8c84 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] HTTP exception thrown: Instance 6bbaa171-17c3-4169-a99b-0d7c803e66e4 could not be found. Jul 11 11:53:17.760045 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-bfa05664-ef30-4a0b-ba8c-7120432f8c84 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Request method failure captured: Jul 11 11:53:17.760045 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: request: GET /compute/v2.1/servers/6bbaa171-17c3-4169-a99b-0d7c803e66e4 HTTP/1.1 Jul 11 11:53:17.760045 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Accept: application/json Jul 11 11:53:17.760045 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Accept-Encoding: identity Jul 11 11:53:17.760045 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Connection: close Jul 11 11:53:17.760045 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Content-Length: 0 Jul 11 11:53:17.760045 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Content-Type: application/json Jul 11 11:53:17.760045 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Host: 10.222.0.26 Jul 11 11:53:17.760045 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Openstack-System-Scope: None Jul 11 11:53:17.760045 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: User-Agent: python-urllib3/1.26.9 Jul 11 11:53:17.760045 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Auth-Token: gAAAAABizAjKhZCKBRh_2i_ADibIvclpyQsJlC0Pm2ZTkb1jefgGS4P1r24evggFjxf1wK4Yv07Vbp7P1Zyv4wsuAQZPiSvMMxoEP8Q4ky7m10lr9iMNQTD4S9hixFXxSjWxJNmm7W7ummIraXw3SPwDOPKNnCr7rjbMh-sv9HcW6WLSiPnZrFU Jul 11 11:53:17.760045 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Domain-Id: None Jul 11 11:53:17.760045 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Domain-Name: None Jul 11 11:53:17.760045 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Identity-Status: Confirmed Jul 11 11:53:17.760045 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Is-Admin-Project: True Jul 11 11:53:17.760045 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Domain-Id: default Jul 11 11:53:17.760045 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Domain-Name: Default Jul 11 11:53:17.760045 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Id: 1328a510264f4374baabad7b5243d8c2 Jul 11 11:53:17.760045 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Name: tempest-AttachVolumeNegativeTest-1544092161 Jul 11 11:53:17.760045 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Role: member,reader Jul 11 11:53:17.760045 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Roles: member,reader Jul 11 11:53:17.761867 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1328a510264f4374baabad7b5243d8c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1328a510264f4374baabad7b5243d8c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1328a510264f4374baabad7b5243d8c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1328a510264f4374baabad7b5243d8c2"}]}] Jul 11 11:53:17.761867 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Tenant: tempest-AttachVolumeNegativeTest-1544092161 Jul 11 11:53:17.761867 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Tenant-Id: 1328a510264f4374baabad7b5243d8c2 Jul 11 11:53:17.761867 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1544092161 Jul 11 11:53:17.761867 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User: tempest-AttachVolumeNegativeTest-1544092161-project Jul 11 11:53:17.761867 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Domain-Id: default Jul 11 11:53:17.761867 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Domain-Name: Default Jul 11 11:53:17.761867 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Id: cbcc15c786fb43669ac34a4897735c1d Jul 11 11:53:17.761867 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Name: tempest-AttachVolumeNegativeTest-1544092161-project Jul 11 11:53:17.761867 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: method: > Jul 11 11:53:17.761867 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: exception: Instance 6bbaa171-17c3-4169-a99b-0d7c803e66e4 could not be found. Jul 11 11:53:17.761867 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: action_args: {'id': '6bbaa171-17c3-4169-a99b-0d7c803e66e4'} Jul 11 11:53:17.762911 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 11:53:17.762911 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:53:17.762911 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 11:53:17.762911 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 11:53:17.762911 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 11:53:17.762911 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 11:53:17.762911 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 11:53:17.762911 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 11:53:17.762911 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 11:53:17.762911 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 11:53:17.762911 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bbaa171-17c3-4169-a99b-0d7c803e66e4 could not be found. Jul 11 11:53:17.762911 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:53:17.762911 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:53:17.762911 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:53:17.762911 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:53:17.762911 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:53:17.762911 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:53:17.762911 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 11:53:17.762911 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 11:53:17.762911 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 11:53:17.764706 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 11:53:17.764706 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 11:53:17.764706 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 11:53:17.764706 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 11:53:17.764706 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 11:53:17.764706 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 11:53:17.764706 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 11:53:17.764706 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bbaa171-17c3-4169-a99b-0d7c803e66e4 could not be found. Jul 11 11:53:17.764706 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:53:17.764706 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:53:17.764706 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:53:17.764706 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:53:17.764706 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:53:17.764706 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:53:17.764706 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 11:53:17.764706 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 11:53:17.764706 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bbaa171-17c3-4169-a99b-0d7c803e66e4 could not be found. Jul 11 11:53:17.764706 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:53:17.766261 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-bfa05664-ef30-4a0b-ba8c-7120432f8c84 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Returning 404 to user: Instance 6bbaa171-17c3-4169-a99b-0d7c803e66e4 could not be found. {{(pid=118321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 11:53:17.766261 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-bfa05664-ef30-4a0b-ba8c-7120432f8c84 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/6bbaa171-17c3-4169-a99b-0d7c803e66e4" status: 404 len: 111 microversion: 2.1 time: 0.029936 Jul 11 11:53:17.766261 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1477/2958] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:53:17 2022] GET /compute/v2.1/servers/6bbaa171-17c3-4169-a99b-0d7c803e66e4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 11:53:17.770726 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-1afbc4e8-e588-407f-87f2-ca91c18f39cc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '.version_select at 0x7fb0102e7550>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:53:17.850066 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-1afbc4e8-e588-407f-87f2-ca91c18f39cc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-593229138" status: 202 len: 0 microversion: 2.1 time: 0.083681 Jul 11 11:53:17.850647 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1482/2959] 10.222.0.26 () {58 vars in 1217 bytes} [Mon Jul 11 11:53:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-593229138 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 11:53:18.625811 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-3b7d1868-365c-41a7-bfe3-d9a14d4fb0dc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:53:18.626306 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-3b7d1868-365c-41a7-bfe3-d9a14d4fb0dc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 6bbaa171-17c3-4169-a99b-0d7c803e66e4] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:53:18.632954 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3b7d1868-365c-41a7-bfe3-d9a14d4fb0dc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:53:18.633395 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3b7d1868-365c-41a7-bfe3-d9a14d4fb0dc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:53:18.634139 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3b7d1868-365c-41a7-bfe3-d9a14d4fb0dc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:53:18.634574 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3b7d1868-365c-41a7-bfe3-d9a14d4fb0dc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:53:18.648516 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.wsgi [None req-3b7d1868-365c-41a7-bfe3-d9a14d4fb0dc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] HTTP exception thrown: Instance 6bbaa171-17c3-4169-a99b-0d7c803e66e4 could not be found. Jul 11 11:53:18.650112 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-3b7d1868-365c-41a7-bfe3-d9a14d4fb0dc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Request method failure captured: Jul 11 11:53:18.650112 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: request: DELETE /compute/v2.1/servers/6bbaa171-17c3-4169-a99b-0d7c803e66e4 HTTP/1.1 Jul 11 11:53:18.650112 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Accept: application/json Jul 11 11:53:18.650112 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Accept-Encoding: identity Jul 11 11:53:18.650112 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Connection: close Jul 11 11:53:18.650112 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Content-Length: 0 Jul 11 11:53:18.650112 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Content-Type: application/json Jul 11 11:53:18.650112 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Host: 10.222.0.26 Jul 11 11:53:18.650112 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Openstack-System-Scope: None Jul 11 11:53:18.650112 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: User-Agent: python-urllib3/1.26.9 Jul 11 11:53:18.650112 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Auth-Token: gAAAAABizAjKhZCKBRh_2i_ADibIvclpyQsJlC0Pm2ZTkb1jefgGS4P1r24evggFjxf1wK4Yv07Vbp7P1Zyv4wsuAQZPiSvMMxoEP8Q4ky7m10lr9iMNQTD4S9hixFXxSjWxJNmm7W7ummIraXw3SPwDOPKNnCr7rjbMh-sv9HcW6WLSiPnZrFU Jul 11 11:53:18.650112 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Domain-Id: None Jul 11 11:53:18.650112 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Domain-Name: None Jul 11 11:53:18.650112 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Identity-Status: Confirmed Jul 11 11:53:18.650112 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Is-Admin-Project: True Jul 11 11:53:18.650112 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Domain-Id: default Jul 11 11:53:18.650112 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Domain-Name: Default Jul 11 11:53:18.650112 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Id: 1328a510264f4374baabad7b5243d8c2 Jul 11 11:53:18.650112 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Name: tempest-AttachVolumeNegativeTest-1544092161 Jul 11 11:53:18.650112 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Role: member,reader Jul 11 11:53:18.650112 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Roles: member,reader Jul 11 11:53:18.651923 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1328a510264f4374baabad7b5243d8c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1328a510264f4374baabad7b5243d8c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1328a510264f4374baabad7b5243d8c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1328a510264f4374baabad7b5243d8c2"}]}] Jul 11 11:53:18.651923 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Tenant: tempest-AttachVolumeNegativeTest-1544092161 Jul 11 11:53:18.651923 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Tenant-Id: 1328a510264f4374baabad7b5243d8c2 Jul 11 11:53:18.651923 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1544092161 Jul 11 11:53:18.651923 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User: tempest-AttachVolumeNegativeTest-1544092161-project Jul 11 11:53:18.651923 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Domain-Id: default Jul 11 11:53:18.651923 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Domain-Name: Default Jul 11 11:53:18.651923 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Id: cbcc15c786fb43669ac34a4897735c1d Jul 11 11:53:18.651923 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Name: tempest-AttachVolumeNegativeTest-1544092161-project Jul 11 11:53:18.651923 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: method: > Jul 11 11:53:18.651923 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: exception: Instance 6bbaa171-17c3-4169-a99b-0d7c803e66e4 could not be found. Jul 11 11:53:18.651923 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: action_args: {'id': '6bbaa171-17c3-4169-a99b-0d7c803e66e4'} Jul 11 11:53:18.652942 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 11:53:18.652942 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:53:18.652942 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 11:53:18.652942 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 11:53:18.652942 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 11:53:18.652942 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 11:53:18.652942 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 11:53:18.652942 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 11:53:18.652942 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 11:53:18.652942 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 11:53:18.652942 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bbaa171-17c3-4169-a99b-0d7c803e66e4 could not be found. Jul 11 11:53:18.652942 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:53:18.652942 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:53:18.652942 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:53:18.652942 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:53:18.652942 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:53:18.652942 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:53:18.652942 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 11:53:18.652942 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 11:53:18.652942 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 11:53:18.654626 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 11:53:18.654626 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 11 11:53:18.654626 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 11 11:53:18.654626 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 11 11:53:18.654626 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 11 11:53:18.654626 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 11:53:18.654626 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 11:53:18.654626 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 11:53:18.654626 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 11:53:18.654626 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bbaa171-17c3-4169-a99b-0d7c803e66e4 could not be found. Jul 11 11:53:18.654626 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:53:18.654626 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:53:18.654626 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:53:18.654626 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:53:18.654626 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:53:18.654626 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:53:18.654626 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 11:53:18.654626 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 11:53:18.654626 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bbaa171-17c3-4169-a99b-0d7c803e66e4 could not be found. Jul 11 11:53:18.654626 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:53:18.656302 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-3b7d1868-365c-41a7-bfe3-d9a14d4fb0dc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Returning 404 to user: Instance 6bbaa171-17c3-4169-a99b-0d7c803e66e4 could not be found. {{(pid=118321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 11:53:18.656302 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-3b7d1868-365c-41a7-bfe3-d9a14d4fb0dc tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6bbaa171-17c3-4169-a99b-0d7c803e66e4" status: 404 len: 111 microversion: 2.1 time: 0.029960 Jul 11 11:53:18.656302 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1478/2960] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 11 11:53:18 2022] DELETE /compute/v2.1/servers/6bbaa171-17c3-4169-a99b-0d7c803e66e4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 11:53:18.660136 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-f5282e53-b44e-4cdb-aa5a-462a076cf675 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:53:18.660785 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-f5282e53-b44e-4cdb-aa5a-462a076cf675 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 6bbaa171-17c3-4169-a99b-0d7c803e66e4] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:53:18.666753 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f5282e53-b44e-4cdb-aa5a-462a076cf675 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:53:18.667197 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f5282e53-b44e-4cdb-aa5a-462a076cf675 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:53:18.667980 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f5282e53-b44e-4cdb-aa5a-462a076cf675 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:53:18.668408 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f5282e53-b44e-4cdb-aa5a-462a076cf675 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:53:18.682160 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.wsgi [None req-f5282e53-b44e-4cdb-aa5a-462a076cf675 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] HTTP exception thrown: Instance 6bbaa171-17c3-4169-a99b-0d7c803e66e4 could not be found. Jul 11 11:53:18.683821 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-f5282e53-b44e-4cdb-aa5a-462a076cf675 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Request method failure captured: Jul 11 11:53:18.683821 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: request: GET /compute/v2.1/servers/6bbaa171-17c3-4169-a99b-0d7c803e66e4 HTTP/1.1 Jul 11 11:53:18.683821 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Accept: application/json Jul 11 11:53:18.683821 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Accept-Encoding: identity Jul 11 11:53:18.683821 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Connection: close Jul 11 11:53:18.683821 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Content-Length: 0 Jul 11 11:53:18.683821 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Content-Type: application/json Jul 11 11:53:18.683821 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Host: 10.222.0.26 Jul 11 11:53:18.683821 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Openstack-System-Scope: None Jul 11 11:53:18.683821 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: User-Agent: python-urllib3/1.26.9 Jul 11 11:53:18.683821 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Auth-Token: gAAAAABizAjKhZCKBRh_2i_ADibIvclpyQsJlC0Pm2ZTkb1jefgGS4P1r24evggFjxf1wK4Yv07Vbp7P1Zyv4wsuAQZPiSvMMxoEP8Q4ky7m10lr9iMNQTD4S9hixFXxSjWxJNmm7W7ummIraXw3SPwDOPKNnCr7rjbMh-sv9HcW6WLSiPnZrFU Jul 11 11:53:18.683821 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Domain-Id: None Jul 11 11:53:18.683821 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Domain-Name: None Jul 11 11:53:18.683821 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Identity-Status: Confirmed Jul 11 11:53:18.683821 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Is-Admin-Project: True Jul 11 11:53:18.683821 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Domain-Id: default Jul 11 11:53:18.683821 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Domain-Name: Default Jul 11 11:53:18.683821 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Id: 1328a510264f4374baabad7b5243d8c2 Jul 11 11:53:18.683821 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Name: tempest-AttachVolumeNegativeTest-1544092161 Jul 11 11:53:18.683821 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Role: member,reader Jul 11 11:53:18.683821 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Roles: member,reader Jul 11 11:53:18.685721 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1328a510264f4374baabad7b5243d8c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1328a510264f4374baabad7b5243d8c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1328a510264f4374baabad7b5243d8c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1328a510264f4374baabad7b5243d8c2"}]}] Jul 11 11:53:18.685721 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Tenant: tempest-AttachVolumeNegativeTest-1544092161 Jul 11 11:53:18.685721 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Tenant-Id: 1328a510264f4374baabad7b5243d8c2 Jul 11 11:53:18.685721 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1544092161 Jul 11 11:53:18.685721 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User: tempest-AttachVolumeNegativeTest-1544092161-project Jul 11 11:53:18.685721 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Domain-Id: default Jul 11 11:53:18.685721 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Domain-Name: Default Jul 11 11:53:18.685721 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Id: cbcc15c786fb43669ac34a4897735c1d Jul 11 11:53:18.685721 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Name: tempest-AttachVolumeNegativeTest-1544092161-project Jul 11 11:53:18.685721 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: method: > Jul 11 11:53:18.685721 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: exception: Instance 6bbaa171-17c3-4169-a99b-0d7c803e66e4 could not be found. Jul 11 11:53:18.685721 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: action_args: {'id': '6bbaa171-17c3-4169-a99b-0d7c803e66e4'} Jul 11 11:53:18.689493 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 11:53:18.689493 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:53:18.689493 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 11:53:18.689493 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 11:53:18.689493 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 11:53:18.689493 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 11:53:18.689493 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 11:53:18.689493 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 11:53:18.689493 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 11:53:18.689493 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 11:53:18.689493 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bbaa171-17c3-4169-a99b-0d7c803e66e4 could not be found. Jul 11 11:53:18.689493 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:53:18.689493 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:53:18.689493 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:53:18.689493 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:53:18.689493 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:53:18.689493 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:53:18.689493 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 11:53:18.689493 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 11:53:18.689493 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 11:53:18.690967 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 11:53:18.690967 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 11:53:18.690967 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 11:53:18.690967 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 11:53:18.690967 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 11:53:18.690967 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 11:53:18.690967 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 11:53:18.690967 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bbaa171-17c3-4169-a99b-0d7c803e66e4 could not be found. Jul 11 11:53:18.690967 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:53:18.690967 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:53:18.690967 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:53:18.690967 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:53:18.690967 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:53:18.690967 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:53:18.690967 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 11:53:18.690967 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 11:53:18.690967 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bbaa171-17c3-4169-a99b-0d7c803e66e4 could not be found. Jul 11 11:53:18.690967 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:53:18.692921 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-f5282e53-b44e-4cdb-aa5a-462a076cf675 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Returning 404 to user: Instance 6bbaa171-17c3-4169-a99b-0d7c803e66e4 could not be found. {{(pid=118322) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 11:53:18.692921 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-f5282e53-b44e-4cdb-aa5a-462a076cf675 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/6bbaa171-17c3-4169-a99b-0d7c803e66e4" status: 404 len: 111 microversion: 2.1 time: 0.028994 Jul 11 11:53:18.692921 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1483/2961] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:53:18 2022] GET /compute/v2.1/servers/6bbaa171-17c3-4169-a99b-0d7c803e66e4 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 11 11:53:18.694115 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-b752792b-110d-43c8-9ab2-155e1ace1d06 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:53:18.694611 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-b752792b-110d-43c8-9ab2-155e1ace1d06 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 44d404ef-3afd-41b2-8f49-8912a6434af5] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:53:18.700915 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b752792b-110d-43c8-9ab2-155e1ace1d06 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:53:18.701363 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b752792b-110d-43c8-9ab2-155e1ace1d06 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:53:18.702118 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b752792b-110d-43c8-9ab2-155e1ace1d06 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:53:18.702556 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b752792b-110d-43c8-9ab2-155e1ace1d06 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:53:18.715571 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.wsgi [None req-b752792b-110d-43c8-9ab2-155e1ace1d06 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] HTTP exception thrown: Instance 44d404ef-3afd-41b2-8f49-8912a6434af5 could not be found. Jul 11 11:53:18.717093 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-b752792b-110d-43c8-9ab2-155e1ace1d06 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Request method failure captured: Jul 11 11:53:18.717093 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: request: DELETE /compute/v2.1/servers/44d404ef-3afd-41b2-8f49-8912a6434af5 HTTP/1.1 Jul 11 11:53:18.717093 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Accept: application/json Jul 11 11:53:18.717093 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Accept-Encoding: identity Jul 11 11:53:18.717093 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Connection: close Jul 11 11:53:18.717093 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Content-Length: 0 Jul 11 11:53:18.717093 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Content-Type: application/json Jul 11 11:53:18.717093 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Host: 10.222.0.26 Jul 11 11:53:18.717093 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Openstack-System-Scope: None Jul 11 11:53:18.717093 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: User-Agent: python-urllib3/1.26.9 Jul 11 11:53:18.717093 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Auth-Token: gAAAAABizAjKhZCKBRh_2i_ADibIvclpyQsJlC0Pm2ZTkb1jefgGS4P1r24evggFjxf1wK4Yv07Vbp7P1Zyv4wsuAQZPiSvMMxoEP8Q4ky7m10lr9iMNQTD4S9hixFXxSjWxJNmm7W7ummIraXw3SPwDOPKNnCr7rjbMh-sv9HcW6WLSiPnZrFU Jul 11 11:53:18.717093 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Domain-Id: None Jul 11 11:53:18.717093 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Domain-Name: None Jul 11 11:53:18.717093 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Identity-Status: Confirmed Jul 11 11:53:18.717093 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Is-Admin-Project: True Jul 11 11:53:18.717093 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Domain-Id: default Jul 11 11:53:18.717093 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Domain-Name: Default Jul 11 11:53:18.717093 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Id: 1328a510264f4374baabad7b5243d8c2 Jul 11 11:53:18.717093 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Name: tempest-AttachVolumeNegativeTest-1544092161 Jul 11 11:53:18.717093 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Role: member,reader Jul 11 11:53:18.717093 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Roles: member,reader Jul 11 11:53:18.718883 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1328a510264f4374baabad7b5243d8c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1328a510264f4374baabad7b5243d8c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1328a510264f4374baabad7b5243d8c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1328a510264f4374baabad7b5243d8c2"}]}] Jul 11 11:53:18.718883 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Tenant: tempest-AttachVolumeNegativeTest-1544092161 Jul 11 11:53:18.718883 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Tenant-Id: 1328a510264f4374baabad7b5243d8c2 Jul 11 11:53:18.718883 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1544092161 Jul 11 11:53:18.718883 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User: tempest-AttachVolumeNegativeTest-1544092161-project Jul 11 11:53:18.718883 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Domain-Id: default Jul 11 11:53:18.718883 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Domain-Name: Default Jul 11 11:53:18.718883 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Id: cbcc15c786fb43669ac34a4897735c1d Jul 11 11:53:18.718883 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Name: tempest-AttachVolumeNegativeTest-1544092161-project Jul 11 11:53:18.718883 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: method: > Jul 11 11:53:18.718883 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: exception: Instance 44d404ef-3afd-41b2-8f49-8912a6434af5 could not be found. Jul 11 11:53:18.718883 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: action_args: {'id': '44d404ef-3afd-41b2-8f49-8912a6434af5'} Jul 11 11:53:18.720125 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 11:53:18.720125 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:53:18.720125 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 11:53:18.720125 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 11:53:18.720125 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 11:53:18.720125 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 11:53:18.720125 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 11:53:18.720125 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 11:53:18.720125 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 11:53:18.720125 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 11:53:18.720125 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44d404ef-3afd-41b2-8f49-8912a6434af5 could not be found. Jul 11 11:53:18.720125 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:53:18.720125 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:53:18.720125 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:53:18.720125 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:53:18.720125 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:53:18.720125 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:53:18.720125 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 11:53:18.720125 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 11:53:18.720125 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 11:53:18.721857 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 11:53:18.721857 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 11 11:53:18.721857 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 11 11:53:18.721857 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 11 11:53:18.721857 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 11 11:53:18.721857 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 11:53:18.721857 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 11:53:18.721857 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 11:53:18.721857 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 11:53:18.721857 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44d404ef-3afd-41b2-8f49-8912a6434af5 could not be found. Jul 11 11:53:18.721857 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:53:18.721857 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:53:18.721857 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:53:18.721857 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:53:18.721857 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:53:18.721857 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:53:18.721857 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 11:53:18.721857 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 11:53:18.721857 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44d404ef-3afd-41b2-8f49-8912a6434af5 could not be found. Jul 11 11:53:18.721857 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:53:18.723578 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-b752792b-110d-43c8-9ab2-155e1ace1d06 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Returning 404 to user: Instance 44d404ef-3afd-41b2-8f49-8912a6434af5 could not be found. {{(pid=118321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 11:53:18.723578 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-b752792b-110d-43c8-9ab2-155e1ace1d06 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "DELETE /compute/v2.1/servers/44d404ef-3afd-41b2-8f49-8912a6434af5" status: 404 len: 111 microversion: 2.1 time: 0.028760 Jul 11 11:53:18.723578 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1479/2962] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 11 11:53:18 2022] DELETE /compute/v2.1/servers/44d404ef-3afd-41b2-8f49-8912a6434af5 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 11:53:18.730018 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-c06224e2-9733-4ab5-8a5c-d5b3f5f8c7bd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:53:18.730643 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-c06224e2-9733-4ab5-8a5c-d5b3f5f8c7bd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 44d404ef-3afd-41b2-8f49-8912a6434af5] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:53:18.736858 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c06224e2-9733-4ab5-8a5c-d5b3f5f8c7bd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:53:18.737309 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c06224e2-9733-4ab5-8a5c-d5b3f5f8c7bd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:53:18.738073 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c06224e2-9733-4ab5-8a5c-d5b3f5f8c7bd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:53:18.738511 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c06224e2-9733-4ab5-8a5c-d5b3f5f8c7bd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:53:18.753611 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.wsgi [None req-c06224e2-9733-4ab5-8a5c-d5b3f5f8c7bd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] HTTP exception thrown: Instance 44d404ef-3afd-41b2-8f49-8912a6434af5 could not be found. Jul 11 11:53:18.756088 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-c06224e2-9733-4ab5-8a5c-d5b3f5f8c7bd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Request method failure captured: Jul 11 11:53:18.756088 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: request: GET /compute/v2.1/servers/44d404ef-3afd-41b2-8f49-8912a6434af5 HTTP/1.1 Jul 11 11:53:18.756088 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Accept: application/json Jul 11 11:53:18.756088 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Accept-Encoding: identity Jul 11 11:53:18.756088 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Connection: close Jul 11 11:53:18.756088 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Content-Length: 0 Jul 11 11:53:18.756088 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Content-Type: application/json Jul 11 11:53:18.756088 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Host: 10.222.0.26 Jul 11 11:53:18.756088 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Openstack-System-Scope: None Jul 11 11:53:18.756088 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: User-Agent: python-urllib3/1.26.9 Jul 11 11:53:18.756088 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Auth-Token: gAAAAABizAjKhZCKBRh_2i_ADibIvclpyQsJlC0Pm2ZTkb1jefgGS4P1r24evggFjxf1wK4Yv07Vbp7P1Zyv4wsuAQZPiSvMMxoEP8Q4ky7m10lr9iMNQTD4S9hixFXxSjWxJNmm7W7ummIraXw3SPwDOPKNnCr7rjbMh-sv9HcW6WLSiPnZrFU Jul 11 11:53:18.756088 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Domain-Id: None Jul 11 11:53:18.756088 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Domain-Name: None Jul 11 11:53:18.756088 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Identity-Status: Confirmed Jul 11 11:53:18.756088 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Is-Admin-Project: True Jul 11 11:53:18.756088 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Domain-Id: default Jul 11 11:53:18.756088 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Domain-Name: Default Jul 11 11:53:18.756088 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Id: 1328a510264f4374baabad7b5243d8c2 Jul 11 11:53:18.756088 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Name: tempest-AttachVolumeNegativeTest-1544092161 Jul 11 11:53:18.756088 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Role: member,reader Jul 11 11:53:18.756088 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Roles: member,reader Jul 11 11:53:18.757686 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1328a510264f4374baabad7b5243d8c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1328a510264f4374baabad7b5243d8c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1328a510264f4374baabad7b5243d8c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1328a510264f4374baabad7b5243d8c2"}]}] Jul 11 11:53:18.757686 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Tenant: tempest-AttachVolumeNegativeTest-1544092161 Jul 11 11:53:18.757686 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Tenant-Id: 1328a510264f4374baabad7b5243d8c2 Jul 11 11:53:18.757686 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1544092161 Jul 11 11:53:18.757686 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User: tempest-AttachVolumeNegativeTest-1544092161-project Jul 11 11:53:18.757686 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Domain-Id: default Jul 11 11:53:18.757686 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Domain-Name: Default Jul 11 11:53:18.757686 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Id: cbcc15c786fb43669ac34a4897735c1d Jul 11 11:53:18.757686 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Name: tempest-AttachVolumeNegativeTest-1544092161-project Jul 11 11:53:18.757686 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: method: > Jul 11 11:53:18.757686 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: exception: Instance 44d404ef-3afd-41b2-8f49-8912a6434af5 could not be found. Jul 11 11:53:18.757686 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: action_args: {'id': '44d404ef-3afd-41b2-8f49-8912a6434af5'} Jul 11 11:53:18.758634 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 11:53:18.758634 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:53:18.758634 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 11:53:18.758634 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 11:53:18.758634 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 11:53:18.758634 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 11:53:18.758634 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 11:53:18.758634 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 11:53:18.758634 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 11:53:18.758634 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 11:53:18.758634 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44d404ef-3afd-41b2-8f49-8912a6434af5 could not be found. Jul 11 11:53:18.758634 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:53:18.758634 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:53:18.758634 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:53:18.758634 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:53:18.758634 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:53:18.758634 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:53:18.758634 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 11:53:18.758634 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 11:53:18.758634 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 11:53:18.760348 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 11:53:18.760348 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 11:53:18.760348 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 11:53:18.760348 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 11:53:18.760348 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 11:53:18.760348 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 11:53:18.760348 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 11:53:18.760348 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44d404ef-3afd-41b2-8f49-8912a6434af5 could not be found. Jul 11 11:53:18.760348 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:53:18.760348 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:53:18.760348 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:53:18.760348 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:53:18.760348 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:53:18.760348 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:53:18.760348 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 11:53:18.760348 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 11:53:18.760348 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44d404ef-3afd-41b2-8f49-8912a6434af5 could not be found. Jul 11 11:53:18.760348 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:53:18.761995 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-c06224e2-9733-4ab5-8a5c-d5b3f5f8c7bd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Returning 404 to user: Instance 44d404ef-3afd-41b2-8f49-8912a6434af5 could not be found. {{(pid=118322) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 11:53:18.761995 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-c06224e2-9733-4ab5-8a5c-d5b3f5f8c7bd tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/44d404ef-3afd-41b2-8f49-8912a6434af5" status: 404 len: 111 microversion: 2.1 time: 0.034618 Jul 11 11:53:18.761995 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1484/2963] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:53:18 2022] GET /compute/v2.1/servers/44d404ef-3afd-41b2-8f49-8912a6434af5 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 11 11:53:18.766220 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-484d36c3-8def-4722-b194-fec9964e6ef5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:53:18.766713 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-484d36c3-8def-4722-b194-fec9964e6ef5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:53:18.773292 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-484d36c3-8def-4722-b194-fec9964e6ef5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:53:18.773747 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-484d36c3-8def-4722-b194-fec9964e6ef5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:53:18.774499 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-484d36c3-8def-4722-b194-fec9964e6ef5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:53:18.774932 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-484d36c3-8def-4722-b194-fec9964e6ef5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:53:18.788648 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.wsgi [None req-484d36c3-8def-4722-b194-fec9964e6ef5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] HTTP exception thrown: Instance 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e could not be found. Jul 11 11:53:18.795318 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-484d36c3-8def-4722-b194-fec9964e6ef5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Request method failure captured: Jul 11 11:53:18.795318 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: request: DELETE /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e HTTP/1.1 Jul 11 11:53:18.795318 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Accept: application/json Jul 11 11:53:18.795318 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Accept-Encoding: identity Jul 11 11:53:18.795318 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Connection: close Jul 11 11:53:18.795318 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Content-Length: 0 Jul 11 11:53:18.795318 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Content-Type: application/json Jul 11 11:53:18.795318 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Host: 10.222.0.26 Jul 11 11:53:18.795318 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Openstack-System-Scope: None Jul 11 11:53:18.795318 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: User-Agent: python-urllib3/1.26.9 Jul 11 11:53:18.795318 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Auth-Token: gAAAAABizAjKhZCKBRh_2i_ADibIvclpyQsJlC0Pm2ZTkb1jefgGS4P1r24evggFjxf1wK4Yv07Vbp7P1Zyv4wsuAQZPiSvMMxoEP8Q4ky7m10lr9iMNQTD4S9hixFXxSjWxJNmm7W7ummIraXw3SPwDOPKNnCr7rjbMh-sv9HcW6WLSiPnZrFU Jul 11 11:53:18.795318 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Domain-Id: None Jul 11 11:53:18.795318 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Domain-Name: None Jul 11 11:53:18.795318 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Identity-Status: Confirmed Jul 11 11:53:18.795318 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Is-Admin-Project: True Jul 11 11:53:18.795318 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Domain-Id: default Jul 11 11:53:18.795318 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Domain-Name: Default Jul 11 11:53:18.795318 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Id: 1328a510264f4374baabad7b5243d8c2 Jul 11 11:53:18.795318 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Name: tempest-AttachVolumeNegativeTest-1544092161 Jul 11 11:53:18.795318 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Role: member,reader Jul 11 11:53:18.795318 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Roles: member,reader Jul 11 11:53:18.797289 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1328a510264f4374baabad7b5243d8c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1328a510264f4374baabad7b5243d8c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1328a510264f4374baabad7b5243d8c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1328a510264f4374baabad7b5243d8c2"}]}] Jul 11 11:53:18.797289 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Tenant: tempest-AttachVolumeNegativeTest-1544092161 Jul 11 11:53:18.797289 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Tenant-Id: 1328a510264f4374baabad7b5243d8c2 Jul 11 11:53:18.797289 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1544092161 Jul 11 11:53:18.797289 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User: tempest-AttachVolumeNegativeTest-1544092161-project Jul 11 11:53:18.797289 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Domain-Id: default Jul 11 11:53:18.797289 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Domain-Name: Default Jul 11 11:53:18.797289 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Id: cbcc15c786fb43669ac34a4897735c1d Jul 11 11:53:18.797289 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Name: tempest-AttachVolumeNegativeTest-1544092161-project Jul 11 11:53:18.797289 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: method: > Jul 11 11:53:18.797289 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: exception: Instance 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e could not be found. Jul 11 11:53:18.797289 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: action_args: {'id': '93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e'} Jul 11 11:53:18.798339 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 11:53:18.798339 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:53:18.798339 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 11:53:18.798339 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 11:53:18.798339 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 11:53:18.798339 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 11:53:18.798339 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 11:53:18.798339 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 11:53:18.798339 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 11:53:18.798339 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 11:53:18.798339 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e could not be found. Jul 11 11:53:18.798339 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:53:18.798339 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:53:18.798339 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:53:18.798339 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:53:18.798339 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:53:18.798339 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:53:18.798339 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 11:53:18.798339 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 11:53:18.798339 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 11:53:18.800124 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 11:53:18.800124 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 11 11:53:18.800124 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 11 11:53:18.800124 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 11 11:53:18.800124 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 11 11:53:18.800124 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 11:53:18.800124 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 11:53:18.800124 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 11:53:18.800124 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 11:53:18.800124 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e could not be found. Jul 11 11:53:18.800124 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:53:18.800124 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:53:18.800124 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:53:18.800124 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:53:18.800124 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:53:18.800124 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:53:18.800124 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 11:53:18.800124 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 11:53:18.800124 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e could not be found. Jul 11 11:53:18.800124 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:53:18.802376 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-484d36c3-8def-4722-b194-fec9964e6ef5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Returning 404 to user: Instance 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e could not be found. {{(pid=118321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 11:53:18.802376 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-484d36c3-8def-4722-b194-fec9964e6ef5 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "DELETE /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e" status: 404 len: 111 microversion: 2.1 time: 0.029248 Jul 11 11:53:18.802376 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1480/2964] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 11 11:53:18 2022] DELETE /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 11:53:18.802670 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-1ecc1ee3-8857-4e7c-a4b1-fa41d84dfa91 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:53:18.803114 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-1ecc1ee3-8857-4e7c-a4b1-fa41d84dfa91 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:53:18.809572 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1ecc1ee3-8857-4e7c-a4b1-fa41d84dfa91 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:53:18.810022 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1ecc1ee3-8857-4e7c-a4b1-fa41d84dfa91 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:53:18.810776 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1ecc1ee3-8857-4e7c-a4b1-fa41d84dfa91 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:53:18.811213 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1ecc1ee3-8857-4e7c-a4b1-fa41d84dfa91 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:53:18.825315 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.wsgi [None req-1ecc1ee3-8857-4e7c-a4b1-fa41d84dfa91 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] HTTP exception thrown: Instance 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e could not be found. Jul 11 11:53:18.826824 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-1ecc1ee3-8857-4e7c-a4b1-fa41d84dfa91 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Request method failure captured: Jul 11 11:53:18.826824 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: request: GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e HTTP/1.1 Jul 11 11:53:18.826824 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Accept: application/json Jul 11 11:53:18.826824 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Accept-Encoding: identity Jul 11 11:53:18.826824 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Connection: close Jul 11 11:53:18.826824 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Content-Length: 0 Jul 11 11:53:18.826824 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Content-Type: application/json Jul 11 11:53:18.826824 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Host: 10.222.0.26 Jul 11 11:53:18.826824 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Openstack-System-Scope: None Jul 11 11:53:18.826824 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: User-Agent: python-urllib3/1.26.9 Jul 11 11:53:18.826824 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Auth-Token: gAAAAABizAjKhZCKBRh_2i_ADibIvclpyQsJlC0Pm2ZTkb1jefgGS4P1r24evggFjxf1wK4Yv07Vbp7P1Zyv4wsuAQZPiSvMMxoEP8Q4ky7m10lr9iMNQTD4S9hixFXxSjWxJNmm7W7ummIraXw3SPwDOPKNnCr7rjbMh-sv9HcW6WLSiPnZrFU Jul 11 11:53:18.826824 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Domain-Id: None Jul 11 11:53:18.826824 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Domain-Name: None Jul 11 11:53:18.826824 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Identity-Status: Confirmed Jul 11 11:53:18.826824 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Is-Admin-Project: True Jul 11 11:53:18.826824 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Domain-Id: default Jul 11 11:53:18.826824 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Domain-Name: Default Jul 11 11:53:18.826824 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Id: 1328a510264f4374baabad7b5243d8c2 Jul 11 11:53:18.826824 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Name: tempest-AttachVolumeNegativeTest-1544092161 Jul 11 11:53:18.826824 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Role: member,reader Jul 11 11:53:18.826824 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Roles: member,reader Jul 11 11:53:18.828628 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1328a510264f4374baabad7b5243d8c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1328a510264f4374baabad7b5243d8c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1328a510264f4374baabad7b5243d8c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1328a510264f4374baabad7b5243d8c2"}]}] Jul 11 11:53:18.828628 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Tenant: tempest-AttachVolumeNegativeTest-1544092161 Jul 11 11:53:18.828628 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Tenant-Id: 1328a510264f4374baabad7b5243d8c2 Jul 11 11:53:18.828628 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1544092161 Jul 11 11:53:18.828628 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User: tempest-AttachVolumeNegativeTest-1544092161-project Jul 11 11:53:18.828628 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Domain-Id: default Jul 11 11:53:18.828628 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Domain-Name: Default Jul 11 11:53:18.828628 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Id: cbcc15c786fb43669ac34a4897735c1d Jul 11 11:53:18.828628 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Name: tempest-AttachVolumeNegativeTest-1544092161-project Jul 11 11:53:18.828628 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: method: > Jul 11 11:53:18.828628 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: exception: Instance 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e could not be found. Jul 11 11:53:18.828628 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: action_args: {'id': '93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e'} Jul 11 11:53:18.829686 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 11:53:18.829686 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:53:18.829686 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 11:53:18.829686 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 11:53:18.829686 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 11:53:18.829686 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 11:53:18.829686 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 11:53:18.829686 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 11:53:18.829686 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 11:53:18.829686 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 11:53:18.829686 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e could not be found. Jul 11 11:53:18.829686 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:53:18.829686 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:53:18.829686 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:53:18.829686 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:53:18.829686 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:53:18.829686 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:53:18.829686 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 11:53:18.829686 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 11:53:18.829686 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 11:53:18.831365 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 11:53:18.831365 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 11:53:18.831365 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 11:53:18.831365 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 11:53:18.831365 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 11:53:18.831365 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 11:53:18.831365 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 11:53:18.831365 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e could not be found. Jul 11 11:53:18.831365 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:53:18.831365 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:53:18.831365 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:53:18.831365 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:53:18.831365 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:53:18.831365 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:53:18.831365 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 11:53:18.831365 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 11:53:18.831365 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e could not be found. Jul 11 11:53:18.831365 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:53:18.833233 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-1ecc1ee3-8857-4e7c-a4b1-fa41d84dfa91 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Returning 404 to user: Instance 93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e could not be found. {{(pid=118322) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 11:53:18.833233 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-1ecc1ee3-8857-4e7c-a4b1-fa41d84dfa91 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e" status: 404 len: 111 microversion: 2.1 time: 0.030253 Jul 11 11:53:18.833233 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1485/2965] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:53:18 2022] GET /compute/v2.1/servers/93fbed2e-d9f1-4d7f-85b8-0c92ddd4bf5e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 11:53:24.561503 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [req-82fa558c-90d7-4712-9250-df021581272b req-4a2e39dc-ca5c-465d-9780-5d1d19981597 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ae01e39-7148-4e87-9ae0-a95832b38101", "name": "network-vif-deleted", "tag": "b54d0e28-6ca3-4d14-ab22-34f6f328aee6"}]} {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:53:24.570566 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [req-82fa558c-90d7-4712-9250-df021581272b req-4a2e39dc-ca5c-465d-9780-5d1d19981597 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:53:24.571007 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [req-82fa558c-90d7-4712-9250-df021581272b req-4a2e39dc-ca5c-465d-9780-5d1d19981597 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:53:24.582255 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.compute.server_external_events [req-82fa558c-90d7-4712-9250-df021581272b req-4a2e39dc-ca5c-465d-9780-5d1d19981597 service nova] Creating event network-vif-deleted:b54d0e28-6ca3-4d14-ab22-34f6f328aee6 for instance 3ae01e39-7148-4e87-9ae0-a95832b38101 on hv-cinder-84842 Jul 11 11:53:24.591566 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [req-82fa558c-90d7-4712-9250-df021581272b req-4a2e39dc-ca5c-465d-9780-5d1d19981597 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030231 Jul 11 11:53:24.591566 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1481/2966] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 11:53:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:54:18.415172 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 11:54:18.415900 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Mon Jul 11 11:54:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 11:55:24.298702 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR oslo.messaging._drivers.impl_rabbit [-] [73153c7c-8222-4333-b8ec-ad525dae098f] AMQP server on 10.222.0.26:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 11 11:55:24.299814 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:24.300607 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:24.305120 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-c5b2756f-2d7b-4364-9b61-cdb9ee53bcfc tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:55:24.305688 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-c5b2756f-2d7b-4364-9b61-cdb9ee53bcfc tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:55:24.311852 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c5b2756f-2d7b-4364-9b61-cdb9ee53bcfc tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:55:24.312239 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c5b2756f-2d7b-4364-9b61-cdb9ee53bcfc tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:55:24.313001 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c5b2756f-2d7b-4364-9b61-cdb9ee53bcfc tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:55:24.313439 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c5b2756f-2d7b-4364-9b61-cdb9ee53bcfc tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:55:24.327070 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.wsgi [None req-c5b2756f-2d7b-4364-9b61-cdb9ee53bcfc tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] HTTP exception thrown: Instance 4b0ec960-6583-4639-9658-a850655eb703 could not be found. Jul 11 11:55:24.328657 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-c5b2756f-2d7b-4364-9b61-cdb9ee53bcfc tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Request method failure captured: Jul 11 11:55:24.328657 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: request: DELETE /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 HTTP/1.1 Jul 11 11:55:24.328657 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Accept: application/json Jul 11 11:55:24.328657 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Accept-Encoding: identity Jul 11 11:55:24.328657 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Connection: close Jul 11 11:55:24.328657 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Content-Length: 0 Jul 11 11:55:24.328657 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Content-Type: application/json Jul 11 11:55:24.328657 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Host: 10.222.0.26 Jul 11 11:55:24.328657 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Openstack-System-Scope: None Jul 11 11:55:24.328657 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: User-Agent: python-urllib3/1.26.9 Jul 11 11:55:24.328657 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Auth-Token: gAAAAABizAjGbyj9-EYsdAofFu2CzO2d59ZW9ABUBAbQnLYnllzeEOzy491jQ4HEpM89bbrLUMplN6mcP6HQ3B1WwP6JVkBcg1zkYwnoXWYRasZ-vSNiHWKxPN1ixhfjDreb4HCRJcBhMJ-WtmjdLoAnivFahEDeMkVzqUGoMBW-7rS50fYCH-4 Jul 11 11:55:24.328657 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Domain-Id: None Jul 11 11:55:24.328657 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Domain-Name: None Jul 11 11:55:24.328657 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Identity-Status: Confirmed Jul 11 11:55:24.328657 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Is-Admin-Project: True Jul 11 11:55:24.328657 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Openstack-Nova-Api-Version: 2.20 Jul 11 11:55:24.328657 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Domain-Id: default Jul 11 11:55:24.328657 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Domain-Name: Default Jul 11 11:55:24.328657 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Id: 876864a8f283481a81ee65a1c97d0f4f Jul 11 11:55:24.328657 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-30953492 Jul 11 11:55:24.328657 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Role: member,reader Jul 11 11:55:24.328657 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Roles: member,reader Jul 11 11:55:24.330645 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_876864a8f283481a81ee65a1c97d0f4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/876864a8f283481a81ee65a1c97d0f4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/876864a8f283481a81ee65a1c97d0f4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/876864a8f283481a81ee65a1c97d0f4f"}]}] Jul 11 11:55:24.330645 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Tenant: tempest-AttachVolumeShelveTestJSON-30953492 Jul 11 11:55:24.330645 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Tenant-Id: 876864a8f283481a81ee65a1c97d0f4f Jul 11 11:55:24.330645 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-30953492 Jul 11 11:55:24.330645 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User: tempest-AttachVolumeShelveTestJSON-30953492-project Jul 11 11:55:24.330645 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Domain-Id: default Jul 11 11:55:24.330645 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Domain-Name: Default Jul 11 11:55:24.330645 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Id: 993a59e8746948ab8a0f11d877314e02 Jul 11 11:55:24.330645 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Name: tempest-AttachVolumeShelveTestJSON-30953492-project Jul 11 11:55:24.330645 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: method: > Jul 11 11:55:24.330645 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: exception: Instance 4b0ec960-6583-4639-9658-a850655eb703 could not be found. Jul 11 11:55:24.330645 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: action_args: {'id': '4b0ec960-6583-4639-9658-a850655eb703'} Jul 11 11:55:24.331746 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 11:55:24.331746 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:55:24.331746 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 11:55:24.331746 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 11:55:24.331746 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 11:55:24.331746 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 11:55:24.331746 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 11:55:24.331746 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 11:55:24.331746 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 11:55:24.331746 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 11:55:24.331746 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b0ec960-6583-4639-9658-a850655eb703 could not be found. Jul 11 11:55:24.331746 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:55:24.331746 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:55:24.331746 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:55:24.331746 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:55:24.331746 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:55:24.331746 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:55:24.331746 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 11:55:24.331746 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 11:55:24.331746 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 11:55:24.333819 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 11:55:24.333819 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 11 11:55:24.333819 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 11 11:55:24.333819 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 11 11:55:24.333819 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 11 11:55:24.333819 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 11:55:24.333819 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 11:55:24.333819 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 11:55:24.333819 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 11:55:24.333819 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b0ec960-6583-4639-9658-a850655eb703 could not be found. Jul 11 11:55:24.333819 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:55:24.333819 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:55:24.333819 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:55:24.333819 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:55:24.333819 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:55:24.333819 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:55:24.333819 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 11:55:24.333819 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 11:55:24.333819 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b0ec960-6583-4639-9658-a850655eb703 could not be found. Jul 11 11:55:24.333819 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:55:24.335749 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-c5b2756f-2d7b-4364-9b61-cdb9ee53bcfc tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Returning 404 to user: Instance 4b0ec960-6583-4639-9658-a850655eb703 could not be found. {{(pid=118322) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 11:55:24.335749 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-c5b2756f-2d7b-4364-9b61-cdb9ee53bcfc tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 404 len: 111 microversion: 2.20 time: 0.033193 Jul 11 11:55:24.335749 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1486/2967] 10.222.0.26 () {60 vars in 1279 bytes} [Mon Jul 11 11:55:24 2022] DELETE /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 11 11:55:24.336807 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6e7662ca-0840-4af7-a170-09ca74b9449f] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 11 11:55:24.337386 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_api:SELECT=21 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:24.338129 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=18 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:24.342485 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-0b7d032d-31dc-47f9-930a-8394f75d6718 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:55:24.343211 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-0b7d032d-31dc-47f9-930a-8394f75d6718 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] [instance: 4b0ec960-6583-4639-9658-a850655eb703] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:55:24.349202 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0b7d032d-31dc-47f9-930a-8394f75d6718 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:55:24.350162 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0b7d032d-31dc-47f9-930a-8394f75d6718 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:55:24.350927 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0b7d032d-31dc-47f9-930a-8394f75d6718 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:55:24.351398 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-0b7d032d-31dc-47f9-930a-8394f75d6718 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:55:24.364428 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.wsgi [None req-0b7d032d-31dc-47f9-930a-8394f75d6718 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] HTTP exception thrown: Instance 4b0ec960-6583-4639-9658-a850655eb703 could not be found. Jul 11 11:55:24.366682 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-0b7d032d-31dc-47f9-930a-8394f75d6718 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Request method failure captured: Jul 11 11:55:24.366682 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: request: GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 HTTP/1.1 Jul 11 11:55:24.366682 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Accept: application/json Jul 11 11:55:24.366682 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Accept-Encoding: identity Jul 11 11:55:24.366682 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Connection: close Jul 11 11:55:24.366682 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Content-Length: 0 Jul 11 11:55:24.366682 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Content-Type: application/json Jul 11 11:55:24.366682 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Host: 10.222.0.26 Jul 11 11:55:24.366682 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Openstack-System-Scope: None Jul 11 11:55:24.366682 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: User-Agent: python-urllib3/1.26.9 Jul 11 11:55:24.366682 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Auth-Token: gAAAAABizAjGbyj9-EYsdAofFu2CzO2d59ZW9ABUBAbQnLYnllzeEOzy491jQ4HEpM89bbrLUMplN6mcP6HQ3B1WwP6JVkBcg1zkYwnoXWYRasZ-vSNiHWKxPN1ixhfjDreb4HCRJcBhMJ-WtmjdLoAnivFahEDeMkVzqUGoMBW-7rS50fYCH-4 Jul 11 11:55:24.366682 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Domain-Id: None Jul 11 11:55:24.366682 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Domain-Name: None Jul 11 11:55:24.366682 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Identity-Status: Confirmed Jul 11 11:55:24.366682 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Is-Admin-Project: True Jul 11 11:55:24.366682 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Openstack-Nova-Api-Version: 2.20 Jul 11 11:55:24.366682 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Domain-Id: default Jul 11 11:55:24.366682 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Domain-Name: Default Jul 11 11:55:24.366682 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Id: 876864a8f283481a81ee65a1c97d0f4f Jul 11 11:55:24.366682 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-30953492 Jul 11 11:55:24.366682 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Role: member,reader Jul 11 11:55:24.366682 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Roles: member,reader Jul 11 11:55:24.368642 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_876864a8f283481a81ee65a1c97d0f4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/876864a8f283481a81ee65a1c97d0f4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/876864a8f283481a81ee65a1c97d0f4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/876864a8f283481a81ee65a1c97d0f4f"}]}] Jul 11 11:55:24.368642 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Tenant: tempest-AttachVolumeShelveTestJSON-30953492 Jul 11 11:55:24.368642 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Tenant-Id: 876864a8f283481a81ee65a1c97d0f4f Jul 11 11:55:24.368642 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-30953492 Jul 11 11:55:24.368642 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User: tempest-AttachVolumeShelveTestJSON-30953492-project Jul 11 11:55:24.368642 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Domain-Id: default Jul 11 11:55:24.368642 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Domain-Name: Default Jul 11 11:55:24.368642 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Id: 993a59e8746948ab8a0f11d877314e02 Jul 11 11:55:24.368642 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Name: tempest-AttachVolumeShelveTestJSON-30953492-project Jul 11 11:55:24.368642 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: method: > Jul 11 11:55:24.368642 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: exception: Instance 4b0ec960-6583-4639-9658-a850655eb703 could not be found. Jul 11 11:55:24.368642 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: action_args: {'id': '4b0ec960-6583-4639-9658-a850655eb703'} Jul 11 11:55:24.369753 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 11:55:24.369753 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:55:24.369753 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 11:55:24.369753 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 11:55:24.369753 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 11:55:24.369753 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 11:55:24.369753 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 11:55:24.369753 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 11:55:24.369753 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 11:55:24.369753 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 11:55:24.369753 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b0ec960-6583-4639-9658-a850655eb703 could not be found. Jul 11 11:55:24.369753 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:55:24.369753 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:55:24.369753 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:55:24.369753 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:55:24.369753 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:55:24.369753 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:55:24.369753 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 11:55:24.369753 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 11:55:24.369753 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 11:55:24.371560 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 11:55:24.371560 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 11:55:24.371560 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 11:55:24.371560 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 11:55:24.371560 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 11:55:24.371560 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 11:55:24.371560 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 11:55:24.371560 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b0ec960-6583-4639-9658-a850655eb703 could not be found. Jul 11 11:55:24.371560 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:55:24.371560 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:55:24.371560 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:55:24.371560 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:55:24.371560 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:55:24.371560 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:55:24.371560 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 11:55:24.371560 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 11:55:24.371560 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b0ec960-6583-4639-9658-a850655eb703 could not be found. Jul 11 11:55:24.371560 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:55:24.377366 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-0b7d032d-31dc-47f9-930a-8394f75d6718 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] Returning 404 to user: Instance 4b0ec960-6583-4639-9658-a850655eb703 could not be found. {{(pid=118321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 11:55:24.377366 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-0b7d032d-31dc-47f9-930a-8394f75d6718 tempest-AttachVolumeShelveTestJSON-30953492 tempest-AttachVolumeShelveTestJSON-30953492-project] 10.222.0.26 "GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703" status: 404 len: 111 microversion: 2.20 time: 0.033134 Jul 11 11:55:24.377366 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1482/2968] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 11 11:55:24 2022] GET /compute/v2.1/servers/4b0ec960-6583-4639-9658-a850655eb703 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 11 11:55:59.024950 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 11:55:59.025578 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Mon Jul 11 11:55:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 11:56:01.955748 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 11:56:01.956423 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Mon Jul 11 11:56:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 11:56:15.045474 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 11:56:15.046300 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Mon Jul 11 11:56:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 11:56:23.681751 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 11:56:23.682376 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Mon Jul 11 11:56:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 11:56:31.151422 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 11:56:31.151997 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Mon Jul 11 11:56:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 11:57:25.044738 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO oslo.messaging._drivers.impl_rabbit [-] [73153c7c-8222-4333-b8ec-ad525dae098f] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 48460. Jul 11 11:57:25.049494 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-514199d4-875d-474a-9822-7df90c52f1f1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:57:25.050005 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-514199d4-875d-474a-9822-7df90c52f1f1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:57:25.061413 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-514199d4-875d-474a-9822-7df90c52f1f1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:57:25.061413 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-514199d4-875d-474a-9822-7df90c52f1f1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:57:25.061413 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-514199d4-875d-474a-9822-7df90c52f1f1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:57:25.061999 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-514199d4-875d-474a-9822-7df90c52f1f1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:57:25.080711 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.wsgi [None req-514199d4-875d-474a-9822-7df90c52f1f1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] HTTP exception thrown: Instance 2a79e2f0-60e3-40b6-aac8-665c0d755ecb could not be found. Jul 11 11:57:25.084284 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-514199d4-875d-474a-9822-7df90c52f1f1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Request method failure captured: Jul 11 11:57:25.084284 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: request: DELETE /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb HTTP/1.1 Jul 11 11:57:25.084284 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Accept: application/json Jul 11 11:57:25.084284 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Accept-Encoding: identity Jul 11 11:57:25.084284 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Connection: close Jul 11 11:57:25.084284 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Content-Length: 0 Jul 11 11:57:25.084284 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Content-Type: application/json Jul 11 11:57:25.084284 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Host: 10.222.0.26 Jul 11 11:57:25.084284 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Openstack-System-Scope: None Jul 11 11:57:25.084284 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: User-Agent: python-urllib3/1.26.9 Jul 11 11:57:25.084284 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Auth-Token: gAAAAABizAjLO4PGFFyBld15DDnMmjOMiyTfdUbsyF5cUuFMKWxHvKhrCVTk7XeaeLJ6AedivEPaw_nguZ4-p4LDjB7T9a0W-yQx3Oeh_u82CdhrQ3J4zLhwezdPpzDSPXg3rjqJkU6X-m1m244kVxKJfdBOeXkvji1jVYDzL1HD6pHDIVJaMlQ Jul 11 11:57:25.084284 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Domain-Id: None Jul 11 11:57:25.084284 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Domain-Name: None Jul 11 11:57:25.084284 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Identity-Status: Confirmed Jul 11 11:57:25.084284 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Is-Admin-Project: True Jul 11 11:57:25.084284 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Domain-Id: default Jul 11 11:57:25.084284 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Domain-Name: Default Jul 11 11:57:25.084284 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Id: 5779b0ffa2244901a92adbee65b10421 Jul 11 11:57:25.084284 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Name: tempest-AttachVolumeTestJSON-1070974935 Jul 11 11:57:25.084284 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Role: member,reader Jul 11 11:57:25.084284 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Roles: member,reader Jul 11 11:57:25.086333 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5779b0ffa2244901a92adbee65b10421"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5779b0ffa2244901a92adbee65b10421"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5779b0ffa2244901a92adbee65b10421"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5779b0ffa2244901a92adbee65b10421"}]}] Jul 11 11:57:25.086333 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Tenant: tempest-AttachVolumeTestJSON-1070974935 Jul 11 11:57:25.086333 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Tenant-Id: 5779b0ffa2244901a92adbee65b10421 Jul 11 11:57:25.086333 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1070974935 Jul 11 11:57:25.086333 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User: tempest-AttachVolumeTestJSON-1070974935-project Jul 11 11:57:25.086333 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Domain-Id: default Jul 11 11:57:25.086333 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Domain-Name: Default Jul 11 11:57:25.086333 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Id: 15ff2cacb5c1450482597a2f5fa3c8a9 Jul 11 11:57:25.086333 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Name: tempest-AttachVolumeTestJSON-1070974935-project Jul 11 11:57:25.086333 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: method: > Jul 11 11:57:25.086333 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: exception: Instance 2a79e2f0-60e3-40b6-aac8-665c0d755ecb could not be found. Jul 11 11:57:25.086333 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: action_args: {'id': '2a79e2f0-60e3-40b6-aac8-665c0d755ecb'} Jul 11 11:57:25.087658 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 11:57:25.087658 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:57:25.087658 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 11:57:25.087658 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 11:57:25.087658 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 11:57:25.087658 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 11:57:25.087658 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 11:57:25.087658 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 11:57:25.087658 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 11:57:25.087658 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 11:57:25.087658 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a79e2f0-60e3-40b6-aac8-665c0d755ecb could not be found. Jul 11 11:57:25.087658 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:57:25.087658 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:57:25.087658 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:57:25.087658 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:57:25.087658 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:57:25.087658 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:57:25.087658 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 11:57:25.087658 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 11:57:25.087658 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 11:57:25.089197 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 11:57:25.089197 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 11 11:57:25.089197 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 11 11:57:25.089197 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 11 11:57:25.089197 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 11 11:57:25.089197 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 11:57:25.089197 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 11:57:25.089197 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 11:57:25.089197 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 11:57:25.089197 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a79e2f0-60e3-40b6-aac8-665c0d755ecb could not be found. Jul 11 11:57:25.089197 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:57:25.089197 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:57:25.089197 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:57:25.089197 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:57:25.089197 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:57:25.089197 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:57:25.089197 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 11:57:25.089197 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 11:57:25.089197 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a79e2f0-60e3-40b6-aac8-665c0d755ecb could not be found. Jul 11 11:57:25.089197 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:57:25.090771 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-514199d4-875d-474a-9822-7df90c52f1f1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Returning 404 to user: Instance 2a79e2f0-60e3-40b6-aac8-665c0d755ecb could not be found. {{(pid=118322) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 11:57:25.090771 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-514199d4-875d-474a-9822-7df90c52f1f1 tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "DELETE /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 404 len: 111 microversion: 2.1 time: 0.050112 Jul 11 11:57:25.090771 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1487/2969] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 11 11:57:25 2022] DELETE /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 11:57:25.095952 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-9ca215c7-d56e-4efd-a650-495f5cbe90ef tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:57:25.096548 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-9ca215c7-d56e-4efd-a650-495f5cbe90ef tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] [instance: 2a79e2f0-60e3-40b6-aac8-665c0d755ecb] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:57:25.107304 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9ca215c7-d56e-4efd-a650-495f5cbe90ef tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:57:25.107698 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9ca215c7-d56e-4efd-a650-495f5cbe90ef tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:57:25.108472 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9ca215c7-d56e-4efd-a650-495f5cbe90ef tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:57:25.108913 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9ca215c7-d56e-4efd-a650-495f5cbe90ef tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:57:25.114419 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO oslo.messaging._drivers.impl_rabbit [-] [6e7662ca-0840-4af7-a170-09ca74b9449f] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 48468. Jul 11 11:57:25.124007 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.wsgi [None req-9ca215c7-d56e-4efd-a650-495f5cbe90ef tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] HTTP exception thrown: Instance 2a79e2f0-60e3-40b6-aac8-665c0d755ecb could not be found. Jul 11 11:57:25.125545 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-9ca215c7-d56e-4efd-a650-495f5cbe90ef tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Request method failure captured: Jul 11 11:57:25.125545 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: request: GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb HTTP/1.1 Jul 11 11:57:25.125545 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Accept: application/json Jul 11 11:57:25.125545 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Accept-Encoding: identity Jul 11 11:57:25.125545 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Connection: close Jul 11 11:57:25.125545 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Content-Length: 0 Jul 11 11:57:25.125545 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Content-Type: application/json Jul 11 11:57:25.125545 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Host: 10.222.0.26 Jul 11 11:57:25.125545 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Openstack-System-Scope: None Jul 11 11:57:25.125545 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: User-Agent: python-urllib3/1.26.9 Jul 11 11:57:25.125545 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Auth-Token: gAAAAABizAjLO4PGFFyBld15DDnMmjOMiyTfdUbsyF5cUuFMKWxHvKhrCVTk7XeaeLJ6AedivEPaw_nguZ4-p4LDjB7T9a0W-yQx3Oeh_u82CdhrQ3J4zLhwezdPpzDSPXg3rjqJkU6X-m1m244kVxKJfdBOeXkvji1jVYDzL1HD6pHDIVJaMlQ Jul 11 11:57:25.125545 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Domain-Id: None Jul 11 11:57:25.125545 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Domain-Name: None Jul 11 11:57:25.125545 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Identity-Status: Confirmed Jul 11 11:57:25.125545 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Is-Admin-Project: True Jul 11 11:57:25.125545 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Domain-Id: default Jul 11 11:57:25.125545 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Domain-Name: Default Jul 11 11:57:25.125545 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Id: 5779b0ffa2244901a92adbee65b10421 Jul 11 11:57:25.125545 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Name: tempest-AttachVolumeTestJSON-1070974935 Jul 11 11:57:25.125545 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Role: member,reader Jul 11 11:57:25.125545 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Roles: member,reader Jul 11 11:57:25.127175 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5779b0ffa2244901a92adbee65b10421"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5779b0ffa2244901a92adbee65b10421"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5779b0ffa2244901a92adbee65b10421"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5779b0ffa2244901a92adbee65b10421"}]}] Jul 11 11:57:25.127175 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Tenant: tempest-AttachVolumeTestJSON-1070974935 Jul 11 11:57:25.127175 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Tenant-Id: 5779b0ffa2244901a92adbee65b10421 Jul 11 11:57:25.127175 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1070974935 Jul 11 11:57:25.127175 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User: tempest-AttachVolumeTestJSON-1070974935-project Jul 11 11:57:25.127175 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Domain-Id: default Jul 11 11:57:25.127175 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Domain-Name: Default Jul 11 11:57:25.127175 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Id: 15ff2cacb5c1450482597a2f5fa3c8a9 Jul 11 11:57:25.127175 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Name: tempest-AttachVolumeTestJSON-1070974935-project Jul 11 11:57:25.127175 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: method: > Jul 11 11:57:25.127175 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: exception: Instance 2a79e2f0-60e3-40b6-aac8-665c0d755ecb could not be found. Jul 11 11:57:25.127175 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: action_args: {'id': '2a79e2f0-60e3-40b6-aac8-665c0d755ecb'} Jul 11 11:57:25.128100 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 11:57:25.128100 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:57:25.128100 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 11:57:25.128100 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 11:57:25.128100 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 11:57:25.128100 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 11:57:25.128100 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 11:57:25.128100 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 11:57:25.128100 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 11:57:25.128100 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 11:57:25.128100 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a79e2f0-60e3-40b6-aac8-665c0d755ecb could not be found. Jul 11 11:57:25.128100 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:57:25.128100 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:57:25.128100 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:57:25.128100 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:57:25.128100 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:57:25.128100 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:57:25.128100 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 11:57:25.128100 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 11:57:25.128100 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 11:57:25.129892 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 11:57:25.129892 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 11:57:25.129892 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 11:57:25.129892 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 11:57:25.129892 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 11:57:25.129892 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 11:57:25.129892 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 11:57:25.129892 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a79e2f0-60e3-40b6-aac8-665c0d755ecb could not be found. Jul 11 11:57:25.129892 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:57:25.129892 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:57:25.129892 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:57:25.129892 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:57:25.129892 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:57:25.129892 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:57:25.129892 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 11:57:25.129892 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 11:57:25.129892 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a79e2f0-60e3-40b6-aac8-665c0d755ecb could not be found. Jul 11 11:57:25.129892 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:57:25.131187 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-9ca215c7-d56e-4efd-a650-495f5cbe90ef tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] Returning 404 to user: Instance 2a79e2f0-60e3-40b6-aac8-665c0d755ecb could not be found. {{(pid=118321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 11:57:25.131187 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-9ca215c7-d56e-4efd-a650-495f5cbe90ef tempest-AttachVolumeTestJSON-1070974935 tempest-AttachVolumeTestJSON-1070974935-project] 10.222.0.26 "GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb" status: 404 len: 111 microversion: 2.1 time: 0.038056 Jul 11 11:57:25.131872 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1483/2970] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:57:25 2022] GET /compute/v2.1/servers/2a79e2f0-60e3-40b6-aac8-665c0d755ecb => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 11:57:30.375283 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-5e71a7e0-641e-43a0-9184-5b14201aa596 tempest-VolumesNegativeTest-526487006 tempest-VolumesNegativeTest-526487006-project] Action: 'create', calling method: .version_select at 0x7fb010480c10>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1379136593", "metadata": {"Type": "work"}}} {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:57:30.400844 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-5e71a7e0-641e-43a0-9184-5b14201aa596 tempest-VolumesNegativeTest-526487006 tempest-VolumesNegativeTest-526487006-project] Request method failure captured: Jul 11 11:57:30.400844 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 11 11:57:30.400844 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Accept: application/json Jul 11 11:57:30.400844 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Accept-Encoding: identity Jul 11 11:57:30.400844 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Connection: close Jul 11 11:57:30.400844 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Content-Length: 122 Jul 11 11:57:30.400844 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Content-Type: application/json Jul 11 11:57:30.400844 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Host: 10.222.0.26 Jul 11 11:57:30.400844 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Openstack-System-Scope: None Jul 11 11:57:30.400844 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: User-Agent: python-urllib3/1.26.9 Jul 11 11:57:30.400844 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Auth-Token: gAAAAABizBAqNUm5t1tgfD1jg3LAN-tdED70l0O6NuB49bIxeyXSVgpGYHu67n49S1QWmOTKcVglMbG1Q8hdTSxTJ80stiGVWuTxj_shTs5lJWa8XViQYDc86Ss05YA86wmE9Y-Ka4tUWER5FV2P_eLcezAoWel9I7YdWnNaOt-1BuWbtVmGNGA Jul 11 11:57:30.400844 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Domain-Id: None Jul 11 11:57:30.400844 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Domain-Name: None Jul 11 11:57:30.400844 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Identity-Status: Confirmed Jul 11 11:57:30.400844 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Is-Admin-Project: True Jul 11 11:57:30.400844 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Domain-Id: default Jul 11 11:57:30.400844 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Domain-Name: Default Jul 11 11:57:30.400844 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Id: 9a8692bb55544ced870a7b4f1f2c4dcf Jul 11 11:57:30.400844 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Name: tempest-VolumesNegativeTest-526487006 Jul 11 11:57:30.400844 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Role: member,reader Jul 11 11:57:30.400844 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Roles: member,reader Jul 11 11:57:30.402634 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9a8692bb55544ced870a7b4f1f2c4dcf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9a8692bb55544ced870a7b4f1f2c4dcf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9a8692bb55544ced870a7b4f1f2c4dcf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9a8692bb55544ced870a7b4f1f2c4dcf"}]}] Jul 11 11:57:30.402634 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Tenant: tempest-VolumesNegativeTest-526487006 Jul 11 11:57:30.402634 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Tenant-Id: 9a8692bb55544ced870a7b4f1f2c4dcf Jul 11 11:57:30.402634 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Tenant-Name: tempest-VolumesNegativeTest-526487006 Jul 11 11:57:30.402634 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User: tempest-VolumesNegativeTest-526487006-project Jul 11 11:57:30.402634 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Domain-Id: default Jul 11 11:57:30.402634 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Domain-Name: Default Jul 11 11:57:30.402634 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Id: d717221a65f1409d83f10ddfa374ebeb Jul 11 11:57:30.402634 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Name: tempest-VolumesNegativeTest-526487006-project Jul 11 11:57:30.402634 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Jul 11 11:57:30.402634 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1379136593", "metadata": {"Type": "work"}}} Jul 11 11:57:30.402634 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: method: Jul 11 11:57:30.402634 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 11 11:57:30.403864 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1379136593', 'metadata': {'Type': 'work'}}}} Jul 11 11:57:30.403864 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 11:57:30.403864 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:57:30.403864 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 11 11:57:30.403864 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 11 11:57:30.403864 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 11 11:57:30.403864 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi raise error Jul 11 11:57:30.403864 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 11 11:57:30.403864 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:57:30.403864 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 11 11:57:30.403864 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 11 11:57:30.403864 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:57:30.403864 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 11 11:57:30.403864 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi '#$%' Jul 11 11:57:30.403864 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:57:30.403864 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:57:30.403864 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:57:30.403864 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:57:30.403864 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:57:30.403864 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:57:30.403864 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 11:57:30.403864 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 11:57:30.406057 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 11 11:57:30.406057 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 11 11:57:30.406057 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 11:57:30.406057 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 11:57:30.406057 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 11 11:57:30.406057 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 11 11:57:30.406057 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 11 11:57:30.406057 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 11 11:57:30.406057 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 11 11:57:30.406057 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 11 11:57:30.406057 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 11 11:57:30.406057 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:57:30.406057 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:57:30.406057 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:57:30.406057 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:57:30.406057 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:57:30.406057 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:57:30.406057 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 11 11:57:30.406057 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 11 11:57:30.407834 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 11 11:57:30.407834 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:57:30.407834 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-5e71a7e0-641e-43a0-9184-5b14201aa596 tempest-VolumesNegativeTest-526487006 tempest-VolumesNegativeTest-526487006-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118322) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 11:57:30.407834 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-5e71a7e0-641e-43a0-9184-5b14201aa596 tempest-VolumesNegativeTest-526487006 tempest-VolumesNegativeTest-526487006-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.154742 Jul 11 11:57:30.407834 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1488/2971] 10.222.0.26 () {60 vars in 1155 bytes} [Mon Jul 11 11:57:30 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 156 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 11 11:57:30.411930 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-34818e11-112b-410e-8c99-5bd97feed514 tempest-VolumesNegativeTest-526487006 tempest-VolumesNegativeTest-526487006-project] Action: 'create', calling method: .version_select at 0x7fb0100844c0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-449572613", "metadata": {"Type": "work"}}} {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:57:30.415654 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-34818e11-112b-410e-8c99-5bd97feed514 tempest-VolumesNegativeTest-526487006 tempest-VolumesNegativeTest-526487006-project] Request method failure captured: Jul 11 11:57:30.415654 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 11 11:57:30.415654 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Accept: application/json Jul 11 11:57:30.415654 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Accept-Encoding: identity Jul 11 11:57:30.415654 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Connection: close Jul 11 11:57:30.415654 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Content-Length: 119 Jul 11 11:57:30.415654 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Content-Type: application/json Jul 11 11:57:30.415654 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Host: 10.222.0.26 Jul 11 11:57:30.415654 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Openstack-System-Scope: None Jul 11 11:57:30.415654 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: User-Agent: python-urllib3/1.26.9 Jul 11 11:57:30.415654 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Auth-Token: gAAAAABizBAqNUm5t1tgfD1jg3LAN-tdED70l0O6NuB49bIxeyXSVgpGYHu67n49S1QWmOTKcVglMbG1Q8hdTSxTJ80stiGVWuTxj_shTs5lJWa8XViQYDc86Ss05YA86wmE9Y-Ka4tUWER5FV2P_eLcezAoWel9I7YdWnNaOt-1BuWbtVmGNGA Jul 11 11:57:30.415654 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Domain-Id: None Jul 11 11:57:30.415654 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Domain-Name: None Jul 11 11:57:30.415654 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Identity-Status: Confirmed Jul 11 11:57:30.415654 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Is-Admin-Project: True Jul 11 11:57:30.415654 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Domain-Id: default Jul 11 11:57:30.415654 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Domain-Name: Default Jul 11 11:57:30.415654 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Id: 9a8692bb55544ced870a7b4f1f2c4dcf Jul 11 11:57:30.415654 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Name: tempest-VolumesNegativeTest-526487006 Jul 11 11:57:30.415654 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Role: member,reader Jul 11 11:57:30.415654 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Roles: member,reader Jul 11 11:57:30.417421 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9a8692bb55544ced870a7b4f1f2c4dcf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9a8692bb55544ced870a7b4f1f2c4dcf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9a8692bb55544ced870a7b4f1f2c4dcf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9a8692bb55544ced870a7b4f1f2c4dcf"}]}] Jul 11 11:57:30.417421 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Tenant: tempest-VolumesNegativeTest-526487006 Jul 11 11:57:30.417421 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Tenant-Id: 9a8692bb55544ced870a7b4f1f2c4dcf Jul 11 11:57:30.417421 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Tenant-Name: tempest-VolumesNegativeTest-526487006 Jul 11 11:57:30.417421 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User: tempest-VolumesNegativeTest-526487006-project Jul 11 11:57:30.417421 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Domain-Id: default Jul 11 11:57:30.417421 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Domain-Name: Default Jul 11 11:57:30.417421 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Id: d717221a65f1409d83f10ddfa374ebeb Jul 11 11:57:30.417421 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Name: tempest-VolumesNegativeTest-526487006-project Jul 11 11:57:30.417421 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Jul 11 11:57:30.417421 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-449572613", "metadata": {"Type": "work"}}} Jul 11 11:57:30.417421 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: method: Jul 11 11:57:30.417421 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 11 11:57:30.418563 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-449572613', 'metadata': {'Type': 'work'}}}} Jul 11 11:57:30.418563 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 11:57:30.418563 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:57:30.418563 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 11 11:57:30.418563 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 11 11:57:30.418563 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 11 11:57:30.418563 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise error Jul 11 11:57:30.418563 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 11 11:57:30.418563 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:57:30.418563 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 11 11:57:30.418563 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 11 11:57:30.418563 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:57:30.418563 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 11 11:57:30.418563 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi '0' Jul 11 11:57:30.418563 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:57:30.418563 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:57:30.418563 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:57:30.418563 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:57:30.418563 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:57:30.418563 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:57:30.418563 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 11:57:30.418563 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 11:57:30.420296 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 11 11:57:30.420296 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 11 11:57:30.420296 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 11:57:30.420296 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 11:57:30.420296 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 11 11:57:30.420296 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 11 11:57:30.420296 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 11 11:57:30.420296 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 11 11:57:30.420296 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 11 11:57:30.420296 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 11 11:57:30.420296 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 11 11:57:30.420296 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:57:30.420296 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:57:30.420296 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:57:30.420296 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:57:30.420296 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:57:30.420296 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:57:30.420296 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 11 11:57:30.420296 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 11 11:57:30.421834 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 11 11:57:30.421834 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:57:30.421834 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-34818e11-112b-410e-8c99-5bd97feed514 tempest-VolumesNegativeTest-526487006 tempest-VolumesNegativeTest-526487006-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 11:57:30.421834 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-34818e11-112b-410e-8c99-5bd97feed514 tempest-VolumesNegativeTest-526487006 tempest-VolumesNegativeTest-526487006-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008988 Jul 11 11:57:30.421834 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1484/2972] 10.222.0.26 () {60 vars in 1155 bytes} [Mon Jul 11 11:57:30 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 11 11:57:30.425610 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-86a76634-57ee-4ed3-b74f-30ca54cb059c tempest-VolumesNegativeTest-526487006 tempest-VolumesNegativeTest-526487006-project] Action: 'create', calling method: .version_select at 0x7fb0105cfe50>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1513972560", "metadata": {"Type": "work"}}} {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:57:30.428855 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-86a76634-57ee-4ed3-b74f-30ca54cb059c tempest-VolumesNegativeTest-526487006 tempest-VolumesNegativeTest-526487006-project] Request method failure captured: Jul 11 11:57:30.428855 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 11 11:57:30.428855 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Accept: application/json Jul 11 11:57:30.428855 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Accept-Encoding: identity Jul 11 11:57:30.428855 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Connection: close Jul 11 11:57:30.428855 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Content-Length: 119 Jul 11 11:57:30.428855 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Content-Type: application/json Jul 11 11:57:30.428855 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Host: 10.222.0.26 Jul 11 11:57:30.428855 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Openstack-System-Scope: None Jul 11 11:57:30.428855 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: User-Agent: python-urllib3/1.26.9 Jul 11 11:57:30.428855 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Auth-Token: gAAAAABizBAqNUm5t1tgfD1jg3LAN-tdED70l0O6NuB49bIxeyXSVgpGYHu67n49S1QWmOTKcVglMbG1Q8hdTSxTJ80stiGVWuTxj_shTs5lJWa8XViQYDc86Ss05YA86wmE9Y-Ka4tUWER5FV2P_eLcezAoWel9I7YdWnNaOt-1BuWbtVmGNGA Jul 11 11:57:30.428855 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Domain-Id: None Jul 11 11:57:30.428855 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Domain-Name: None Jul 11 11:57:30.428855 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Identity-Status: Confirmed Jul 11 11:57:30.428855 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Is-Admin-Project: True Jul 11 11:57:30.428855 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Domain-Id: default Jul 11 11:57:30.428855 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Domain-Name: Default Jul 11 11:57:30.428855 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Id: 9a8692bb55544ced870a7b4f1f2c4dcf Jul 11 11:57:30.428855 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Name: tempest-VolumesNegativeTest-526487006 Jul 11 11:57:30.428855 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Role: member,reader Jul 11 11:57:30.428855 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Roles: member,reader Jul 11 11:57:30.431359 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9a8692bb55544ced870a7b4f1f2c4dcf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9a8692bb55544ced870a7b4f1f2c4dcf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9a8692bb55544ced870a7b4f1f2c4dcf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9a8692bb55544ced870a7b4f1f2c4dcf"}]}] Jul 11 11:57:30.431359 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Tenant: tempest-VolumesNegativeTest-526487006 Jul 11 11:57:30.431359 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Tenant-Id: 9a8692bb55544ced870a7b4f1f2c4dcf Jul 11 11:57:30.431359 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Tenant-Name: tempest-VolumesNegativeTest-526487006 Jul 11 11:57:30.431359 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User: tempest-VolumesNegativeTest-526487006-project Jul 11 11:57:30.431359 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Domain-Id: default Jul 11 11:57:30.431359 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Domain-Name: Default Jul 11 11:57:30.431359 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Id: d717221a65f1409d83f10ddfa374ebeb Jul 11 11:57:30.431359 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Name: tempest-VolumesNegativeTest-526487006-project Jul 11 11:57:30.431359 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Jul 11 11:57:30.431359 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1513972560", "metadata": {"Type": "work"}}} Jul 11 11:57:30.431359 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: method: Jul 11 11:57:30.431359 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 11 11:57:30.432842 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1513972560', 'metadata': {'Type': 'work'}}}} Jul 11 11:57:30.432842 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 11:57:30.432842 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:57:30.432842 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 11 11:57:30.432842 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 11 11:57:30.432842 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 11 11:57:30.432842 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi raise error Jul 11 11:57:30.432842 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 11 11:57:30.432842 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:57:30.432842 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 11 11:57:30.432842 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 11 11:57:30.432842 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:57:30.432842 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 11 11:57:30.432842 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi '' Jul 11 11:57:30.432842 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:57:30.432842 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:57:30.432842 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:57:30.432842 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:57:30.432842 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:57:30.432842 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:57:30.432842 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 11:57:30.432842 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 11:57:30.434563 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 11 11:57:30.434563 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 11 11:57:30.434563 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 11:57:30.434563 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 11:57:30.434563 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 11 11:57:30.434563 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 11 11:57:30.434563 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 11 11:57:30.434563 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 11 11:57:30.434563 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 11 11:57:30.434563 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 11 11:57:30.434563 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 11 11:57:30.434563 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:57:30.434563 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:57:30.434563 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:57:30.434563 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:57:30.434563 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:57:30.434563 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:57:30.434563 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 11 11:57:30.434563 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 11 11:57:30.436198 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 11 11:57:30.436198 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:57:30.436198 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-86a76634-57ee-4ed3-b74f-30ca54cb059c tempest-VolumesNegativeTest-526487006 tempest-VolumesNegativeTest-526487006-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118322) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 11:57:30.436198 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-86a76634-57ee-4ed3-b74f-30ca54cb059c tempest-VolumesNegativeTest-526487006 tempest-VolumesNegativeTest-526487006-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008843 Jul 11 11:57:30.436198 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1489/2973] 10.222.0.26 () {60 vars in 1155 bytes} [Mon Jul 11 11:57:30 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 11 11:57:30.439847 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-dc90188a-b750-4ec6-987d-1402cabdd452 tempest-VolumesNegativeTest-526487006 tempest-VolumesNegativeTest-526487006-project] Calling method '.version_select at 0x7fb010090dc0>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:57:35.103299 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_api:SELECT=4 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:57:35.114238 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=4 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:57:38.423444 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 11:57:38.424120 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Mon Jul 11 11:57:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-volumes/tempest-invalid-330245880 (ip 10.222.0.26) !!! Jul 11 11:58:30.494860 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_api:SELECT=4 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:58:30.495616 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=4 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:58:30.499670 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-44f8a606-ff2e-4475-bf35-d2f787babe7c tempest-VolumesNegativeTest-526487006 tempest-VolumesNegativeTest-526487006-project] Calling method '.version_select at 0x7fb01009fd30>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:59:08.045206 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.wsgi [None req-dc90188a-b750-4ec6-987d-1402cabdd452 tempest-VolumesNegativeTest-526487006 tempest-VolumesNegativeTest-526487006-project] HTTP exception thrown: Volume tempest-invalid-330245880 could not be found. Jul 11 11:59:08.047460 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-dc90188a-b750-4ec6-987d-1402cabdd452 tempest-VolumesNegativeTest-526487006 tempest-VolumesNegativeTest-526487006-project] Request method failure captured: Jul 11 11:59:08.047460 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-330245880 HTTP/1.1 Jul 11 11:59:08.047460 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Accept: application/json Jul 11 11:59:08.047460 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Accept-Encoding: identity Jul 11 11:59:08.047460 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Connection: close Jul 11 11:59:08.047460 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Content-Length: 0 Jul 11 11:59:08.047460 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Content-Type: application/json Jul 11 11:59:08.047460 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Host: 10.222.0.26 Jul 11 11:59:08.047460 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Openstack-System-Scope: None Jul 11 11:59:08.047460 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: User-Agent: python-urllib3/1.26.9 Jul 11 11:59:08.047460 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Auth-Token: gAAAAABizBAqNUm5t1tgfD1jg3LAN-tdED70l0O6NuB49bIxeyXSVgpGYHu67n49S1QWmOTKcVglMbG1Q8hdTSxTJ80stiGVWuTxj_shTs5lJWa8XViQYDc86Ss05YA86wmE9Y-Ka4tUWER5FV2P_eLcezAoWel9I7YdWnNaOt-1BuWbtVmGNGA Jul 11 11:59:08.047460 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Domain-Id: None Jul 11 11:59:08.047460 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Domain-Name: None Jul 11 11:59:08.047460 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Identity-Status: Confirmed Jul 11 11:59:08.047460 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Is-Admin-Project: True Jul 11 11:59:08.047460 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Domain-Id: default Jul 11 11:59:08.047460 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Domain-Name: Default Jul 11 11:59:08.047460 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Id: 9a8692bb55544ced870a7b4f1f2c4dcf Jul 11 11:59:08.047460 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Name: tempest-VolumesNegativeTest-526487006 Jul 11 11:59:08.047460 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Role: member,reader Jul 11 11:59:08.047460 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Roles: member,reader Jul 11 11:59:08.049294 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9a8692bb55544ced870a7b4f1f2c4dcf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9a8692bb55544ced870a7b4f1f2c4dcf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9a8692bb55544ced870a7b4f1f2c4dcf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9a8692bb55544ced870a7b4f1f2c4dcf"}]}] Jul 11 11:59:08.049294 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Tenant: tempest-VolumesNegativeTest-526487006 Jul 11 11:59:08.049294 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Tenant-Id: 9a8692bb55544ced870a7b4f1f2c4dcf Jul 11 11:59:08.049294 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Tenant-Name: tempest-VolumesNegativeTest-526487006 Jul 11 11:59:08.049294 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User: tempest-VolumesNegativeTest-526487006-project Jul 11 11:59:08.049294 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Domain-Id: default Jul 11 11:59:08.049294 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Domain-Name: Default Jul 11 11:59:08.049294 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Id: d717221a65f1409d83f10ddfa374ebeb Jul 11 11:59:08.049294 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Name: tempest-VolumesNegativeTest-526487006-project Jul 11 11:59:08.049294 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: method: Jul 11 11:59:08.049294 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: exception: Volume tempest-invalid-330245880 could not be found. Jul 11 11:59:08.049294 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: action_args: {'id': 'tempest-invalid-330245880'} Jul 11 11:59:08.049294 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 11:59:08.050506 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:59:08.050506 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 11 11:59:08.050506 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 11 11:59:08.050506 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 11 11:59:08.050506 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 11 11:59:08.050506 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 11 11:59:08.050506 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 11 11:59:08.050506 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 11 11:59:08.050506 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 11 11:59:08.050506 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 11 11:59:08.050506 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 11 11:59:08.050506 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 11:59:08.050506 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 11:59:08.050506 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 11:59:08.050506 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 11:59:08.050506 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-330245880 could not be found. (HTTP 404) (Request-ID: req-f7833a61-c115-4105-b101-051620ae17a7) Jul 11 11:59:08.050506 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:59:08.050506 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:59:08.050506 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:59:08.052869 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:59:08.052869 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 11 11:59:08.052869 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 11 11:59:08.052869 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 11 11:59:08.052869 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 11 11:59:08.052869 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 11 11:59:08.052869 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 11 11:59:08.052869 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 11 11:59:08.052869 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 11 11:59:08.052869 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 11 11:59:08.052869 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 11 11:59:08.052869 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 11 11:59:08.052869 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 11 11:59:08.052869 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 11 11:59:08.052869 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 11 11:59:08.052869 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 11 11:59:08.052869 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 11 11:59:08.052869 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 11 11:59:08.052869 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 11 11:59:08.055474 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 11:59:08.055474 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 11:59:08.055474 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 11:59:08.055474 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 11:59:08.055474 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-330245880 could not be found. Jul 11 11:59:08.055474 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:59:08.055474 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:59:08.055474 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:59:08.055474 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:59:08.055474 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:59:08.055474 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:59:08.055474 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 11:59:08.055474 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 11:59:08.055474 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 11 11:59:08.055474 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 11 11:59:08.055474 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 11:59:08.055474 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 11:59:08.055474 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 11 11:59:08.055474 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 11:59:08.055474 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-330245880 could not be found. Jul 11 11:59:08.057878 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:59:08.057878 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:59:08.057878 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:59:08.057878 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:59:08.057878 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:59:08.057878 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:59:08.057878 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 11:59:08.057878 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 11:59:08.057878 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-330245880 could not be found. Jul 11 11:59:08.057878 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:59:08.057878 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-dc90188a-b750-4ec6-987d-1402cabdd452 tempest-VolumesNegativeTest-526487006 tempest-VolumesNegativeTest-526487006-project] Returning 404 to user: Volume tempest-invalid-330245880 could not be found. {{(pid=118321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 11:59:08.057878 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-dc90188a-b750-4ec6-987d-1402cabdd452 tempest-VolumesNegativeTest-526487006 tempest-VolumesNegativeTest-526487006-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/tempest-invalid-330245880" status: 404 len: 98 microversion: 2.1 time: 97.613036 Jul 11 11:59:08.057878 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1485/2974] 10.222.0.26 () {58 vars in 1214 bytes} [Mon Jul 11 11:57:30 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-330245880 => generated 98 bytes in 97614 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 11 11:59:08.250946 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.wsgi [None req-44f8a606-ff2e-4475-bf35-d2f787babe7c tempest-VolumesNegativeTest-526487006 tempest-VolumesNegativeTest-526487006-project] HTTP exception thrown: Volume tempest-invalid-330245880 could not be found. Jul 11 11:59:08.252922 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-44f8a606-ff2e-4475-bf35-d2f787babe7c tempest-VolumesNegativeTest-526487006 tempest-VolumesNegativeTest-526487006-project] Request method failure captured: Jul 11 11:59:08.252922 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-330245880 HTTP/1.1 Jul 11 11:59:08.252922 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Accept: application/json Jul 11 11:59:08.252922 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Accept-Encoding: identity Jul 11 11:59:08.252922 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Connection: close Jul 11 11:59:08.252922 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Content-Length: 0 Jul 11 11:59:08.252922 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Content-Type: application/json Jul 11 11:59:08.252922 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Host: 10.222.0.26 Jul 11 11:59:08.252922 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Openstack-System-Scope: None Jul 11 11:59:08.252922 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: User-Agent: python-urllib3/1.26.9 Jul 11 11:59:08.252922 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Auth-Token: gAAAAABizBAqNUm5t1tgfD1jg3LAN-tdED70l0O6NuB49bIxeyXSVgpGYHu67n49S1QWmOTKcVglMbG1Q8hdTSxTJ80stiGVWuTxj_shTs5lJWa8XViQYDc86Ss05YA86wmE9Y-Ka4tUWER5FV2P_eLcezAoWel9I7YdWnNaOt-1BuWbtVmGNGA Jul 11 11:59:08.252922 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Domain-Id: None Jul 11 11:59:08.252922 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Domain-Name: None Jul 11 11:59:08.252922 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Identity-Status: Confirmed Jul 11 11:59:08.252922 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Is-Admin-Project: True Jul 11 11:59:08.252922 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Domain-Id: default Jul 11 11:59:08.252922 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Domain-Name: Default Jul 11 11:59:08.252922 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Id: 9a8692bb55544ced870a7b4f1f2c4dcf Jul 11 11:59:08.252922 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Name: tempest-VolumesNegativeTest-526487006 Jul 11 11:59:08.252922 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Role: member,reader Jul 11 11:59:08.252922 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Roles: member,reader Jul 11 11:59:08.254745 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9a8692bb55544ced870a7b4f1f2c4dcf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9a8692bb55544ced870a7b4f1f2c4dcf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9a8692bb55544ced870a7b4f1f2c4dcf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9a8692bb55544ced870a7b4f1f2c4dcf"}]}] Jul 11 11:59:08.254745 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Tenant: tempest-VolumesNegativeTest-526487006 Jul 11 11:59:08.254745 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Tenant-Id: 9a8692bb55544ced870a7b4f1f2c4dcf Jul 11 11:59:08.254745 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Tenant-Name: tempest-VolumesNegativeTest-526487006 Jul 11 11:59:08.254745 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User: tempest-VolumesNegativeTest-526487006-project Jul 11 11:59:08.254745 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Domain-Id: default Jul 11 11:59:08.254745 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Domain-Name: Default Jul 11 11:59:08.254745 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Id: d717221a65f1409d83f10ddfa374ebeb Jul 11 11:59:08.254745 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Name: tempest-VolumesNegativeTest-526487006-project Jul 11 11:59:08.254745 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: method: Jul 11 11:59:08.254745 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: exception: Volume tempest-invalid-330245880 could not be found. Jul 11 11:59:08.254745 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: action_args: {'id': 'tempest-invalid-330245880'} Jul 11 11:59:08.254745 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 11:59:08.255853 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:59:08.255853 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 11 11:59:08.255853 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 11 11:59:08.255853 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 11 11:59:08.255853 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 11 11:59:08.255853 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 11 11:59:08.255853 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 11 11:59:08.255853 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 11 11:59:08.255853 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 11 11:59:08.255853 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 11 11:59:08.255853 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 11 11:59:08.255853 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 11:59:08.255853 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 11:59:08.255853 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 11:59:08.255853 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 11:59:08.255853 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-330245880 could not be found. (HTTP 404) (Request-ID: req-c638f42d-762c-4376-9fe7-3eb7bf6c361f) Jul 11 11:59:08.255853 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:59:08.255853 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:59:08.255853 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:59:08.257353 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:59:08.257353 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 11 11:59:08.257353 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 11 11:59:08.257353 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 11 11:59:08.257353 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 11 11:59:08.257353 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 11 11:59:08.257353 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 11 11:59:08.257353 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 11 11:59:08.257353 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 11 11:59:08.257353 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 11 11:59:08.257353 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 11 11:59:08.257353 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 11 11:59:08.257353 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 11 11:59:08.257353 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 11 11:59:08.257353 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 11 11:59:08.257353 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 11 11:59:08.257353 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 11 11:59:08.257353 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 11 11:59:08.257353 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 11 11:59:08.259945 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 11:59:08.259945 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 11:59:08.259945 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 11:59:08.259945 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 11:59:08.259945 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-330245880 could not be found. Jul 11 11:59:08.259945 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:59:08.259945 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:59:08.259945 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:59:08.259945 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:59:08.259945 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:59:08.259945 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:59:08.259945 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 11:59:08.259945 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 11:59:08.259945 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 11 11:59:08.259945 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 11 11:59:08.259945 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 11:59:08.259945 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 11:59:08.259945 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 11 11:59:08.259945 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 11:59:08.259945 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-330245880 could not be found. Jul 11 11:59:08.265279 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:59:08.265279 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:59:08.265279 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:59:08.265279 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:59:08.265279 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:59:08.265279 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:59:08.265279 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 11:59:08.265279 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 11:59:08.265279 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-330245880 could not be found. Jul 11 11:59:08.265279 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:59:08.265279 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-44f8a606-ff2e-4475-bf35-d2f787babe7c tempest-VolumesNegativeTest-526487006 tempest-VolumesNegativeTest-526487006-project] Returning 404 to user: Volume tempest-invalid-330245880 could not be found. {{(pid=118322) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 11:59:08.265279 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-44f8a606-ff2e-4475-bf35-d2f787babe7c tempest-VolumesNegativeTest-526487006 tempest-VolumesNegativeTest-526487006-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/tempest-invalid-330245880" status: 404 len: 98 microversion: 2.1 time: 37.761227 Jul 11 11:59:08.265279 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1490/2975] 10.222.0.26 () {58 vars in 1214 bytes} [Mon Jul 11 11:58:30 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-330245880 => generated 98 bytes in 37762 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 11 11:59:08.266563 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-872a7a83-2aff-48fb-9d50-274d4e708cff tempest-VolumesNegativeTest-526487006 tempest-VolumesNegativeTest-526487006-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005192 Jul 11 11:59:08.267189 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1486/2976] 10.222.0.26 () {58 vars in 1139 bytes} [Mon Jul 11 11:59:08 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 11 11:59:08.276222 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-f736ea80-dc46-4f7e-9798-5405046e4008 tempest-VolumesNegativeTest-526487006 tempest-VolumesNegativeTest-526487006-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004328 Jul 11 11:59:08.276921 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1491/2977] 10.222.0.26 () {58 vars in 1136 bytes} [Mon Jul 11 11:59:08 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 11 11:59:08.290138 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-93c8186c-73e7-49b9-86c1-66b0355d8dd7 tempest-VolumesNegativeTest-526487006 tempest-VolumesNegativeTest-526487006-project] Calling method '.version_select at 0x7fb010072ca0>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:59:08.777786 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.wsgi [None req-93c8186c-73e7-49b9-86c1-66b0355d8dd7 tempest-VolumesNegativeTest-526487006 tempest-VolumesNegativeTest-526487006-project] HTTP exception thrown: Volume d447b2c0-f369-4546-a8e1-aa8a6b074461 could not be found. Jul 11 11:59:08.779848 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-93c8186c-73e7-49b9-86c1-66b0355d8dd7 tempest-VolumesNegativeTest-526487006 tempest-VolumesNegativeTest-526487006-project] Request method failure captured: Jul 11 11:59:08.779848 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: request: DELETE /compute/v2.1/os-volumes/d447b2c0-f369-4546-a8e1-aa8a6b074461 HTTP/1.1 Jul 11 11:59:08.779848 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Accept: application/json Jul 11 11:59:08.779848 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Accept-Encoding: identity Jul 11 11:59:08.779848 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Connection: close Jul 11 11:59:08.779848 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Content-Length: 0 Jul 11 11:59:08.779848 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Content-Type: application/json Jul 11 11:59:08.779848 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Host: 10.222.0.26 Jul 11 11:59:08.779848 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Openstack-System-Scope: None Jul 11 11:59:08.779848 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: User-Agent: python-urllib3/1.26.9 Jul 11 11:59:08.779848 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Auth-Token: gAAAAABizBAqNUm5t1tgfD1jg3LAN-tdED70l0O6NuB49bIxeyXSVgpGYHu67n49S1QWmOTKcVglMbG1Q8hdTSxTJ80stiGVWuTxj_shTs5lJWa8XViQYDc86Ss05YA86wmE9Y-Ka4tUWER5FV2P_eLcezAoWel9I7YdWnNaOt-1BuWbtVmGNGA Jul 11 11:59:08.779848 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Domain-Id: None Jul 11 11:59:08.779848 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Domain-Name: None Jul 11 11:59:08.779848 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Identity-Status: Confirmed Jul 11 11:59:08.779848 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Is-Admin-Project: True Jul 11 11:59:08.779848 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Domain-Id: default Jul 11 11:59:08.779848 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Domain-Name: Default Jul 11 11:59:08.779848 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Id: 9a8692bb55544ced870a7b4f1f2c4dcf Jul 11 11:59:08.779848 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Name: tempest-VolumesNegativeTest-526487006 Jul 11 11:59:08.779848 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Role: member,reader Jul 11 11:59:08.779848 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Roles: member,reader Jul 11 11:59:08.789857 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9a8692bb55544ced870a7b4f1f2c4dcf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9a8692bb55544ced870a7b4f1f2c4dcf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9a8692bb55544ced870a7b4f1f2c4dcf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9a8692bb55544ced870a7b4f1f2c4dcf"}]}] Jul 11 11:59:08.789857 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Tenant: tempest-VolumesNegativeTest-526487006 Jul 11 11:59:08.789857 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Tenant-Id: 9a8692bb55544ced870a7b4f1f2c4dcf Jul 11 11:59:08.789857 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Tenant-Name: tempest-VolumesNegativeTest-526487006 Jul 11 11:59:08.789857 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User: tempest-VolumesNegativeTest-526487006-project Jul 11 11:59:08.789857 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Domain-Id: default Jul 11 11:59:08.789857 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Domain-Name: Default Jul 11 11:59:08.789857 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Id: d717221a65f1409d83f10ddfa374ebeb Jul 11 11:59:08.789857 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Name: tempest-VolumesNegativeTest-526487006-project Jul 11 11:59:08.789857 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: method: Jul 11 11:59:08.789857 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: exception: Volume d447b2c0-f369-4546-a8e1-aa8a6b074461 could not be found. Jul 11 11:59:08.789857 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: action_args: {'id': 'd447b2c0-f369-4546-a8e1-aa8a6b074461'} Jul 11 11:59:08.789857 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 11:59:08.791808 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:59:08.791808 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 11 11:59:08.791808 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 11 11:59:08.791808 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 11 11:59:08.791808 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 11 11:59:08.791808 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 11 11:59:08.791808 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 11 11:59:08.791808 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 11 11:59:08.791808 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 11 11:59:08.791808 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 11 11:59:08.791808 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 11 11:59:08.791808 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 11:59:08.791808 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 11:59:08.791808 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 11:59:08.791808 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 11:59:08.791808 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d447b2c0-f369-4546-a8e1-aa8a6b074461 could not be found. (HTTP 404) (Request-ID: req-35ccc86c-9696-4ceb-8fad-3ebf1916b964) Jul 11 11:59:08.791808 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:59:08.791808 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:59:08.791808 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:59:08.793431 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:59:08.793431 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 11 11:59:08.793431 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 11 11:59:08.793431 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 11 11:59:08.793431 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 11 11:59:08.793431 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 11 11:59:08.793431 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 11 11:59:08.793431 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 11 11:59:08.793431 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 11 11:59:08.793431 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 11 11:59:08.793431 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 11 11:59:08.793431 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 11 11:59:08.793431 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 11 11:59:08.793431 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 11 11:59:08.793431 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 11 11:59:08.793431 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 11 11:59:08.793431 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 11 11:59:08.793431 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 11 11:59:08.793431 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 11 11:59:08.795080 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 11:59:08.795080 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 11:59:08.795080 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 11:59:08.795080 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 11:59:08.795080 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d447b2c0-f369-4546-a8e1-aa8a6b074461 could not be found. Jul 11 11:59:08.795080 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:59:08.795080 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:59:08.795080 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:59:08.795080 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:59:08.795080 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:59:08.795080 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:59:08.795080 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 11:59:08.795080 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 11:59:08.795080 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 11 11:59:08.795080 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 11 11:59:08.795080 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 11:59:08.795080 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 11:59:08.795080 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 11 11:59:08.795080 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 11:59:08.797317 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d447b2c0-f369-4546-a8e1-aa8a6b074461 could not be found. Jul 11 11:59:08.797317 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:59:08.797317 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:59:08.797317 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:59:08.797317 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:59:08.797317 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:59:08.797317 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:59:08.797317 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 11:59:08.797317 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 11:59:08.797317 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d447b2c0-f369-4546-a8e1-aa8a6b074461 could not be found. Jul 11 11:59:08.797317 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:59:08.797317 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-93c8186c-73e7-49b9-86c1-66b0355d8dd7 tempest-VolumesNegativeTest-526487006 tempest-VolumesNegativeTest-526487006-project] Returning 404 to user: Volume d447b2c0-f369-4546-a8e1-aa8a6b074461 could not be found. {{(pid=118321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 11:59:08.797317 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-93c8186c-73e7-49b9-86c1-66b0355d8dd7 tempest-VolumesNegativeTest-526487006 tempest-VolumesNegativeTest-526487006-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/d447b2c0-f369-4546-a8e1-aa8a6b074461" status: 404 len: 109 microversion: 2.1 time: 0.499332 Jul 11 11:59:08.797317 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1487/2978] 10.222.0.26 () {58 vars in 1247 bytes} [Mon Jul 11 11:59:08 2022] DELETE /compute/v2.1/os-volumes/d447b2c0-f369-4546-a8e1-aa8a6b074461 => generated 109 bytes in 501 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 11:59:08.800880 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-61189711-4d6b-492a-afcc-723002ff871c tempest-VolumesNegativeTest-526487006 tempest-VolumesNegativeTest-526487006-project] Calling method '.version_select at 0x7fb0104800d0>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:59:08.841195 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.wsgi [None req-61189711-4d6b-492a-afcc-723002ff871c tempest-VolumesNegativeTest-526487006 tempest-VolumesNegativeTest-526487006-project] HTTP exception thrown: Volume db26dcde-cf70-49a7-9ebc-830f49a0889e could not be found. Jul 11 11:59:08.843469 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-61189711-4d6b-492a-afcc-723002ff871c tempest-VolumesNegativeTest-526487006 tempest-VolumesNegativeTest-526487006-project] Request method failure captured: Jul 11 11:59:08.843469 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: request: GET /compute/v2.1/os-volumes/db26dcde-cf70-49a7-9ebc-830f49a0889e HTTP/1.1 Jul 11 11:59:08.843469 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Accept: application/json Jul 11 11:59:08.843469 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Accept-Encoding: identity Jul 11 11:59:08.843469 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Connection: close Jul 11 11:59:08.843469 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Content-Length: 0 Jul 11 11:59:08.843469 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Content-Type: application/json Jul 11 11:59:08.843469 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Host: 10.222.0.26 Jul 11 11:59:08.843469 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Openstack-System-Scope: None Jul 11 11:59:08.843469 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: User-Agent: python-urllib3/1.26.9 Jul 11 11:59:08.843469 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Auth-Token: gAAAAABizBAqNUm5t1tgfD1jg3LAN-tdED70l0O6NuB49bIxeyXSVgpGYHu67n49S1QWmOTKcVglMbG1Q8hdTSxTJ80stiGVWuTxj_shTs5lJWa8XViQYDc86Ss05YA86wmE9Y-Ka4tUWER5FV2P_eLcezAoWel9I7YdWnNaOt-1BuWbtVmGNGA Jul 11 11:59:08.843469 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Domain-Id: None Jul 11 11:59:08.843469 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Domain-Name: None Jul 11 11:59:08.843469 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Identity-Status: Confirmed Jul 11 11:59:08.843469 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Is-Admin-Project: True Jul 11 11:59:08.843469 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Domain-Id: default Jul 11 11:59:08.843469 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Domain-Name: Default Jul 11 11:59:08.843469 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Id: 9a8692bb55544ced870a7b4f1f2c4dcf Jul 11 11:59:08.843469 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Name: tempest-VolumesNegativeTest-526487006 Jul 11 11:59:08.843469 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Role: member,reader Jul 11 11:59:08.843469 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Roles: member,reader Jul 11 11:59:08.845390 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9a8692bb55544ced870a7b4f1f2c4dcf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9a8692bb55544ced870a7b4f1f2c4dcf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9a8692bb55544ced870a7b4f1f2c4dcf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9a8692bb55544ced870a7b4f1f2c4dcf"}]}] Jul 11 11:59:08.845390 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Tenant: tempest-VolumesNegativeTest-526487006 Jul 11 11:59:08.845390 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Tenant-Id: 9a8692bb55544ced870a7b4f1f2c4dcf Jul 11 11:59:08.845390 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Tenant-Name: tempest-VolumesNegativeTest-526487006 Jul 11 11:59:08.845390 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User: tempest-VolumesNegativeTest-526487006-project Jul 11 11:59:08.845390 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Domain-Id: default Jul 11 11:59:08.845390 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Domain-Name: Default Jul 11 11:59:08.845390 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Id: d717221a65f1409d83f10ddfa374ebeb Jul 11 11:59:08.845390 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Name: tempest-VolumesNegativeTest-526487006-project Jul 11 11:59:08.845390 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: method: Jul 11 11:59:08.845390 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: exception: Volume db26dcde-cf70-49a7-9ebc-830f49a0889e could not be found. Jul 11 11:59:08.845390 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: action_args: {'id': 'db26dcde-cf70-49a7-9ebc-830f49a0889e'} Jul 11 11:59:08.845390 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 11:59:08.848472 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:59:08.848472 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 11 11:59:08.848472 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 11 11:59:08.848472 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 11 11:59:08.848472 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 11 11:59:08.848472 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 11 11:59:08.848472 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 11 11:59:08.848472 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 11 11:59:08.848472 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 11 11:59:08.848472 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 11 11:59:08.848472 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 11 11:59:08.848472 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 11:59:08.848472 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 11:59:08.848472 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 11:59:08.848472 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 11:59:08.848472 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume db26dcde-cf70-49a7-9ebc-830f49a0889e could not be found. (HTTP 404) (Request-ID: req-8c06db24-dd44-42fb-9472-8e77d778d1ce) Jul 11 11:59:08.848472 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:59:08.848472 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:59:08.848472 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:59:08.849974 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:59:08.849974 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 11 11:59:08.849974 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 11 11:59:08.849974 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 11 11:59:08.849974 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 11 11:59:08.849974 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 11 11:59:08.849974 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 11 11:59:08.849974 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 11 11:59:08.849974 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 11 11:59:08.849974 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 11 11:59:08.849974 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 11 11:59:08.849974 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 11 11:59:08.849974 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 11 11:59:08.849974 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 11 11:59:08.849974 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 11 11:59:08.849974 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 11 11:59:08.849974 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 11 11:59:08.849974 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 11 11:59:08.849974 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 11 11:59:08.851371 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 11:59:08.851371 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 11:59:08.851371 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 11:59:08.851371 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 11:59:08.851371 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume db26dcde-cf70-49a7-9ebc-830f49a0889e could not be found. Jul 11 11:59:08.851371 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:59:08.851371 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:59:08.851371 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:59:08.851371 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:59:08.851371 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:59:08.851371 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:59:08.851371 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 11:59:08.851371 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 11:59:08.851371 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 11 11:59:08.851371 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 11 11:59:08.851371 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 11:59:08.851371 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 11:59:08.851371 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 11 11:59:08.851371 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 11:59:08.856355 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume db26dcde-cf70-49a7-9ebc-830f49a0889e could not be found. Jul 11 11:59:08.856355 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:59:08.856355 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:59:08.856355 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:59:08.856355 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:59:08.856355 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:59:08.856355 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:59:08.856355 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 11:59:08.856355 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 11:59:08.856355 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume db26dcde-cf70-49a7-9ebc-830f49a0889e could not be found. Jul 11 11:59:08.856355 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:59:08.856355 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-61189711-4d6b-492a-afcc-723002ff871c tempest-VolumesNegativeTest-526487006 tempest-VolumesNegativeTest-526487006-project] Returning 404 to user: Volume db26dcde-cf70-49a7-9ebc-830f49a0889e could not be found. {{(pid=118322) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 11:59:08.856355 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-61189711-4d6b-492a-afcc-723002ff871c tempest-VolumesNegativeTest-526487006 tempest-VolumesNegativeTest-526487006-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/db26dcde-cf70-49a7-9ebc-830f49a0889e" status: 404 len: 109 microversion: 2.1 time: 0.055099 Jul 11 11:59:08.856355 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1492/2979] 10.222.0.26 () {58 vars in 1244 bytes} [Mon Jul 11 11:59:08 2022] GET /compute/v2.1/os-volumes/db26dcde-cf70-49a7-9ebc-830f49a0889e => generated 109 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 11:59:09.455084 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [req-bddba430-36d6-43d2-a1ca-424436035ab4 req-6314fb36-96f7-494a-b77e-8935934e6ee8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21831efc-9278-477a-b760-33d7830c9423", "name": "network-vif-deleted", "tag": "b228f83d-5440-4b26-bfcb-f1dd9dfc209f"}]} {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:59:09.463297 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [req-bddba430-36d6-43d2-a1ca-424436035ab4 req-6314fb36-96f7-494a-b77e-8935934e6ee8 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:59:09.463911 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [req-bddba430-36d6-43d2-a1ca-424436035ab4 req-6314fb36-96f7-494a-b77e-8935934e6ee8 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:59:09.484463 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.compute.server_external_events [req-bddba430-36d6-43d2-a1ca-424436035ab4 req-6314fb36-96f7-494a-b77e-8935934e6ee8 service nova] Creating event network-vif-deleted:b228f83d-5440-4b26-bfcb-f1dd9dfc209f for instance 21831efc-9278-477a-b760-33d7830c9423 on hv-cinder-84842 Jul 11 11:59:09.484463 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [req-bddba430-36d6-43d2-a1ca-424436035ab4 req-6314fb36-96f7-494a-b77e-8935934e6ee8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.169137 Jul 11 11:59:09.484463 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1488/2980] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 11:59:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:59:19.033091 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 11:59:19.033596 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Mon Jul 11 11:59:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 11:59:20.015229 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-a2af3cc0-1543-43a3-b9ad-d31179b2ab84 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:59:20.019777 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-a2af3cc0-1543-43a3-b9ad-d31179b2ab84 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:59:20.021918 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a2af3cc0-1543-43a3-b9ad-d31179b2ab84 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:59:20.022399 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a2af3cc0-1543-43a3-b9ad-d31179b2ab84 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:59:20.023163 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a2af3cc0-1543-43a3-b9ad-d31179b2ab84 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:59:20.023636 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a2af3cc0-1543-43a3-b9ad-d31179b2ab84 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:59:20.036467 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.wsgi [None req-a2af3cc0-1543-43a3-b9ad-d31179b2ab84 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] HTTP exception thrown: Instance 3ae01e39-7148-4e87-9ae0-a95832b38101 could not be found. Jul 11 11:59:20.038008 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-a2af3cc0-1543-43a3-b9ad-d31179b2ab84 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Request method failure captured: Jul 11 11:59:20.038008 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: request: DELETE /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 HTTP/1.1 Jul 11 11:59:20.038008 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Accept: application/json Jul 11 11:59:20.038008 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Accept-Encoding: identity Jul 11 11:59:20.038008 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Connection: close Jul 11 11:59:20.038008 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Content-Length: 0 Jul 11 11:59:20.038008 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Content-Type: application/json Jul 11 11:59:20.038008 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Host: 10.222.0.26 Jul 11 11:59:20.038008 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Openstack-System-Scope: None Jul 11 11:59:20.038008 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: User-Agent: python-urllib3/1.26.9 Jul 11 11:59:20.038008 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Auth-Token: gAAAAABizAjKhZCKBRh_2i_ADibIvclpyQsJlC0Pm2ZTkb1jefgGS4P1r24evggFjxf1wK4Yv07Vbp7P1Zyv4wsuAQZPiSvMMxoEP8Q4ky7m10lr9iMNQTD4S9hixFXxSjWxJNmm7W7ummIraXw3SPwDOPKNnCr7rjbMh-sv9HcW6WLSiPnZrFU Jul 11 11:59:20.038008 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Domain-Id: None Jul 11 11:59:20.038008 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Domain-Name: None Jul 11 11:59:20.038008 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Identity-Status: Confirmed Jul 11 11:59:20.038008 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Is-Admin-Project: True Jul 11 11:59:20.038008 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Domain-Id: default Jul 11 11:59:20.038008 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Domain-Name: Default Jul 11 11:59:20.038008 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Id: 1328a510264f4374baabad7b5243d8c2 Jul 11 11:59:20.038008 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Name: tempest-AttachVolumeNegativeTest-1544092161 Jul 11 11:59:20.038008 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Role: member,reader Jul 11 11:59:20.038008 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Roles: member,reader Jul 11 11:59:20.039990 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1328a510264f4374baabad7b5243d8c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1328a510264f4374baabad7b5243d8c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1328a510264f4374baabad7b5243d8c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1328a510264f4374baabad7b5243d8c2"}]}] Jul 11 11:59:20.039990 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Tenant: tempest-AttachVolumeNegativeTest-1544092161 Jul 11 11:59:20.039990 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Tenant-Id: 1328a510264f4374baabad7b5243d8c2 Jul 11 11:59:20.039990 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1544092161 Jul 11 11:59:20.039990 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User: tempest-AttachVolumeNegativeTest-1544092161-project Jul 11 11:59:20.039990 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Domain-Id: default Jul 11 11:59:20.039990 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Domain-Name: Default Jul 11 11:59:20.039990 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Id: cbcc15c786fb43669ac34a4897735c1d Jul 11 11:59:20.039990 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Name: tempest-AttachVolumeNegativeTest-1544092161-project Jul 11 11:59:20.039990 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: method: > Jul 11 11:59:20.039990 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: exception: Instance 3ae01e39-7148-4e87-9ae0-a95832b38101 could not be found. Jul 11 11:59:20.039990 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: action_args: {'id': '3ae01e39-7148-4e87-9ae0-a95832b38101'} Jul 11 11:59:20.042037 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 11:59:20.042037 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:59:20.042037 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 11:59:20.042037 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 11:59:20.042037 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 11:59:20.042037 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 11:59:20.042037 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 11:59:20.042037 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 11:59:20.042037 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 11:59:20.042037 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 11:59:20.042037 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ae01e39-7148-4e87-9ae0-a95832b38101 could not be found. Jul 11 11:59:20.042037 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:59:20.042037 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:59:20.042037 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:59:20.042037 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:59:20.042037 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:59:20.042037 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:59:20.042037 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 11:59:20.042037 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 11:59:20.042037 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 11:59:20.048463 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 11:59:20.048463 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 11 11:59:20.048463 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 11 11:59:20.048463 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 11 11:59:20.048463 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 11 11:59:20.048463 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 11:59:20.048463 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 11:59:20.048463 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 11:59:20.048463 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 11:59:20.048463 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ae01e39-7148-4e87-9ae0-a95832b38101 could not be found. Jul 11 11:59:20.048463 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:59:20.048463 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:59:20.048463 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:59:20.048463 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:59:20.048463 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:59:20.048463 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:59:20.048463 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 11:59:20.048463 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 11:59:20.048463 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ae01e39-7148-4e87-9ae0-a95832b38101 could not be found. Jul 11 11:59:20.048463 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:59:20.050353 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-a2af3cc0-1543-43a3-b9ad-d31179b2ab84 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Returning 404 to user: Instance 3ae01e39-7148-4e87-9ae0-a95832b38101 could not be found. {{(pid=118322) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 11:59:20.050353 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-a2af3cc0-1543-43a3-b9ad-d31179b2ab84 tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 404 len: 111 microversion: 2.1 time: 0.029561 Jul 11 11:59:20.050353 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1493/2981] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 11 11:59:20 2022] DELETE /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 11:59:20.052449 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_api:SELECT=2 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:59:20.053193 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=2 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:59:20.057677 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-3c97b16e-5951-4449-b09d-9e1fd49198ab tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:59:20.058387 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-3c97b16e-5951-4449-b09d-9e1fd49198ab tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] [instance: 3ae01e39-7148-4e87-9ae0-a95832b38101] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:59:20.064366 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3c97b16e-5951-4449-b09d-9e1fd49198ab tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:59:20.064808 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3c97b16e-5951-4449-b09d-9e1fd49198ab tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:59:20.065556 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3c97b16e-5951-4449-b09d-9e1fd49198ab tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:59:20.065986 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3c97b16e-5951-4449-b09d-9e1fd49198ab tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:59:20.079475 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.wsgi [None req-3c97b16e-5951-4449-b09d-9e1fd49198ab tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] HTTP exception thrown: Instance 3ae01e39-7148-4e87-9ae0-a95832b38101 could not be found. Jul 11 11:59:20.081148 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-3c97b16e-5951-4449-b09d-9e1fd49198ab tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Request method failure captured: Jul 11 11:59:20.081148 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: request: GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 HTTP/1.1 Jul 11 11:59:20.081148 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Accept: application/json Jul 11 11:59:20.081148 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Accept-Encoding: identity Jul 11 11:59:20.081148 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Connection: close Jul 11 11:59:20.081148 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Content-Length: 0 Jul 11 11:59:20.081148 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Content-Type: application/json Jul 11 11:59:20.081148 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Host: 10.222.0.26 Jul 11 11:59:20.081148 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Openstack-System-Scope: None Jul 11 11:59:20.081148 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: User-Agent: python-urllib3/1.26.9 Jul 11 11:59:20.081148 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Auth-Token: gAAAAABizAjKhZCKBRh_2i_ADibIvclpyQsJlC0Pm2ZTkb1jefgGS4P1r24evggFjxf1wK4Yv07Vbp7P1Zyv4wsuAQZPiSvMMxoEP8Q4ky7m10lr9iMNQTD4S9hixFXxSjWxJNmm7W7ummIraXw3SPwDOPKNnCr7rjbMh-sv9HcW6WLSiPnZrFU Jul 11 11:59:20.081148 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Domain-Id: None Jul 11 11:59:20.081148 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Domain-Name: None Jul 11 11:59:20.081148 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Identity-Status: Confirmed Jul 11 11:59:20.081148 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Is-Admin-Project: True Jul 11 11:59:20.081148 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Domain-Id: default Jul 11 11:59:20.081148 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Domain-Name: Default Jul 11 11:59:20.081148 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Id: 1328a510264f4374baabad7b5243d8c2 Jul 11 11:59:20.081148 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Name: tempest-AttachVolumeNegativeTest-1544092161 Jul 11 11:59:20.081148 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Role: member,reader Jul 11 11:59:20.081148 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Roles: member,reader Jul 11 11:59:20.082980 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1328a510264f4374baabad7b5243d8c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1328a510264f4374baabad7b5243d8c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1328a510264f4374baabad7b5243d8c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1328a510264f4374baabad7b5243d8c2"}]}] Jul 11 11:59:20.082980 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Tenant: tempest-AttachVolumeNegativeTest-1544092161 Jul 11 11:59:20.082980 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Tenant-Id: 1328a510264f4374baabad7b5243d8c2 Jul 11 11:59:20.082980 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1544092161 Jul 11 11:59:20.082980 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User: tempest-AttachVolumeNegativeTest-1544092161-project Jul 11 11:59:20.082980 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Domain-Id: default Jul 11 11:59:20.082980 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Domain-Name: Default Jul 11 11:59:20.082980 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Id: cbcc15c786fb43669ac34a4897735c1d Jul 11 11:59:20.082980 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Name: tempest-AttachVolumeNegativeTest-1544092161-project Jul 11 11:59:20.082980 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: method: > Jul 11 11:59:20.082980 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: exception: Instance 3ae01e39-7148-4e87-9ae0-a95832b38101 could not be found. Jul 11 11:59:20.082980 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: action_args: {'id': '3ae01e39-7148-4e87-9ae0-a95832b38101'} Jul 11 11:59:20.084090 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 11:59:20.084090 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:59:20.084090 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 11:59:20.084090 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 11:59:20.084090 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 11:59:20.084090 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 11:59:20.084090 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 11:59:20.084090 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 11:59:20.084090 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 11:59:20.084090 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 11:59:20.084090 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ae01e39-7148-4e87-9ae0-a95832b38101 could not be found. Jul 11 11:59:20.084090 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:59:20.084090 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:59:20.084090 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:59:20.084090 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:59:20.084090 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:59:20.084090 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:59:20.084090 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 11:59:20.084090 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 11:59:20.084090 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 11:59:20.085552 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 11:59:20.085552 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 11:59:20.085552 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 11:59:20.085552 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 11:59:20.085552 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 11:59:20.085552 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 11:59:20.085552 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 11:59:20.085552 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ae01e39-7148-4e87-9ae0-a95832b38101 could not be found. Jul 11 11:59:20.085552 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:59:20.085552 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:59:20.085552 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:59:20.085552 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:59:20.085552 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:59:20.085552 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:59:20.085552 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 11:59:20.085552 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 11:59:20.085552 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ae01e39-7148-4e87-9ae0-a95832b38101 could not be found. Jul 11 11:59:20.085552 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 11:59:20.087091 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-3c97b16e-5951-4449-b09d-9e1fd49198ab tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] Returning 404 to user: Instance 3ae01e39-7148-4e87-9ae0-a95832b38101 could not be found. {{(pid=118321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 11:59:20.087091 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-3c97b16e-5951-4449-b09d-9e1fd49198ab tempest-AttachVolumeNegativeTest-1544092161 tempest-AttachVolumeNegativeTest-1544092161-project] 10.222.0.26 "GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101" status: 404 len: 111 microversion: 2.1 time: 0.031642 Jul 11 11:59:20.087091 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1489/2982] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:59:20 2022] GET /compute/v2.1/servers/3ae01e39-7148-4e87-9ae0-a95832b38101 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 11:59:21.964382 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 11:59:21.965035 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Mon Jul 11 11:59:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 11:59:27.068122 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-3d6ac799-87ae-47de-a55f-f7bdf0469ac5 tempest-VolumesGetTestJSON-1685080622 tempest-VolumesGetTestJSON-1685080622-project] Action: 'create', calling method: .version_select at 0x7fb01042a9d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-895972021", "metadata": {"Type": "work"}}} {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:59:27.859691 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-3d6ac799-87ae-47de-a55f-f7bdf0469ac5 tempest-VolumesGetTestJSON-1685080622 tempest-VolumesGetTestJSON-1685080622-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.930327 Jul 11 11:59:27.860425 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1494/2983] 10.222.0.26 () {60 vars in 1155 bytes} [Mon Jul 11 11:59:26 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 932 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 11 11:59:27.872349 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-854d9514-802e-4b76-a1a0-51bb77a957a1 tempest-VolumesGetTestJSON-1685080622 tempest-VolumesGetTestJSON-1685080622-project] Calling method '.version_select at 0x7fb01001b700>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:59:27.976985 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-854d9514-802e-4b76-a1a0-51bb77a957a1 tempest-VolumesGetTestJSON-1685080622 tempest-VolumesGetTestJSON-1685080622-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/a2d499c6-43fc-4b1c-b5a6-996d0877c44a" status: 200 len: 352 microversion: 2.1 time: 0.108526 Jul 11 11:59:27.977806 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1490/2984] 10.222.0.26 () {58 vars in 1244 bytes} [Mon Jul 11 11:59:27 2022] GET /compute/v2.1/os-volumes/a2d499c6-43fc-4b1c-b5a6-996d0877c44a => generated 352 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:59:28.990530 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-edfbb206-829e-479b-95f4-4ceeb4fa14e2 tempest-VolumesGetTestJSON-1685080622 tempest-VolumesGetTestJSON-1685080622-project] Calling method '.version_select at 0x7fb01007a8b0>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:59:29.051808 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-edfbb206-829e-479b-95f4-4ceeb4fa14e2 tempest-VolumesGetTestJSON-1685080622 tempest-VolumesGetTestJSON-1685080622-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/a2d499c6-43fc-4b1c-b5a6-996d0877c44a" status: 200 len: 353 microversion: 2.1 time: 0.064089 Jul 11 11:59:29.052548 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1495/2985] 10.222.0.26 () {58 vars in 1244 bytes} [Mon Jul 11 11:59:28 2022] GET /compute/v2.1/os-volumes/a2d499c6-43fc-4b1c-b5a6-996d0877c44a => generated 353 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:59:29.066101 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-5a40fa66-26f0-4f17-b494-ce3cb41a4d6a tempest-VolumesGetTestJSON-1685080622 tempest-VolumesGetTestJSON-1685080622-project] Calling method '.version_select at 0x7fb011802c10>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:59:29.117613 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-5a40fa66-26f0-4f17-b494-ce3cb41a4d6a tempest-VolumesGetTestJSON-1685080622 tempest-VolumesGetTestJSON-1685080622-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/a2d499c6-43fc-4b1c-b5a6-996d0877c44a" status: 200 len: 353 microversion: 2.1 time: 0.055341 Jul 11 11:59:29.118245 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1491/2986] 10.222.0.26 () {58 vars in 1244 bytes} [Mon Jul 11 11:59:29 2022] GET /compute/v2.1/os-volumes/a2d499c6-43fc-4b1c-b5a6-996d0877c44a => generated 353 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:59:29.135189 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-d143c539-17f2-4d14-b7a8-00c8c7d224d5 tempest-VolumesGetTestJSON-1685080622 tempest-VolumesGetTestJSON-1685080622-project] Calling method '.version_select at 0x7fb01009f0d0>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:59:29.376881 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-d143c539-17f2-4d14-b7a8-00c8c7d224d5 tempest-VolumesGetTestJSON-1685080622 tempest-VolumesGetTestJSON-1685080622-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/a2d499c6-43fc-4b1c-b5a6-996d0877c44a" status: 202 len: 0 microversion: 2.1 time: 0.246141 Jul 11 11:59:29.377534 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1496/2987] 10.222.0.26 () {58 vars in 1247 bytes} [Mon Jul 11 11:59:29 2022] DELETE /compute/v2.1/os-volumes/a2d499c6-43fc-4b1c-b5a6-996d0877c44a => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 11:59:29.385939 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-f73ff179-8730-4cac-bd7e-c3a82e599bdc tempest-VolumesGetTestJSON-1685080622 tempest-VolumesGetTestJSON-1685080622-project] Calling method '.version_select at 0x7fb010325e50>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:59:29.437664 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-f73ff179-8730-4cac-bd7e-c3a82e599bdc tempest-VolumesGetTestJSON-1685080622 tempest-VolumesGetTestJSON-1685080622-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/a2d499c6-43fc-4b1c-b5a6-996d0877c44a" status: 200 len: 352 microversion: 2.1 time: 0.056041 Jul 11 11:59:29.438254 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1492/2988] 10.222.0.26 () {58 vars in 1244 bytes} [Mon Jul 11 11:59:29 2022] GET /compute/v2.1/os-volumes/a2d499c6-43fc-4b1c-b5a6-996d0877c44a => generated 352 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:59:30.448354 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_api:SELECT=2 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:59:30.449714 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=2 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:59:30.453802 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-869348fb-d1b0-4fca-9fa7-566efb60a767 tempest-VolumesGetTestJSON-1685080622 tempest-VolumesGetTestJSON-1685080622-project] Calling method '.version_select at 0x7fb010331670>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:59:30.491739 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.wsgi [None req-869348fb-d1b0-4fca-9fa7-566efb60a767 tempest-VolumesGetTestJSON-1685080622 tempest-VolumesGetTestJSON-1685080622-project] HTTP exception thrown: Volume a2d499c6-43fc-4b1c-b5a6-996d0877c44a could not be found. Jul 11 11:59:30.495572 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-869348fb-d1b0-4fca-9fa7-566efb60a767 tempest-VolumesGetTestJSON-1685080622 tempest-VolumesGetTestJSON-1685080622-project] Request method failure captured: Jul 11 11:59:30.495572 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: request: GET /compute/v2.1/os-volumes/a2d499c6-43fc-4b1c-b5a6-996d0877c44a HTTP/1.1 Jul 11 11:59:30.495572 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Accept: application/json Jul 11 11:59:30.495572 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Accept-Encoding: identity Jul 11 11:59:30.495572 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Connection: close Jul 11 11:59:30.495572 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Content-Length: 0 Jul 11 11:59:30.495572 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Content-Type: application/json Jul 11 11:59:30.495572 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Host: 10.222.0.26 Jul 11 11:59:30.495572 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Openstack-System-Scope: None Jul 11 11:59:30.495572 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: User-Agent: python-urllib3/1.26.9 Jul 11 11:59:30.495572 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Auth-Token: gAAAAABizBCeqp1wmidgnDWPxadxML93MHldvZqY48M8l9ty7hJpUqNEad16zLz9AHR90B720WOy4LBLr8P5ICz2ChQ6-4XM4Y7nRleqHgx8vnw-Pbw6_D4vN1GGU2nV0Fx89-GsqRaosN6TvQUYZECOCFXZ59YWFX0NKsDrufbAEHcxdvnO4pA Jul 11 11:59:30.495572 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Domain-Id: None Jul 11 11:59:30.495572 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Domain-Name: None Jul 11 11:59:30.495572 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Identity-Status: Confirmed Jul 11 11:59:30.495572 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Is-Admin-Project: True Jul 11 11:59:30.495572 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Domain-Id: default Jul 11 11:59:30.495572 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Domain-Name: Default Jul 11 11:59:30.495572 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Id: 63924816a0c242ca943117f422a7d778 Jul 11 11:59:30.495572 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Name: tempest-VolumesGetTestJSON-1685080622 Jul 11 11:59:30.495572 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Role: member,reader Jul 11 11:59:30.495572 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Roles: member,reader Jul 11 11:59:30.497356 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_63924816a0c242ca943117f422a7d778"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/63924816a0c242ca943117f422a7d778"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/63924816a0c242ca943117f422a7d778"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/63924816a0c242ca943117f422a7d778"}]}] Jul 11 11:59:30.497356 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Tenant: tempest-VolumesGetTestJSON-1685080622 Jul 11 11:59:30.497356 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Tenant-Id: 63924816a0c242ca943117f422a7d778 Jul 11 11:59:30.497356 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Tenant-Name: tempest-VolumesGetTestJSON-1685080622 Jul 11 11:59:30.497356 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User: tempest-VolumesGetTestJSON-1685080622-project Jul 11 11:59:30.497356 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Domain-Id: default Jul 11 11:59:30.497356 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Domain-Name: Default Jul 11 11:59:30.497356 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Id: 9064cd21f64d4110974d69b4ea94e58f Jul 11 11:59:30.497356 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Name: tempest-VolumesGetTestJSON-1685080622-project Jul 11 11:59:30.497356 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: method: Jul 11 11:59:30.497356 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: exception: Volume a2d499c6-43fc-4b1c-b5a6-996d0877c44a could not be found. Jul 11 11:59:30.497356 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: action_args: {'id': 'a2d499c6-43fc-4b1c-b5a6-996d0877c44a'} Jul 11 11:59:30.497356 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 11:59:30.498497 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:59:30.498497 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 11 11:59:30.498497 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 11 11:59:30.498497 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 11 11:59:30.498497 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 11 11:59:30.498497 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 11 11:59:30.498497 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 11 11:59:30.498497 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 11 11:59:30.498497 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 11 11:59:30.498497 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 11 11:59:30.498497 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 11 11:59:30.498497 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 11:59:30.498497 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 11:59:30.498497 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 11:59:30.498497 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 11:59:30.498497 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a2d499c6-43fc-4b1c-b5a6-996d0877c44a could not be found. (HTTP 404) (Request-ID: req-de765626-af17-44cd-9f16-15562d5476a2) Jul 11 11:59:30.498497 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:59:30.498497 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:59:30.498497 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:59:30.500336 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:59:30.500336 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 11 11:59:30.500336 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 11 11:59:30.500336 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 11 11:59:30.500336 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 11 11:59:30.500336 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 11 11:59:30.500336 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 11 11:59:30.500336 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 11 11:59:30.500336 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 11 11:59:30.500336 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 11 11:59:30.500336 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 11 11:59:30.500336 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 11 11:59:30.500336 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 11 11:59:30.500336 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 11 11:59:30.500336 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 11 11:59:30.500336 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 11 11:59:30.500336 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 11 11:59:30.500336 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 11 11:59:30.500336 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 11 11:59:30.503205 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 11:59:30.503205 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 11:59:30.503205 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 11:59:30.503205 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 11:59:30.503205 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a2d499c6-43fc-4b1c-b5a6-996d0877c44a could not be found. Jul 11 11:59:30.503205 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:59:30.503205 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:59:30.503205 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:59:30.503205 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:59:30.503205 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:59:30.503205 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:59:30.503205 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 11:59:30.503205 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 11:59:30.503205 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 11 11:59:30.503205 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 11 11:59:30.503205 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 11:59:30.503205 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 11:59:30.503205 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 11 11:59:30.503205 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 11:59:30.504668 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a2d499c6-43fc-4b1c-b5a6-996d0877c44a could not be found. Jul 11 11:59:30.504668 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:59:30.504668 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 11:59:30.504668 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:59:30.504668 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 11:59:30.504668 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 11:59:30.504668 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 11:59:30.504668 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 11:59:30.504668 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 11:59:30.504668 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a2d499c6-43fc-4b1c-b5a6-996d0877c44a could not be found. Jul 11 11:59:30.504668 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 11:59:30.504668 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-869348fb-d1b0-4fca-9fa7-566efb60a767 tempest-VolumesGetTestJSON-1685080622 tempest-VolumesGetTestJSON-1685080622-project] Returning 404 to user: Volume a2d499c6-43fc-4b1c-b5a6-996d0877c44a could not be found. {{(pid=118322) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 11:59:30.504668 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-869348fb-d1b0-4fca-9fa7-566efb60a767 tempest-VolumesGetTestJSON-1685080622 tempest-VolumesGetTestJSON-1685080622-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/a2d499c6-43fc-4b1c-b5a6-996d0877c44a" status: 404 len: 109 microversion: 2.1 time: 0.055129 Jul 11 11:59:30.504668 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1497/2989] 10.222.0.26 () {58 vars in 1244 bytes} [Mon Jul 11 11:59:30 2022] GET /compute/v2.1/os-volumes/a2d499c6-43fc-4b1c-b5a6-996d0877c44a => generated 109 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 11:59:35.053530 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 11:59:35.054178 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Mon Jul 11 11:59:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 11:59:38.996859 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_api:SELECT=2 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:59:38.997682 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=2 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:59:39.001654 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-74780eb9-1bdf-4f23-a015-3e1f091c9cac tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-958146911", "imageRef": "1bb93fc1-b713-4e67-8f76-bfec3a96168b", "flavorRef": "452"}} {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:59:39.052694 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.network.neutron [None req-74780eb9-1bdf-4f23-a015-3e1f091c9cac tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] validate_networks() for None {{(pid=118321) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 11:59:39.346068 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.virt.hardware [None req-74780eb9-1bdf-4f23-a015-3e1f091c9cac tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Flavor limits 0:0:0 {{(pid=118321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 11:59:39.346362 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.virt.hardware [None req-74780eb9-1bdf-4f23-a015-3e1f091c9cac tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Image limits 0:0:0 {{(pid=118321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 11:59:39.346837 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.virt.hardware [None req-74780eb9-1bdf-4f23-a015-3e1f091c9cac tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Flavor pref 0:0:0 {{(pid=118321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 11:59:39.347273 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.virt.hardware [None req-74780eb9-1bdf-4f23-a015-3e1f091c9cac tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Image pref 0:0:0 {{(pid=118321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 11:59:39.347683 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.virt.hardware [None req-74780eb9-1bdf-4f23-a015-3e1f091c9cac tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 11:59:39.356718 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-74780eb9-1bdf-4f23-a015-3e1f091c9cac tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:59:39.357162 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-74780eb9-1bdf-4f23-a015-3e1f091c9cac tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:59:39.357954 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-74780eb9-1bdf-4f23-a015-3e1f091c9cac tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:59:39.358388 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-74780eb9-1bdf-4f23-a015-3e1f091c9cac tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:59:39.375423 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.quota [None req-74780eb9-1bdf-4f23-a015-3e1f091c9cac tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Getting quotas for project 0507d00afdc046a8bc4d1bd0fda1eb7b. Resources: {'cores', 'ram', 'instances'} {{(pid=118321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 11:59:39.379375 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.quota [None req-74780eb9-1bdf-4f23-a015-3e1f091c9cac tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Getting quotas for user 431134cb94bd448cb6413da52ac4ed48 and project 0507d00afdc046a8bc4d1bd0fda1eb7b. Resources: {'cores', 'ram', 'instances'} {{(pid=118321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 11:59:39.390780 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-74780eb9-1bdf-4f23-a015-3e1f091c9cac tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Going to run 1 instances... {{(pid=118321) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 11:59:39.393048 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-74780eb9-1bdf-4f23-a015-3e1f091c9cac tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] [instance: 68f705d9-36c1-483f-bb38-7e1749b61677] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1bb93fc1-b713-4e67-8f76-bfec3a96168b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118321) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 11:59:39.515857 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-74780eb9-1bdf-4f23-a015-3e1f091c9cac tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.520290 Jul 11 11:59:39.516609 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1493/2990] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jul 11 11:59:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 522 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 11 11:59:39.528838 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-ad8ad99b-9b74-4892-b763-671e77a4cfb2 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:59:39.529574 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-ad8ad99b-9b74-4892-b763-671e77a4cfb2 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] [instance: 68f705d9-36c1-483f-bb38-7e1749b61677] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:59:39.596719 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-ad8ad99b-9b74-4892-b763-671e77a4cfb2 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431134cb94bd448cb6413da52ac4ed48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0507d00afdc046a8bc4d1bd0fda1eb7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:59:39.604097 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-ad8ad99b-9b74-4892-b763-671e77a4cfb2 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] 10.222.0.26 "GET /compute/v2.1/servers/68f705d9-36c1-483f-bb38-7e1749b61677" status: 200 len: 1214 microversion: 2.1 time: 0.081189 Jul 11 11:59:39.605145 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1498/2991] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:59:39 2022] GET /compute/v2.1/servers/68f705d9-36c1-483f-bb38-7e1749b61677 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:59:40.622292 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-6ccf175b-0728-4cf0-b45b-e75681dffa63 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:59:40.622825 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-6ccf175b-0728-4cf0-b45b-e75681dffa63 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] [instance: 68f705d9-36c1-483f-bb38-7e1749b61677] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:59:40.684875 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-6ccf175b-0728-4cf0-b45b-e75681dffa63 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431134cb94bd448cb6413da52ac4ed48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0507d00afdc046a8bc4d1bd0fda1eb7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:59:40.688295 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-6ccf175b-0728-4cf0-b45b-e75681dffa63 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] 10.222.0.26 "GET /compute/v2.1/servers/68f705d9-36c1-483f-bb38-7e1749b61677" status: 200 len: 1214 microversion: 2.1 time: 0.070953 Jul 11 11:59:40.688955 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1494/2992] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:59:40 2022] GET /compute/v2.1/servers/68f705d9-36c1-483f-bb38-7e1749b61677 => generated 1214 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:59:41.705910 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-a317a0ec-5cbc-4cfc-9e22-db88295f886f tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:59:41.706549 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-a317a0ec-5cbc-4cfc-9e22-db88295f886f tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] [instance: 68f705d9-36c1-483f-bb38-7e1749b61677] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:59:41.713829 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a317a0ec-5cbc-4cfc-9e22-db88295f886f tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:59:41.714283 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a317a0ec-5cbc-4cfc-9e22-db88295f886f tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:59:41.715053 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a317a0ec-5cbc-4cfc-9e22-db88295f886f tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:59:41.715513 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a317a0ec-5cbc-4cfc-9e22-db88295f886f tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:59:41.784662 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-a317a0ec-5cbc-4cfc-9e22-db88295f886f tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431134cb94bd448cb6413da52ac4ed48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0507d00afdc046a8bc4d1bd0fda1eb7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:59:41.787185 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-a317a0ec-5cbc-4cfc-9e22-db88295f886f tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] 10.222.0.26 "GET /compute/v2.1/servers/68f705d9-36c1-483f-bb38-7e1749b61677" status: 200 len: 1210 microversion: 2.1 time: 0.085312 Jul 11 11:59:41.787794 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1499/2993] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:59:41 2022] GET /compute/v2.1/servers/68f705d9-36c1-483f-bb38-7e1749b61677 => generated 1210 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:59:42.806163 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-b3ecc60a-73e4-44b4-ad85-63f009c8c956 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:59:42.806800 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-b3ecc60a-73e4-44b4-ad85-63f009c8c956 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] [instance: 68f705d9-36c1-483f-bb38-7e1749b61677] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:59:42.815156 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b3ecc60a-73e4-44b4-ad85-63f009c8c956 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:59:42.815720 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b3ecc60a-73e4-44b4-ad85-63f009c8c956 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:59:42.816557 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b3ecc60a-73e4-44b4-ad85-63f009c8c956 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:59:42.816994 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b3ecc60a-73e4-44b4-ad85-63f009c8c956 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:59:42.879929 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-b3ecc60a-73e4-44b4-ad85-63f009c8c956 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431134cb94bd448cb6413da52ac4ed48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0507d00afdc046a8bc4d1bd0fda1eb7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:59:42.887884 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-b3ecc60a-73e4-44b4-ad85-63f009c8c956 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] 10.222.0.26 "GET /compute/v2.1/servers/68f705d9-36c1-483f-bb38-7e1749b61677" status: 200 len: 1266 microversion: 2.1 time: 0.087451 Jul 11 11:59:42.888448 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1495/2994] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:59:42 2022] GET /compute/v2.1/servers/68f705d9-36c1-483f-bb38-7e1749b61677 => generated 1266 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:59:43.690619 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 11:59:43.690844 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Mon Jul 11 11:59:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 11:59:43.904525 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-3585da1e-4bfd-49f1-9475-68f8c8edd4ff tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:59:43.905872 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-3585da1e-4bfd-49f1-9475-68f8c8edd4ff tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] [instance: 68f705d9-36c1-483f-bb38-7e1749b61677] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:59:43.912578 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3585da1e-4bfd-49f1-9475-68f8c8edd4ff tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:59:43.913114 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3585da1e-4bfd-49f1-9475-68f8c8edd4ff tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:59:43.913933 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3585da1e-4bfd-49f1-9475-68f8c8edd4ff tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:59:43.914457 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3585da1e-4bfd-49f1-9475-68f8c8edd4ff tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:59:43.976699 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-3585da1e-4bfd-49f1-9475-68f8c8edd4ff tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431134cb94bd448cb6413da52ac4ed48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0507d00afdc046a8bc4d1bd0fda1eb7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:59:43.984689 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-3585da1e-4bfd-49f1-9475-68f8c8edd4ff tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] 10.222.0.26 "GET /compute/v2.1/servers/68f705d9-36c1-483f-bb38-7e1749b61677" status: 200 len: 1266 microversion: 2.1 time: 0.084108 Jul 11 11:59:43.985249 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1500/2995] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:59:43 2022] GET /compute/v2.1/servers/68f705d9-36c1-483f-bb38-7e1749b61677 => generated 1266 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:59:45.001979 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-2abe7266-6ac4-4ea4-b49d-941c7e732c96 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:59:45.002615 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-2abe7266-6ac4-4ea4-b49d-941c7e732c96 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] [instance: 68f705d9-36c1-483f-bb38-7e1749b61677] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:59:45.009976 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2abe7266-6ac4-4ea4-b49d-941c7e732c96 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:59:45.010421 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2abe7266-6ac4-4ea4-b49d-941c7e732c96 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:59:45.011400 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2abe7266-6ac4-4ea4-b49d-941c7e732c96 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:59:45.012035 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2abe7266-6ac4-4ea4-b49d-941c7e732c96 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:59:45.106042 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-2abe7266-6ac4-4ea4-b49d-941c7e732c96 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431134cb94bd448cb6413da52ac4ed48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0507d00afdc046a8bc4d1bd0fda1eb7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:59:45.113845 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-2abe7266-6ac4-4ea4-b49d-941c7e732c96 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] 10.222.0.26 "GET /compute/v2.1/servers/68f705d9-36c1-483f-bb38-7e1749b61677" status: 200 len: 1274 microversion: 2.1 time: 0.115669 Jul 11 11:59:45.114414 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1496/2996] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:59:44 2022] GET /compute/v2.1/servers/68f705d9-36c1-483f-bb38-7e1749b61677 => generated 1274 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:59:46.134386 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-5bf824ff-57e0-4558-9e9d-032e0f7af906 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:59:46.135826 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-5bf824ff-57e0-4558-9e9d-032e0f7af906 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] [instance: 68f705d9-36c1-483f-bb38-7e1749b61677] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:59:46.147753 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5bf824ff-57e0-4558-9e9d-032e0f7af906 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:59:46.152544 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5bf824ff-57e0-4558-9e9d-032e0f7af906 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:59:46.152544 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5bf824ff-57e0-4558-9e9d-032e0f7af906 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:59:46.152544 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5bf824ff-57e0-4558-9e9d-032e0f7af906 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:59:46.402429 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-5bf824ff-57e0-4558-9e9d-032e0f7af906 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431134cb94bd448cb6413da52ac4ed48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0507d00afdc046a8bc4d1bd0fda1eb7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:59:46.418263 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-5bf824ff-57e0-4558-9e9d-032e0f7af906 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] 10.222.0.26 "GET /compute/v2.1/servers/68f705d9-36c1-483f-bb38-7e1749b61677" status: 200 len: 1314 microversion: 2.1 time: 0.286222 Jul 11 11:59:46.432248 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1501/2997] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:59:46 2022] GET /compute/v2.1/servers/68f705d9-36c1-483f-bb38-7e1749b61677 => generated 1314 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:59:47.025751 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [req-ae398b6f-30d9-4388-97b2-f78c01fd93ed req-edade806-a3af-4bcc-b3ad-7de5e6085221 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68f705d9-36c1-483f-bb38-7e1749b61677", "tag": "3a37fda0-5187-4d77-9d12-68b5fd6c58d0"}]} {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:59:47.034791 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [req-ae398b6f-30d9-4388-97b2-f78c01fd93ed req-edade806-a3af-4bcc-b3ad-7de5e6085221 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:59:47.035273 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [req-ae398b6f-30d9-4388-97b2-f78c01fd93ed req-edade806-a3af-4bcc-b3ad-7de5e6085221 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:59:47.048831 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.compute.server_external_events [req-ae398b6f-30d9-4388-97b2-f78c01fd93ed req-edade806-a3af-4bcc-b3ad-7de5e6085221 service nova] Creating event network-changed:3a37fda0-5187-4d77-9d12-68b5fd6c58d0 for instance 68f705d9-36c1-483f-bb38-7e1749b61677 on hv-cinder-84842 Jul 11 11:59:47.053740 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [req-ae398b6f-30d9-4388-97b2-f78c01fd93ed req-edade806-a3af-4bcc-b3ad-7de5e6085221 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031912 Jul 11 11:59:47.054343 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1497/2998] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 11:59:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:59:47.437488 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-3727d725-4573-4de3-8fb6-de103d098632 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:59:47.438098 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-3727d725-4573-4de3-8fb6-de103d098632 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] [instance: 68f705d9-36c1-483f-bb38-7e1749b61677] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:59:47.444513 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3727d725-4573-4de3-8fb6-de103d098632 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:59:47.444959 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3727d725-4573-4de3-8fb6-de103d098632 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:59:47.445705 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3727d725-4573-4de3-8fb6-de103d098632 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:59:47.446401 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3727d725-4573-4de3-8fb6-de103d098632 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:59:47.602011 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-3727d725-4573-4de3-8fb6-de103d098632 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431134cb94bd448cb6413da52ac4ed48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0507d00afdc046a8bc4d1bd0fda1eb7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:59:47.609347 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-3727d725-4573-4de3-8fb6-de103d098632 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] 10.222.0.26 "GET /compute/v2.1/servers/68f705d9-36c1-483f-bb38-7e1749b61677" status: 200 len: 1314 microversion: 2.1 time: 0.175809 Jul 11 11:59:47.609917 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1502/2999] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:59:47 2022] GET /compute/v2.1/servers/68f705d9-36c1-483f-bb38-7e1749b61677 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:59:48.628115 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-9d0e17c2-1961-471a-ab7d-26772c21def9 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:59:48.628945 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-9d0e17c2-1961-471a-ab7d-26772c21def9 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] [instance: 68f705d9-36c1-483f-bb38-7e1749b61677] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:59:48.636137 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9d0e17c2-1961-471a-ab7d-26772c21def9 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:59:48.636580 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9d0e17c2-1961-471a-ab7d-26772c21def9 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:59:48.637333 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9d0e17c2-1961-471a-ab7d-26772c21def9 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:59:48.637936 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-9d0e17c2-1961-471a-ab7d-26772c21def9 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:59:48.798730 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-9d0e17c2-1961-471a-ab7d-26772c21def9 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431134cb94bd448cb6413da52ac4ed48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0507d00afdc046a8bc4d1bd0fda1eb7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:59:48.806393 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-9d0e17c2-1961-471a-ab7d-26772c21def9 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] 10.222.0.26 "GET /compute/v2.1/servers/68f705d9-36c1-483f-bb38-7e1749b61677" status: 200 len: 1314 microversion: 2.1 time: 0.183007 Jul 11 11:59:48.815578 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1498/3000] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:59:48 2022] GET /compute/v2.1/servers/68f705d9-36c1-483f-bb38-7e1749b61677 => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:59:49.823866 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-ba120fcc-311a-440d-b4b1-7249bdd0364c tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:59:49.824534 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-ba120fcc-311a-440d-b4b1-7249bdd0364c tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] [instance: 68f705d9-36c1-483f-bb38-7e1749b61677] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:59:49.826693 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell0:SELECT=2 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:59:49.831662 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ba120fcc-311a-440d-b4b1-7249bdd0364c tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:59:49.832169 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ba120fcc-311a-440d-b4b1-7249bdd0364c tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:59:49.832920 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ba120fcc-311a-440d-b4b1-7249bdd0364c tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:59:49.833424 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ba120fcc-311a-440d-b4b1-7249bdd0364c tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:59:49.971717 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-ba120fcc-311a-440d-b4b1-7249bdd0364c tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431134cb94bd448cb6413da52ac4ed48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0507d00afdc046a8bc4d1bd0fda1eb7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:59:49.979878 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-ba120fcc-311a-440d-b4b1-7249bdd0364c tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] 10.222.0.26 "GET /compute/v2.1/servers/68f705d9-36c1-483f-bb38-7e1749b61677" status: 200 len: 1314 microversion: 2.1 time: 0.161018 Jul 11 11:59:49.980448 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1503/3001] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:59:49 2022] GET /compute/v2.1/servers/68f705d9-36c1-483f-bb38-7e1749b61677 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:59:51.000845 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-b958aba4-a01c-477a-83ed-eec00f9c94c7 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:59:51.001586 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-b958aba4-a01c-477a-83ed-eec00f9c94c7 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] [instance: 68f705d9-36c1-483f-bb38-7e1749b61677] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:59:51.007520 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell0:SELECT=2 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:59:51.010930 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell0:SELECT=8 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:59:51.012771 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b958aba4-a01c-477a-83ed-eec00f9c94c7 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:59:51.013676 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b958aba4-a01c-477a-83ed-eec00f9c94c7 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:59:51.014491 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b958aba4-a01c-477a-83ed-eec00f9c94c7 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:59:51.015171 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b958aba4-a01c-477a-83ed-eec00f9c94c7 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:59:51.208443 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-b958aba4-a01c-477a-83ed-eec00f9c94c7 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431134cb94bd448cb6413da52ac4ed48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0507d00afdc046a8bc4d1bd0fda1eb7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:59:51.220772 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-b958aba4-a01c-477a-83ed-eec00f9c94c7 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] 10.222.0.26 "GET /compute/v2.1/servers/68f705d9-36c1-483f-bb38-7e1749b61677" status: 200 len: 1314 microversion: 2.1 time: 0.223651 Jul 11 11:59:51.222633 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1499/3002] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:59:50 2022] GET /compute/v2.1/servers/68f705d9-36c1-483f-bb38-7e1749b61677 => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:59:52.243523 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-97467003-fbe0-41dc-b525-af0b186b941a tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:59:52.266737 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-97467003-fbe0-41dc-b525-af0b186b941a tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] [instance: 68f705d9-36c1-483f-bb38-7e1749b61677] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:59:52.266737 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-97467003-fbe0-41dc-b525-af0b186b941a tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:59:52.266737 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-97467003-fbe0-41dc-b525-af0b186b941a tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:59:52.266737 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-97467003-fbe0-41dc-b525-af0b186b941a tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:59:52.267639 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-97467003-fbe0-41dc-b525-af0b186b941a tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:59:52.440566 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-97467003-fbe0-41dc-b525-af0b186b941a tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431134cb94bd448cb6413da52ac4ed48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0507d00afdc046a8bc4d1bd0fda1eb7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:59:52.453410 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-97467003-fbe0-41dc-b525-af0b186b941a tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] 10.222.0.26 "GET /compute/v2.1/servers/68f705d9-36c1-483f-bb38-7e1749b61677" status: 200 len: 1314 microversion: 2.1 time: 0.214770 Jul 11 11:59:52.455648 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1504/3003] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:59:52 2022] GET /compute/v2.1/servers/68f705d9-36c1-483f-bb38-7e1749b61677 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:59:53.472255 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-7d1e4dce-4216-4909-a328-33f1cb5c5220 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:59:53.474550 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-7d1e4dce-4216-4909-a328-33f1cb5c5220 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] [instance: 68f705d9-36c1-483f-bb38-7e1749b61677] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:59:53.488046 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7d1e4dce-4216-4909-a328-33f1cb5c5220 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:59:53.489676 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7d1e4dce-4216-4909-a328-33f1cb5c5220 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:59:53.494070 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7d1e4dce-4216-4909-a328-33f1cb5c5220 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:59:53.494862 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7d1e4dce-4216-4909-a328-33f1cb5c5220 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:59:53.784545 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-7d1e4dce-4216-4909-a328-33f1cb5c5220 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431134cb94bd448cb6413da52ac4ed48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0507d00afdc046a8bc4d1bd0fda1eb7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:59:53.792475 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-7d1e4dce-4216-4909-a328-33f1cb5c5220 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] 10.222.0.26 "GET /compute/v2.1/servers/68f705d9-36c1-483f-bb38-7e1749b61677" status: 200 len: 1314 microversion: 2.1 time: 0.324760 Jul 11 11:59:53.793045 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1500/3004] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:59:53 2022] GET /compute/v2.1/servers/68f705d9-36c1-483f-bb38-7e1749b61677 => generated 1314 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:59:54.811090 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-b2a624f5-0e26-4164-8d60-6e89365dcf96 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:59:54.812188 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-b2a624f5-0e26-4164-8d60-6e89365dcf96 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] [instance: 68f705d9-36c1-483f-bb38-7e1749b61677] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:59:54.819136 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b2a624f5-0e26-4164-8d60-6e89365dcf96 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:59:54.819638 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b2a624f5-0e26-4164-8d60-6e89365dcf96 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:59:54.824322 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b2a624f5-0e26-4164-8d60-6e89365dcf96 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:59:54.824322 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b2a624f5-0e26-4164-8d60-6e89365dcf96 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:59:54.991064 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-b2a624f5-0e26-4164-8d60-6e89365dcf96 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431134cb94bd448cb6413da52ac4ed48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0507d00afdc046a8bc4d1bd0fda1eb7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:59:54.999805 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-b2a624f5-0e26-4164-8d60-6e89365dcf96 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] 10.222.0.26 "GET /compute/v2.1/servers/68f705d9-36c1-483f-bb38-7e1749b61677" status: 200 len: 1314 microversion: 2.1 time: 0.193626 Jul 11 11:59:55.002075 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1505/3005] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:59:54 2022] GET /compute/v2.1/servers/68f705d9-36c1-483f-bb38-7e1749b61677 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:59:56.023142 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-d529f75d-ce72-499b-9ba4-530976563ea0 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:59:56.023142 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-d529f75d-ce72-499b-9ba4-530976563ea0 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] [instance: 68f705d9-36c1-483f-bb38-7e1749b61677] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:59:56.032804 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d529f75d-ce72-499b-9ba4-530976563ea0 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:59:56.033554 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d529f75d-ce72-499b-9ba4-530976563ea0 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:59:56.034649 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d529f75d-ce72-499b-9ba4-530976563ea0 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:59:56.035313 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d529f75d-ce72-499b-9ba4-530976563ea0 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:59:56.202488 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-d529f75d-ce72-499b-9ba4-530976563ea0 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431134cb94bd448cb6413da52ac4ed48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0507d00afdc046a8bc4d1bd0fda1eb7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:59:56.213142 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-d529f75d-ce72-499b-9ba4-530976563ea0 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] 10.222.0.26 "GET /compute/v2.1/servers/68f705d9-36c1-483f-bb38-7e1749b61677" status: 200 len: 1314 microversion: 2.1 time: 0.198947 Jul 11 11:59:56.213845 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1501/3006] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:59:56 2022] GET /compute/v2.1/servers/68f705d9-36c1-483f-bb38-7e1749b61677 => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:59:57.387979 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-db420eb7-e68d-44f3-903a-b611dce442e7 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:59:57.387979 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-db420eb7-e68d-44f3-903a-b611dce442e7 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] [instance: 68f705d9-36c1-483f-bb38-7e1749b61677] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:59:57.387979 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-db420eb7-e68d-44f3-903a-b611dce442e7 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:59:57.387979 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-db420eb7-e68d-44f3-903a-b611dce442e7 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:59:57.394368 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-db420eb7-e68d-44f3-903a-b611dce442e7 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:59:57.394368 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-db420eb7-e68d-44f3-903a-b611dce442e7 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:59:57.394368 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-db420eb7-e68d-44f3-903a-b611dce442e7 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431134cb94bd448cb6413da52ac4ed48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0507d00afdc046a8bc4d1bd0fda1eb7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:59:57.402979 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-db420eb7-e68d-44f3-903a-b611dce442e7 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] 10.222.0.26 "GET /compute/v2.1/servers/68f705d9-36c1-483f-bb38-7e1749b61677" status: 200 len: 1314 microversion: 2.1 time: 0.176763 Jul 11 11:59:57.403806 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1506/3007] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:59:57 2022] GET /compute/v2.1/servers/68f705d9-36c1-483f-bb38-7e1749b61677 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 11:59:58.423887 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [req-de3e6715-a8a6-43e1-966d-482150c8ec9b req-86b3dc3d-d892-40b6-ae87-082d8aaef0ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68f705d9-36c1-483f-bb38-7e1749b61677", "name": "network-vif-plugged", "status": "completed", "tag": "3a37fda0-5187-4d77-9d12-68b5fd6c58d0"}]} {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 11:59:58.443017 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [req-de3e6715-a8a6-43e1-966d-482150c8ec9b req-86b3dc3d-d892-40b6-ae87-082d8aaef0ae service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:59:58.449370 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [req-de3e6715-a8a6-43e1-966d-482150c8ec9b req-86b3dc3d-d892-40b6-ae87-082d8aaef0ae service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:59:58.458244 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.compute.server_external_events [req-de3e6715-a8a6-43e1-966d-482150c8ec9b req-86b3dc3d-d892-40b6-ae87-082d8aaef0ae service nova] Creating event network-vif-plugged:3a37fda0-5187-4d77-9d12-68b5fd6c58d0 for instance 68f705d9-36c1-483f-bb38-7e1749b61677 on hv-cinder-84842 Jul 11 11:59:58.464155 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [req-de3e6715-a8a6-43e1-966d-482150c8ec9b req-86b3dc3d-d892-40b6-ae87-082d8aaef0ae service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.402004 Jul 11 11:59:58.464869 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1502/3008] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 11:59:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 11:59:58.511057 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-78723c0b-1e73-47ba-88b0-cc9e87f328af tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 11:59:58.511057 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-78723c0b-1e73-47ba-88b0-cc9e87f328af tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] [instance: 68f705d9-36c1-483f-bb38-7e1749b61677] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 11:59:58.556176 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-78723c0b-1e73-47ba-88b0-cc9e87f328af tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:59:58.556655 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-78723c0b-1e73-47ba-88b0-cc9e87f328af tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:59:58.557435 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-78723c0b-1e73-47ba-88b0-cc9e87f328af tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 11:59:58.557869 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-78723c0b-1e73-47ba-88b0-cc9e87f328af tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 11:59:59.009244 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-78723c0b-1e73-47ba-88b0-cc9e87f328af tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431134cb94bd448cb6413da52ac4ed48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0507d00afdc046a8bc4d1bd0fda1eb7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 11:59:59.029393 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-78723c0b-1e73-47ba-88b0-cc9e87f328af tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] 10.222.0.26 "GET /compute/v2.1/servers/68f705d9-36c1-483f-bb38-7e1749b61677" status: 200 len: 1314 microversion: 2.1 time: 0.525323 Jul 11 11:59:59.033928 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1507/3009] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 11:59:58 2022] GET /compute/v2.1/servers/68f705d9-36c1-483f-bb38-7e1749b61677 => generated 1314 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:00:00.063468 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-a4d6afd1-fc8f-41ae-943d-df40d0217052 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:00:00.064692 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-a4d6afd1-fc8f-41ae-943d-df40d0217052 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] [instance: 68f705d9-36c1-483f-bb38-7e1749b61677] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:00:00.073490 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a4d6afd1-fc8f-41ae-943d-df40d0217052 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:00:00.074665 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a4d6afd1-fc8f-41ae-943d-df40d0217052 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:00:00.077850 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a4d6afd1-fc8f-41ae-943d-df40d0217052 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:00:00.078072 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a4d6afd1-fc8f-41ae-943d-df40d0217052 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:00:00.233756 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-a4d6afd1-fc8f-41ae-943d-df40d0217052 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431134cb94bd448cb6413da52ac4ed48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0507d00afdc046a8bc4d1bd0fda1eb7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:00:00.240724 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-a4d6afd1-fc8f-41ae-943d-df40d0217052 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] 10.222.0.26 "GET /compute/v2.1/servers/68f705d9-36c1-483f-bb38-7e1749b61677" status: 200 len: 1314 microversion: 2.1 time: 0.193353 Jul 11 12:00:00.241722 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1503/3010] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:00:00 2022] GET /compute/v2.1/servers/68f705d9-36c1-483f-bb38-7e1749b61677 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:00:01.260233 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-f7530146-fe72-4e41-90bf-a0efd87a800b tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:00:01.261729 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-f7530146-fe72-4e41-90bf-a0efd87a800b tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] [instance: 68f705d9-36c1-483f-bb38-7e1749b61677] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:00:01.297637 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f7530146-fe72-4e41-90bf-a0efd87a800b tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:00:01.299085 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f7530146-fe72-4e41-90bf-a0efd87a800b tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:00:01.301457 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f7530146-fe72-4e41-90bf-a0efd87a800b tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:00:01.305453 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f7530146-fe72-4e41-90bf-a0efd87a800b tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:00:01.487524 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-f7530146-fe72-4e41-90bf-a0efd87a800b tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431134cb94bd448cb6413da52ac4ed48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0507d00afdc046a8bc4d1bd0fda1eb7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:00:01.496353 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-f7530146-fe72-4e41-90bf-a0efd87a800b tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] 10.222.0.26 "GET /compute/v2.1/servers/68f705d9-36c1-483f-bb38-7e1749b61677" status: 200 len: 1314 microversion: 2.1 time: 0.242354 Jul 11 12:00:01.504866 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1508/3011] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:00:01 2022] GET /compute/v2.1/servers/68f705d9-36c1-483f-bb38-7e1749b61677 => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:00:02.513873 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-856441c5-9f80-47b2-ac81-6e169e0634de tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:00:02.514539 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-856441c5-9f80-47b2-ac81-6e169e0634de tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] [instance: 68f705d9-36c1-483f-bb38-7e1749b61677] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:00:02.523615 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-856441c5-9f80-47b2-ac81-6e169e0634de tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:00:02.524065 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-856441c5-9f80-47b2-ac81-6e169e0634de tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:00:02.524840 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-856441c5-9f80-47b2-ac81-6e169e0634de tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:00:02.525282 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-856441c5-9f80-47b2-ac81-6e169e0634de tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:00:02.758199 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-856441c5-9f80-47b2-ac81-6e169e0634de tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431134cb94bd448cb6413da52ac4ed48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0507d00afdc046a8bc4d1bd0fda1eb7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:00:02.768686 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-856441c5-9f80-47b2-ac81-6e169e0634de tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] 10.222.0.26 "GET /compute/v2.1/servers/68f705d9-36c1-483f-bb38-7e1749b61677" status: 200 len: 1314 microversion: 2.1 time: 0.259341 Jul 11 12:00:02.771474 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1504/3012] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:00:02 2022] GET /compute/v2.1/servers/68f705d9-36c1-483f-bb38-7e1749b61677 => generated 1314 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:00:03.608740 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-81c837ec-28ed-4e70-bb50-70ce34ce3187 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Action: 'create', calling method: .version_select at 0x7fb014258b80>, body: {"keypair": {"name": "tempest-TestShelveInstance-247202412", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBZRG4/Jg7K6Dca6yrkaO0d2J6xqZMEQ1uEOUJIcvdJ+3e2z0oLDx8VyRBOHxW2MvcMQOwYXWBePTUQPUNd+kAqCbDsWtbcsvXCLAXPzLVkDy3KB/8+TqfCUyxBSyQDRCg=="}} {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 12:00:03.626982 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.quota [None req-81c837ec-28ed-4e70-bb50-70ce34ce3187 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Getting quotas for project 59ae388052ee406c8d6cc749a1ed8c02. Resources: {'key_pairs'} {{(pid=118322) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 12:00:03.634258 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.quota [None req-81c837ec-28ed-4e70-bb50-70ce34ce3187 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Getting quotas for user fa171a9679a3460bb2ee9369e4051690 and project 59ae388052ee406c8d6cc749a1ed8c02. Resources: {'key_pairs'} {{(pid=118322) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 12:00:03.772395 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-81c837ec-28ed-4e70-bb50-70ce34ce3187 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.409898 Jul 11 12:00:03.773014 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1509/3013] 10.222.0.26 () {60 vars in 1158 bytes} [Mon Jul 11 12:00:03 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 12:00:03.785677 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-fc18d288-da7f-4ec1-9197-85e778893efc tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:00:03.786298 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-fc18d288-da7f-4ec1-9197-85e778893efc tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] [instance: 68f705d9-36c1-483f-bb38-7e1749b61677] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:00:03.793556 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fc18d288-da7f-4ec1-9197-85e778893efc tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:00:03.794171 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fc18d288-da7f-4ec1-9197-85e778893efc tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:00:03.794818 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fc18d288-da7f-4ec1-9197-85e778893efc tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:00:03.795456 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-fc18d288-da7f-4ec1-9197-85e778893efc tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:00:03.959242 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-fc18d288-da7f-4ec1-9197-85e778893efc tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431134cb94bd448cb6413da52ac4ed48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0507d00afdc046a8bc4d1bd0fda1eb7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:00:03.968897 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-fc18d288-da7f-4ec1-9197-85e778893efc tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] 10.222.0.26 "GET /compute/v2.1/servers/68f705d9-36c1-483f-bb38-7e1749b61677" status: 200 len: 1463 microversion: 2.1 time: 0.187745 Jul 11 12:00:03.969485 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1505/3014] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:00:03 2022] GET /compute/v2.1/servers/68f705d9-36c1-483f-bb38-7e1749b61677 => generated 1463 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:00:04.012483 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-30edc26e-420f-4c7a-9ffa-c189f8fe9ade tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:00:04.013063 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-30edc26e-420f-4c7a-9ffa-c189f8fe9ade tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] [instance: 68f705d9-36c1-483f-bb38-7e1749b61677] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:00:04.019347 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-30edc26e-420f-4c7a-9ffa-c189f8fe9ade tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:00:04.020032 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-30edc26e-420f-4c7a-9ffa-c189f8fe9ade tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:00:04.020826 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-30edc26e-420f-4c7a-9ffa-c189f8fe9ade tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:00:04.021257 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-30edc26e-420f-4c7a-9ffa-c189f8fe9ade tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:00:04.046994 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-30edc26e-420f-4c7a-9ffa-c189f8fe9ade tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] [instance: 68f705d9-36c1-483f-bb38-7e1749b61677] Going to try to terminate instance {{(pid=118322) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 12:00:04.417077 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-30edc26e-420f-4c7a-9ffa-c189f8fe9ade tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] 10.222.0.26 "DELETE /compute/v2.1/servers/68f705d9-36c1-483f-bb38-7e1749b61677" status: 204 len: 0 microversion: 2.1 time: 0.407447 Jul 11 12:00:04.418039 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1510/3015] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 11 12:00:04 2022] DELETE /compute/v2.1/servers/68f705d9-36c1-483f-bb38-7e1749b61677 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 11 12:00:04.426328 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-375817c9-fc36-4d65-ac2b-0036fe5244ab tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:00:04.426935 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-375817c9-fc36-4d65-ac2b-0036fe5244ab tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] [instance: 68f705d9-36c1-483f-bb38-7e1749b61677] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:00:04.434193 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-375817c9-fc36-4d65-ac2b-0036fe5244ab tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:00:04.434638 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-375817c9-fc36-4d65-ac2b-0036fe5244ab tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:00:04.435435 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-375817c9-fc36-4d65-ac2b-0036fe5244ab tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:00:04.436191 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-375817c9-fc36-4d65-ac2b-0036fe5244ab tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:00:04.578885 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-375817c9-fc36-4d65-ac2b-0036fe5244ab tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431134cb94bd448cb6413da52ac4ed48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0507d00afdc046a8bc4d1bd0fda1eb7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:00:04.587014 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-375817c9-fc36-4d65-ac2b-0036fe5244ab tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] 10.222.0.26 "GET /compute/v2.1/servers/68f705d9-36c1-483f-bb38-7e1749b61677" status: 200 len: 1469 microversion: 2.1 time: 0.164670 Jul 11 12:00:04.587612 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1506/3016] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:00:04 2022] GET /compute/v2.1/servers/68f705d9-36c1-483f-bb38-7e1749b61677 => generated 1469 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:00:05.604422 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-5f53da9b-73ab-4adc-9152-b80def7ba29f tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:00:05.605119 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-5f53da9b-73ab-4adc-9152-b80def7ba29f tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] [instance: 68f705d9-36c1-483f-bb38-7e1749b61677] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:00:05.611823 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5f53da9b-73ab-4adc-9152-b80def7ba29f tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:00:05.612295 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5f53da9b-73ab-4adc-9152-b80def7ba29f tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:00:05.613042 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5f53da9b-73ab-4adc-9152-b80def7ba29f tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:00:05.613470 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5f53da9b-73ab-4adc-9152-b80def7ba29f tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:00:05.748914 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-5f53da9b-73ab-4adc-9152-b80def7ba29f tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431134cb94bd448cb6413da52ac4ed48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0507d00afdc046a8bc4d1bd0fda1eb7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:00:05.758410 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-5f53da9b-73ab-4adc-9152-b80def7ba29f tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] 10.222.0.26 "GET /compute/v2.1/servers/68f705d9-36c1-483f-bb38-7e1749b61677" status: 200 len: 1469 microversion: 2.1 time: 0.156355 Jul 11 12:00:05.758410 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1511/3017] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:00:05 2022] GET /compute/v2.1/servers/68f705d9-36c1-483f-bb38-7e1749b61677 => generated 1469 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:00:06.777569 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-c13913cb-71c6-4463-80ec-cd76ad6ef47a tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:00:06.778635 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-c13913cb-71c6-4463-80ec-cd76ad6ef47a tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] [instance: 68f705d9-36c1-483f-bb38-7e1749b61677] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:00:06.786662 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c13913cb-71c6-4463-80ec-cd76ad6ef47a tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:00:06.787442 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c13913cb-71c6-4463-80ec-cd76ad6ef47a tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:00:06.788333 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c13913cb-71c6-4463-80ec-cd76ad6ef47a tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:00:06.788992 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c13913cb-71c6-4463-80ec-cd76ad6ef47a tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:00:06.941578 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-c13913cb-71c6-4463-80ec-cd76ad6ef47a tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431134cb94bd448cb6413da52ac4ed48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0507d00afdc046a8bc4d1bd0fda1eb7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:00:06.953880 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-c13913cb-71c6-4463-80ec-cd76ad6ef47a tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] 10.222.0.26 "GET /compute/v2.1/servers/68f705d9-36c1-483f-bb38-7e1749b61677" status: 200 len: 1469 microversion: 2.1 time: 0.182833 Jul 11 12:00:06.954476 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1507/3018] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:00:06 2022] GET /compute/v2.1/servers/68f705d9-36c1-483f-bb38-7e1749b61677 => generated 1469 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 12:00:07.971199 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-ee30fd16-e26e-42d4-9449-13b26306e5c1 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:00:07.971832 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-ee30fd16-e26e-42d4-9449-13b26306e5c1 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] [instance: 68f705d9-36c1-483f-bb38-7e1749b61677] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:00:07.979071 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ee30fd16-e26e-42d4-9449-13b26306e5c1 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:00:07.979550 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ee30fd16-e26e-42d4-9449-13b26306e5c1 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:00:07.980312 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ee30fd16-e26e-42d4-9449-13b26306e5c1 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:00:07.980780 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ee30fd16-e26e-42d4-9449-13b26306e5c1 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:00:08.125116 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-ee30fd16-e26e-42d4-9449-13b26306e5c1 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431134cb94bd448cb6413da52ac4ed48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0507d00afdc046a8bc4d1bd0fda1eb7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:00:08.133083 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-ee30fd16-e26e-42d4-9449-13b26306e5c1 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] 10.222.0.26 "GET /compute/v2.1/servers/68f705d9-36c1-483f-bb38-7e1749b61677" status: 200 len: 1469 microversion: 2.1 time: 0.165756 Jul 11 12:00:08.133710 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1512/3019] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:00:07 2022] GET /compute/v2.1/servers/68f705d9-36c1-483f-bb38-7e1749b61677 => generated 1469 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:00:09.129978 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [req-18fa771f-09ec-4624-81a9-7e3bdd94b627 req-4e092bdb-734f-495f-b230-a8cf5dd686de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68f705d9-36c1-483f-bb38-7e1749b61677", "name": "network-vif-deleted", "tag": "3a37fda0-5187-4d77-9d12-68b5fd6c58d0"}]} {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 12:00:09.138600 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [req-18fa771f-09ec-4624-81a9-7e3bdd94b627 req-4e092bdb-734f-495f-b230-a8cf5dd686de service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:00:09.139914 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [req-18fa771f-09ec-4624-81a9-7e3bdd94b627 req-4e092bdb-734f-495f-b230-a8cf5dd686de service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:00:09.150546 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-490e68f1-fba6-4590-9544-2b4c738ce0a1 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:00:09.151363 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-490e68f1-fba6-4590-9544-2b4c738ce0a1 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] [instance: 68f705d9-36c1-483f-bb38-7e1749b61677] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:00:09.153092 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.compute.server_external_events [req-18fa771f-09ec-4624-81a9-7e3bdd94b627 req-4e092bdb-734f-495f-b230-a8cf5dd686de service nova] Creating event network-vif-deleted:3a37fda0-5187-4d77-9d12-68b5fd6c58d0 for instance 68f705d9-36c1-483f-bb38-7e1749b61677 on hv-cinder-84842 Jul 11 12:00:09.158348 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-490e68f1-fba6-4590-9544-2b4c738ce0a1 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:00:09.158793 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-490e68f1-fba6-4590-9544-2b4c738ce0a1 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:00:09.159588 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-490e68f1-fba6-4590-9544-2b4c738ce0a1 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:00:09.160015 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-490e68f1-fba6-4590-9544-2b4c738ce0a1 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:00:09.162708 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [req-18fa771f-09ec-4624-81a9-7e3bdd94b627 req-4e092bdb-734f-495f-b230-a8cf5dd686de service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036503 Jul 11 12:00:09.166876 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1508/3020] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 12:00:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 12:00:09.235076 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-490e68f1-fba6-4590-9544-2b4c738ce0a1 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431134cb94bd448cb6413da52ac4ed48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0507d00afdc046a8bc4d1bd0fda1eb7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:00:09.250215 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-490e68f1-fba6-4590-9544-2b4c738ce0a1 tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] 10.222.0.26 "GET /compute/v2.1/servers/68f705d9-36c1-483f-bb38-7e1749b61677" status: 200 len: 1427 microversion: 2.1 time: 0.103230 Jul 11 12:00:09.251139 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1513/3021] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:00:09 2022] GET /compute/v2.1/servers/68f705d9-36c1-483f-bb38-7e1749b61677 => generated 1427 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:00:10.272025 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-823766d0-bc3c-422f-a3ca-ad436debe7bf tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:00:10.272645 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-823766d0-bc3c-422f-a3ca-ad436debe7bf tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] [instance: 68f705d9-36c1-483f-bb38-7e1749b61677] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:00:10.275106 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:00:10.280094 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-823766d0-bc3c-422f-a3ca-ad436debe7bf tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:00:10.280547 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-823766d0-bc3c-422f-a3ca-ad436debe7bf tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:00:10.281311 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-823766d0-bc3c-422f-a3ca-ad436debe7bf tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:00:10.281746 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-823766d0-bc3c-422f-a3ca-ad436debe7bf tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:00:10.285618 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=75 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:00:10.294691 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.wsgi [None req-823766d0-bc3c-422f-a3ca-ad436debe7bf tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] HTTP exception thrown: Instance 68f705d9-36c1-483f-bb38-7e1749b61677 could not be found. Jul 11 12:00:10.296341 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-823766d0-bc3c-422f-a3ca-ad436debe7bf tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Request method failure captured: Jul 11 12:00:10.296341 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: request: GET /compute/v2.1/servers/68f705d9-36c1-483f-bb38-7e1749b61677 HTTP/1.1 Jul 11 12:00:10.296341 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Accept: application/json Jul 11 12:00:10.296341 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Accept-Encoding: identity Jul 11 12:00:10.296341 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Connection: close Jul 11 12:00:10.296341 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Content-Length: 0 Jul 11 12:00:10.296341 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Content-Type: application/json Jul 11 12:00:10.296341 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Host: 10.222.0.26 Jul 11 12:00:10.296341 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Openstack-System-Scope: None Jul 11 12:00:10.296341 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: User-Agent: python-urllib3/1.26.9 Jul 11 12:00:10.296341 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Auth-Token: gAAAAABizBCoqJLf0RYiVxiddzRjFODPH9QKikzgC3-RKo7eTGiZVbrl6s6V5_c7rlUQgtuMnCYMJd3_HItUcKz0-_KBgY7i9BVeq7IiokFUQ_Y908LMJN_0yYNENepEtg7PB-nqynlYUnCdxmreI_TzCbP5ZhXjaKjCDu6v85FFNMl-IoPw7rg Jul 11 12:00:10.296341 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Domain-Id: None Jul 11 12:00:10.296341 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Domain-Name: None Jul 11 12:00:10.296341 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Identity-Status: Confirmed Jul 11 12:00:10.296341 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Is-Admin-Project: True Jul 11 12:00:10.296341 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Domain-Id: default Jul 11 12:00:10.296341 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Domain-Name: Default Jul 11 12:00:10.296341 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Id: 0507d00afdc046a8bc4d1bd0fda1eb7b Jul 11 12:00:10.296341 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Name: tempest-VolumesNegativeTest-497367945 Jul 11 12:00:10.296341 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Role: member,reader Jul 11 12:00:10.296341 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Roles: member,reader Jul 11 12:00:10.297672 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0507d00afdc046a8bc4d1bd0fda1eb7b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0507d00afdc046a8bc4d1bd0fda1eb7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0507d00afdc046a8bc4d1bd0fda1eb7b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0507d00afdc046a8bc4d1bd0fda1eb7b"}]}] Jul 11 12:00:10.297672 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Tenant: tempest-VolumesNegativeTest-497367945 Jul 11 12:00:10.297672 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Tenant-Id: 0507d00afdc046a8bc4d1bd0fda1eb7b Jul 11 12:00:10.297672 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Tenant-Name: tempest-VolumesNegativeTest-497367945 Jul 11 12:00:10.297672 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User: tempest-VolumesNegativeTest-497367945-project Jul 11 12:00:10.297672 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Domain-Id: default Jul 11 12:00:10.297672 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Domain-Name: Default Jul 11 12:00:10.297672 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Id: 431134cb94bd448cb6413da52ac4ed48 Jul 11 12:00:10.297672 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Name: tempest-VolumesNegativeTest-497367945-project Jul 11 12:00:10.297672 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: method: > Jul 11 12:00:10.297672 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: exception: Instance 68f705d9-36c1-483f-bb38-7e1749b61677 could not be found. Jul 11 12:00:10.297672 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: action_args: {'id': '68f705d9-36c1-483f-bb38-7e1749b61677'} Jul 11 12:00:10.298402 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 12:00:10.298402 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 12:00:10.298402 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 12:00:10.298402 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 12:00:10.298402 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 12:00:10.298402 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 12:00:10.298402 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 12:00:10.298402 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 12:00:10.298402 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 12:00:10.298402 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 12:00:10.298402 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68f705d9-36c1-483f-bb38-7e1749b61677 could not be found. Jul 11 12:00:10.298402 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 12:00:10.298402 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 12:00:10.298402 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 12:00:10.298402 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 12:00:10.298402 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 12:00:10.298402 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 12:00:10.298402 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 12:00:10.298402 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 12:00:10.298402 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 12:00:10.299703 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 12:00:10.299703 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 12:00:10.299703 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 12:00:10.299703 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 12:00:10.299703 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 12:00:10.299703 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 12:00:10.299703 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 12:00:10.299703 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68f705d9-36c1-483f-bb38-7e1749b61677 could not be found. Jul 11 12:00:10.299703 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 12:00:10.299703 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 12:00:10.299703 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 12:00:10.299703 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 12:00:10.299703 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 12:00:10.299703 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 12:00:10.299703 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 12:00:10.299703 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 12:00:10.299703 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68f705d9-36c1-483f-bb38-7e1749b61677 could not be found. Jul 11 12:00:10.299703 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 12:00:10.300828 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-823766d0-bc3c-422f-a3ca-ad436debe7bf tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] Returning 404 to user: Instance 68f705d9-36c1-483f-bb38-7e1749b61677 could not be found. {{(pid=118321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 12:00:10.300828 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-823766d0-bc3c-422f-a3ca-ad436debe7bf tempest-VolumesNegativeTest-497367945 tempest-VolumesNegativeTest-497367945-project] 10.222.0.26 "GET /compute/v2.1/servers/68f705d9-36c1-483f-bb38-7e1749b61677" status: 404 len: 111 microversion: 2.1 time: 0.030638 Jul 11 12:00:10.300828 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1509/3022] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:00:10 2022] GET /compute/v2.1/servers/68f705d9-36c1-483f-bb38-7e1749b61677 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 12:00:32.744265 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-946d2a1b-32fb-4611-8193-fff32f7fa37c tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-169761126", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-247202412", "security_groups": [{"name": "tempest-secgroup-smoke-17403947"}], "networks": [{"uuid": "2f0fff82-6eea-4c58-afcd-9d3d3bbe25fd"}], "block_device_mapping_v2": [{"uuid": "ed00a181-5302-42e8-8ee4-3b9911ee78b3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 12:00:32.775809 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell0:SELECT=4 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:00:32.776961 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:00:32.777719 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:00:33.058605 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.network.neutron [None req-946d2a1b-32fb-4611-8193-fff32f7fa37c tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] validate_networks() for [('2f0fff82-6eea-4c58-afcd-9d3d3bbe25fd', None, None, None, None, None)] {{(pid=118322) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 12:00:33.667752 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-562969fa-8694-46eb-9b21-7a5aedd81adf tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Action: 'create', calling method: .version_select at 0x7fb010060ca0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1764556180", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEnI236ax8RtL9YYydIL0z0/ixwqGQ5G73+Wu9GigbQ00pLJqEulkUvhE6gY2CdNxRnqYXQayA3CpTufshvcii0oUqE0u8I4bS4GTNUsKPBfeXtd2DwZqjLSEgpg+gYMlw=="}} {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 12:00:33.688443 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.quota [None req-562969fa-8694-46eb-9b21-7a5aedd81adf tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Getting quotas for project 79c8c84b3f704d528ea772607da56ddf. Resources: {'key_pairs'} {{(pid=118321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 12:00:33.693858 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.quota [None req-562969fa-8694-46eb-9b21-7a5aedd81adf tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Getting quotas for user fccd3de89cd94e5fa4c488c16d993241 and project 79c8c84b3f704d528ea772607da56ddf. Resources: {'key_pairs'} {{(pid=118321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 12:00:33.792118 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.virt.hardware [None req-946d2a1b-32fb-4611-8193-fff32f7fa37c tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Flavor limits 0:0:0 {{(pid=118322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 12:00:33.792613 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.virt.hardware [None req-946d2a1b-32fb-4611-8193-fff32f7fa37c tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Image limits 0:0:0 {{(pid=118322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 12:00:33.793010 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.virt.hardware [None req-946d2a1b-32fb-4611-8193-fff32f7fa37c tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Flavor pref 0:0:0 {{(pid=118322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 12:00:33.793448 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.virt.hardware [None req-946d2a1b-32fb-4611-8193-fff32f7fa37c tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Image pref 0:0:0 {{(pid=118322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 12:00:33.793861 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.virt.hardware [None req-946d2a1b-32fb-4611-8193-fff32f7fa37c tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 12:00:33.795808 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-562969fa-8694-46eb-9b21-7a5aedd81adf tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.441990 Jul 11 12:00:33.797985 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1510/3023] 10.222.0.26 () {60 vars in 1158 bytes} [Mon Jul 11 12:00:33 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 12:00:33.804809 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-946d2a1b-32fb-4611-8193-fff32f7fa37c tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:00:33.805272 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-946d2a1b-32fb-4611-8193-fff32f7fa37c tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:00:33.806101 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-946d2a1b-32fb-4611-8193-fff32f7fa37c tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:00:33.806545 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-946d2a1b-32fb-4611-8193-fff32f7fa37c tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:00:33.828147 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.quota [None req-946d2a1b-32fb-4611-8193-fff32f7fa37c tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Getting quotas for project 59ae388052ee406c8d6cc749a1ed8c02. Resources: {'cores', 'ram', 'instances'} {{(pid=118322) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 12:00:33.832892 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.quota [None req-946d2a1b-32fb-4611-8193-fff32f7fa37c tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Getting quotas for user fa171a9679a3460bb2ee9369e4051690 and project 59ae388052ee406c8d6cc749a1ed8c02. Resources: {'cores', 'ram', 'instances'} {{(pid=118322) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 12:00:33.992723 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-946d2a1b-32fb-4611-8193-fff32f7fa37c tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Going to run 1 instances... {{(pid=118322) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 12:00:33.995397 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-946d2a1b-32fb-4611-8193-fff32f7fa37c tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] [instance: 6dc56556-ace0-40cd-8f2e-d8fece4412e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ed00a181-5302-42e8-8ee4-3b9911ee78b3',volume_size=None,volume_type=None)] {{(pid=118322) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 12:00:34.525969 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-946d2a1b-32fb-4611-8193-fff32f7fa37c tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.788185 Jul 11 12:00:34.536015 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1514/3024] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jul 11 12:00:32 2022] POST /compute/v2.1/servers => generated 404 bytes in 1797 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 11 12:00:34.546421 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-fed6ffb4-cc88-4227-b699-4c136cd8bca9 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:00:34.546421 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-fed6ffb4-cc88-4227-b699-4c136cd8bca9 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] [instance: 6dc56556-ace0-40cd-8f2e-d8fece4412e9] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:00:34.603194 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-fed6ffb4-cc88-4227-b699-4c136cd8bca9 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa171a9679a3460bb2ee9369e4051690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ae388052ee406c8d6cc749a1ed8c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:00:34.611766 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-fed6ffb4-cc88-4227-b699-4c136cd8bca9 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] 10.222.0.26 "GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9" status: 200 len: 1087 microversion: 2.1 time: 0.076580 Jul 11 12:00:34.612331 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1511/3025] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:00:34 2022] GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9 => generated 1087 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:00:35.629492 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-2fb30fdc-5c30-4c4c-9f84-e08353d4d380 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:00:35.630154 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-2fb30fdc-5c30-4c4c-9f84-e08353d4d380 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] [instance: 6dc56556-ace0-40cd-8f2e-d8fece4412e9] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:00:35.639329 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2fb30fdc-5c30-4c4c-9f84-e08353d4d380 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:00:35.639776 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2fb30fdc-5c30-4c4c-9f84-e08353d4d380 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:00:35.640533 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2fb30fdc-5c30-4c4c-9f84-e08353d4d380 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:00:35.640971 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2fb30fdc-5c30-4c4c-9f84-e08353d4d380 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:00:35.706931 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-2fb30fdc-5c30-4c4c-9f84-e08353d4d380 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa171a9679a3460bb2ee9369e4051690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ae388052ee406c8d6cc749a1ed8c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:00:35.716352 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-2fb30fdc-5c30-4c4c-9f84-e08353d4d380 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] 10.222.0.26 "GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9" status: 200 len: 1137 microversion: 2.1 time: 0.091007 Jul 11 12:00:35.718853 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1515/3026] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:00:35 2022] GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9 => generated 1137 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:00:36.735448 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-98966c15-6580-4d15-a7fd-0b6b3d6ba6f5 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:00:36.735448 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-98966c15-6580-4d15-a7fd-0b6b3d6ba6f5 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] [instance: 6dc56556-ace0-40cd-8f2e-d8fece4412e9] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:00:36.741696 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-98966c15-6580-4d15-a7fd-0b6b3d6ba6f5 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:00:36.742296 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-98966c15-6580-4d15-a7fd-0b6b3d6ba6f5 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:00:36.743058 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-98966c15-6580-4d15-a7fd-0b6b3d6ba6f5 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:00:36.743811 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-98966c15-6580-4d15-a7fd-0b6b3d6ba6f5 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:00:36.936183 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-98966c15-6580-4d15-a7fd-0b6b3d6ba6f5 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa171a9679a3460bb2ee9369e4051690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ae388052ee406c8d6cc749a1ed8c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:00:36.947146 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-98966c15-6580-4d15-a7fd-0b6b3d6ba6f5 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] 10.222.0.26 "GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9" status: 200 len: 1193 microversion: 2.1 time: 0.217447 Jul 11 12:00:36.955627 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1512/3027] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:00:36 2022] GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9 => generated 1193 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:00:37.972266 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-109f8663-d96d-4fd6-b7a2-92f32e098031 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:00:37.973448 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-109f8663-d96d-4fd6-b7a2-92f32e098031 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] [instance: 6dc56556-ace0-40cd-8f2e-d8fece4412e9] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:00:37.982350 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-109f8663-d96d-4fd6-b7a2-92f32e098031 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:00:37.983622 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-109f8663-d96d-4fd6-b7a2-92f32e098031 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:00:37.987114 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-109f8663-d96d-4fd6-b7a2-92f32e098031 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:00:37.987983 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-109f8663-d96d-4fd6-b7a2-92f32e098031 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:00:38.272389 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-109f8663-d96d-4fd6-b7a2-92f32e098031 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa171a9679a3460bb2ee9369e4051690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ae388052ee406c8d6cc749a1ed8c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:00:38.289505 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-109f8663-d96d-4fd6-b7a2-92f32e098031 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] 10.222.0.26 "GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9" status: 200 len: 1269 microversion: 2.1 time: 0.321824 Jul 11 12:00:38.291838 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1516/3028] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:00:37 2022] GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9 => generated 1269 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 12:00:39.275518 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [req-ee2ebd82-bc5b-427e-a012-f8bdbaba5e44 req-a152afad-7666-4e2d-b134-c3a54fad6d33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dc56556-ace0-40cd-8f2e-d8fece4412e9", "tag": "e8bfdf4d-ab82-479d-85eb-97c40021c54f"}]} {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 12:00:39.288406 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [req-ee2ebd82-bc5b-427e-a012-f8bdbaba5e44 req-a152afad-7666-4e2d-b134-c3a54fad6d33 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:00:39.289075 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [req-ee2ebd82-bc5b-427e-a012-f8bdbaba5e44 req-a152afad-7666-4e2d-b134-c3a54fad6d33 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:00:39.306634 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.compute.server_external_events [req-ee2ebd82-bc5b-427e-a012-f8bdbaba5e44 req-a152afad-7666-4e2d-b134-c3a54fad6d33 service nova] Creating event network-changed:e8bfdf4d-ab82-479d-85eb-97c40021c54f for instance 6dc56556-ace0-40cd-8f2e-d8fece4412e9 on hv-cinder-84842 Jul 11 12:00:39.314973 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-80f81acb-020b-4ca1-a818-893e3a5864f3 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:00:39.316168 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-80f81acb-020b-4ca1-a818-893e3a5864f3 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] [instance: 6dc56556-ace0-40cd-8f2e-d8fece4412e9] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:00:39.319573 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [req-ee2ebd82-bc5b-427e-a012-f8bdbaba5e44 req-a152afad-7666-4e2d-b134-c3a54fad6d33 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047864 Jul 11 12:00:39.320247 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1513/3029] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 12:00:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 12:00:39.334841 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-80f81acb-020b-4ca1-a818-893e3a5864f3 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:00:39.335711 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-80f81acb-020b-4ca1-a818-893e3a5864f3 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:00:39.336503 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-80f81acb-020b-4ca1-a818-893e3a5864f3 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:00:39.337376 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-80f81acb-020b-4ca1-a818-893e3a5864f3 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:00:39.540781 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-80f81acb-020b-4ca1-a818-893e3a5864f3 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa171a9679a3460bb2ee9369e4051690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ae388052ee406c8d6cc749a1ed8c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:00:39.551167 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-80f81acb-020b-4ca1-a818-893e3a5864f3 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] 10.222.0.26 "GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9" status: 200 len: 1257 microversion: 2.1 time: 0.244497 Jul 11 12:00:39.551766 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1517/3030] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:00:39 2022] GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9 => generated 1257 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 12:00:40.571617 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-e2ddaaf4-f10a-4f78-9a77-cf1f1d1f20f7 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:00:40.575501 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-e2ddaaf4-f10a-4f78-9a77-cf1f1d1f20f7 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] [instance: 6dc56556-ace0-40cd-8f2e-d8fece4412e9] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:00:40.586667 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e2ddaaf4-f10a-4f78-9a77-cf1f1d1f20f7 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:00:40.587535 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e2ddaaf4-f10a-4f78-9a77-cf1f1d1f20f7 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:00:40.588313 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e2ddaaf4-f10a-4f78-9a77-cf1f1d1f20f7 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:00:40.588886 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e2ddaaf4-f10a-4f78-9a77-cf1f1d1f20f7 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:00:40.770076 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-e2ddaaf4-f10a-4f78-9a77-cf1f1d1f20f7 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa171a9679a3460bb2ee9369e4051690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ae388052ee406c8d6cc749a1ed8c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:00:40.778623 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-e2ddaaf4-f10a-4f78-9a77-cf1f1d1f20f7 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] 10.222.0.26 "GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9" status: 200 len: 1257 microversion: 2.1 time: 0.213218 Jul 11 12:00:40.779288 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1514/3031] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:00:40 2022] GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9 => generated 1257 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:00:41.795841 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-9087e1a7-74ff-4ec0-a9c5-053fbf583424 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:00:41.796996 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-9087e1a7-74ff-4ec0-a9c5-053fbf583424 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] [instance: 6dc56556-ace0-40cd-8f2e-d8fece4412e9] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:00:41.805610 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9087e1a7-74ff-4ec0-a9c5-053fbf583424 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:00:41.806064 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9087e1a7-74ff-4ec0-a9c5-053fbf583424 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:00:41.806864 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9087e1a7-74ff-4ec0-a9c5-053fbf583424 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:00:41.807335 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9087e1a7-74ff-4ec0-a9c5-053fbf583424 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:00:41.997408 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-9087e1a7-74ff-4ec0-a9c5-053fbf583424 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa171a9679a3460bb2ee9369e4051690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ae388052ee406c8d6cc749a1ed8c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:00:42.005981 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-9087e1a7-74ff-4ec0-a9c5-053fbf583424 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] 10.222.0.26 "GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9" status: 200 len: 1257 microversion: 2.1 time: 0.214583 Jul 11 12:00:42.006579 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1518/3032] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:00:41 2022] GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9 => generated 1257 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:00:43.028404 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-e6eaee39-501e-45e7-9c9d-bf1c5aad2c80 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:00:43.029067 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-e6eaee39-501e-45e7-9c9d-bf1c5aad2c80 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] [instance: 6dc56556-ace0-40cd-8f2e-d8fece4412e9] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:00:43.035887 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e6eaee39-501e-45e7-9c9d-bf1c5aad2c80 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:00:43.036567 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e6eaee39-501e-45e7-9c9d-bf1c5aad2c80 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:00:43.038047 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e6eaee39-501e-45e7-9c9d-bf1c5aad2c80 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:00:43.038489 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e6eaee39-501e-45e7-9c9d-bf1c5aad2c80 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:00:43.184803 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-e6eaee39-501e-45e7-9c9d-bf1c5aad2c80 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa171a9679a3460bb2ee9369e4051690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ae388052ee406c8d6cc749a1ed8c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:00:43.195687 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-e6eaee39-501e-45e7-9c9d-bf1c5aad2c80 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] 10.222.0.26 "GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9" status: 200 len: 1257 microversion: 2.1 time: 0.172702 Jul 11 12:00:43.195687 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1515/3033] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:00:43 2022] GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9 => generated 1257 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:00:44.209765 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-1439d372-d477-4b23-a440-9122239b0c8a tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:00:44.210378 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-1439d372-d477-4b23-a440-9122239b0c8a tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] [instance: 6dc56556-ace0-40cd-8f2e-d8fece4412e9] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:00:44.213677 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell0:SELECT=2 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:00:44.214381 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell0:SELECT=6 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:00:44.217933 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1439d372-d477-4b23-a440-9122239b0c8a tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:00:44.218383 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1439d372-d477-4b23-a440-9122239b0c8a tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:00:44.219338 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1439d372-d477-4b23-a440-9122239b0c8a tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:00:44.224352 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1439d372-d477-4b23-a440-9122239b0c8a tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:00:44.375336 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-1439d372-d477-4b23-a440-9122239b0c8a tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa171a9679a3460bb2ee9369e4051690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ae388052ee406c8d6cc749a1ed8c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:00:44.384542 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-1439d372-d477-4b23-a440-9122239b0c8a tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] 10.222.0.26 "GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9" status: 200 len: 1257 microversion: 2.1 time: 0.178159 Jul 11 12:00:44.385059 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1519/3034] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:00:44 2022] GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9 => generated 1257 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:00:45.400854 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-22763813-4fcd-4337-9d0b-f7809a3cf0e0 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:00:45.401467 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-22763813-4fcd-4337-9d0b-f7809a3cf0e0 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] [instance: 6dc56556-ace0-40cd-8f2e-d8fece4412e9] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:00:45.404552 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell0:SELECT=6 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:00:45.409604 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-22763813-4fcd-4337-9d0b-f7809a3cf0e0 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:00:45.412355 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-22763813-4fcd-4337-9d0b-f7809a3cf0e0 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:00:45.419091 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-22763813-4fcd-4337-9d0b-f7809a3cf0e0 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:00:45.419790 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-22763813-4fcd-4337-9d0b-f7809a3cf0e0 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:00:45.566168 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-22763813-4fcd-4337-9d0b-f7809a3cf0e0 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa171a9679a3460bb2ee9369e4051690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ae388052ee406c8d6cc749a1ed8c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:00:45.573958 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-22763813-4fcd-4337-9d0b-f7809a3cf0e0 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] 10.222.0.26 "GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9" status: 200 len: 1257 microversion: 2.1 time: 0.176879 Jul 11 12:00:45.575084 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1516/3035] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:00:45 2022] GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9 => generated 1257 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:00:46.591915 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-7da77040-51b1-4ac7-acf4-4f56b4e0b88e tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:00:46.593178 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-7da77040-51b1-4ac7-acf4-4f56b4e0b88e tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] [instance: 6dc56556-ace0-40cd-8f2e-d8fece4412e9] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:00:46.600188 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7da77040-51b1-4ac7-acf4-4f56b4e0b88e tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:00:46.600715 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7da77040-51b1-4ac7-acf4-4f56b4e0b88e tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:00:46.601489 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7da77040-51b1-4ac7-acf4-4f56b4e0b88e tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:00:46.602074 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7da77040-51b1-4ac7-acf4-4f56b4e0b88e tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:00:46.752107 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-7da77040-51b1-4ac7-acf4-4f56b4e0b88e tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa171a9679a3460bb2ee9369e4051690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ae388052ee406c8d6cc749a1ed8c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:00:46.759605 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-7da77040-51b1-4ac7-acf4-4f56b4e0b88e tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] 10.222.0.26 "GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9" status: 200 len: 1257 microversion: 2.1 time: 0.172234 Jul 11 12:00:46.760172 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1520/3036] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:00:46 2022] GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9 => generated 1257 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:00:47.778248 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-bd320701-8006-487c-8b20-786373a35e1a tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:00:47.778874 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-bd320701-8006-487c-8b20-786373a35e1a tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] [instance: 6dc56556-ace0-40cd-8f2e-d8fece4412e9] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:00:47.785970 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bd320701-8006-487c-8b20-786373a35e1a tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:00:47.786426 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bd320701-8006-487c-8b20-786373a35e1a tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:00:47.787193 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bd320701-8006-487c-8b20-786373a35e1a tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:00:47.787694 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bd320701-8006-487c-8b20-786373a35e1a tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:00:47.926353 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-bd320701-8006-487c-8b20-786373a35e1a tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa171a9679a3460bb2ee9369e4051690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ae388052ee406c8d6cc749a1ed8c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:00:47.934708 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-bd320701-8006-487c-8b20-786373a35e1a tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] 10.222.0.26 "GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9" status: 200 len: 1257 microversion: 2.1 time: 0.161337 Jul 11 12:00:47.935481 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1517/3037] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:00:47 2022] GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9 => generated 1257 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:00:48.951638 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-c0f476ab-5c52-4f91-8062-19bacc9da284 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:00:48.952254 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-c0f476ab-5c52-4f91-8062-19bacc9da284 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] [instance: 6dc56556-ace0-40cd-8f2e-d8fece4412e9] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:00:48.959552 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c0f476ab-5c52-4f91-8062-19bacc9da284 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:00:48.959999 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c0f476ab-5c52-4f91-8062-19bacc9da284 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:00:48.960926 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c0f476ab-5c52-4f91-8062-19bacc9da284 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:00:48.961606 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c0f476ab-5c52-4f91-8062-19bacc9da284 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:00:49.114171 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-c0f476ab-5c52-4f91-8062-19bacc9da284 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa171a9679a3460bb2ee9369e4051690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ae388052ee406c8d6cc749a1ed8c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:00:49.121838 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-c0f476ab-5c52-4f91-8062-19bacc9da284 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] 10.222.0.26 "GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9" status: 200 len: 1257 microversion: 2.1 time: 0.174107 Jul 11 12:00:49.122410 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1521/3038] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:00:48 2022] GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9 => generated 1257 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:00:50.138567 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-a7c6ebe1-525f-4da3-958c-55eeb3b72db1 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:00:50.139148 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-a7c6ebe1-525f-4da3-958c-55eeb3b72db1 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] [instance: 6dc56556-ace0-40cd-8f2e-d8fece4412e9] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:00:50.145626 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a7c6ebe1-525f-4da3-958c-55eeb3b72db1 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:00:50.146068 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a7c6ebe1-525f-4da3-958c-55eeb3b72db1 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:00:50.146821 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a7c6ebe1-525f-4da3-958c-55eeb3b72db1 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:00:50.147268 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a7c6ebe1-525f-4da3-958c-55eeb3b72db1 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:00:50.276116 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-a7c6ebe1-525f-4da3-958c-55eeb3b72db1 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa171a9679a3460bb2ee9369e4051690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ae388052ee406c8d6cc749a1ed8c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:00:50.284132 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-a7c6ebe1-525f-4da3-958c-55eeb3b72db1 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] 10.222.0.26 "GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9" status: 200 len: 1257 microversion: 2.1 time: 0.149385 Jul 11 12:00:50.284937 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1518/3039] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:00:50 2022] GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9 => generated 1257 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:00:50.883282 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [req-4dd3fea5-127e-4f72-ab36-49d950bb8be7 req-c7f7c159-ecef-4bc2-aa42-b47b5538254e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dc56556-ace0-40cd-8f2e-d8fece4412e9", "name": "network-vif-plugged", "status": "completed", "tag": "e8bfdf4d-ab82-479d-85eb-97c40021c54f"}]} {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 12:00:50.893576 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [req-4dd3fea5-127e-4f72-ab36-49d950bb8be7 req-c7f7c159-ecef-4bc2-aa42-b47b5538254e service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:00:50.894029 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [req-4dd3fea5-127e-4f72-ab36-49d950bb8be7 req-c7f7c159-ecef-4bc2-aa42-b47b5538254e service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:00:50.907584 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.compute.server_external_events [req-4dd3fea5-127e-4f72-ab36-49d950bb8be7 req-c7f7c159-ecef-4bc2-aa42-b47b5538254e service nova] Creating event network-vif-plugged:e8bfdf4d-ab82-479d-85eb-97c40021c54f for instance 6dc56556-ace0-40cd-8f2e-d8fece4412e9 on hv-cinder-84842 Jul 11 12:00:50.913220 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [req-4dd3fea5-127e-4f72-ab36-49d950bb8be7 req-c7f7c159-ecef-4bc2-aa42-b47b5538254e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037784 Jul 11 12:00:50.913826 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1522/3040] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 12:00:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 12:00:51.301446 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-95aaed0a-3b76-41ff-97b1-81ac0e4b6e71 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:00:51.301982 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-95aaed0a-3b76-41ff-97b1-81ac0e4b6e71 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] [instance: 6dc56556-ace0-40cd-8f2e-d8fece4412e9] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:00:51.308933 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-95aaed0a-3b76-41ff-97b1-81ac0e4b6e71 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:00:51.309368 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-95aaed0a-3b76-41ff-97b1-81ac0e4b6e71 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:00:51.310372 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-95aaed0a-3b76-41ff-97b1-81ac0e4b6e71 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:00:51.310809 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-95aaed0a-3b76-41ff-97b1-81ac0e4b6e71 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:00:51.520052 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-95aaed0a-3b76-41ff-97b1-81ac0e4b6e71 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa171a9679a3460bb2ee9369e4051690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ae388052ee406c8d6cc749a1ed8c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:00:51.527983 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-95aaed0a-3b76-41ff-97b1-81ac0e4b6e71 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] 10.222.0.26 "GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9" status: 200 len: 1257 microversion: 2.1 time: 0.230255 Jul 11 12:00:51.537449 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1519/3041] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:00:51 2022] GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9 => generated 1257 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:00:52.545117 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-679ba865-5e4b-474b-9d26-3ad1e6237f36 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:00:52.545742 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-679ba865-5e4b-474b-9d26-3ad1e6237f36 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] [instance: 6dc56556-ace0-40cd-8f2e-d8fece4412e9] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:00:52.552013 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-679ba865-5e4b-474b-9d26-3ad1e6237f36 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:00:52.552463 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-679ba865-5e4b-474b-9d26-3ad1e6237f36 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:00:52.553237 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-679ba865-5e4b-474b-9d26-3ad1e6237f36 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:00:52.553673 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-679ba865-5e4b-474b-9d26-3ad1e6237f36 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:00:52.722401 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-679ba865-5e4b-474b-9d26-3ad1e6237f36 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa171a9679a3460bb2ee9369e4051690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ae388052ee406c8d6cc749a1ed8c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:00:52.730284 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-679ba865-5e4b-474b-9d26-3ad1e6237f36 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] 10.222.0.26 "GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9" status: 200 len: 1257 microversion: 2.1 time: 0.189898 Jul 11 12:00:52.731054 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1523/3042] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:00:52 2022] GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9 => generated 1257 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:00:52.845095 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-c20744f2-8203-4206-90f2-b1f5742e1f4b tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1626734680", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1764556180", "security_groups": [{"name": "tempest-secgroup-smoke-242625149"}], "block_device_mapping_v2": [{"uuid": "68c71257-6b93-4612-90ae-cc77325c6063", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "cbf23430-d3c4-4909-b958-81c6ba8296b8"}]}} {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 12:00:52.960384 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.network.neutron [None req-c20744f2-8203-4206-90f2-b1f5742e1f4b tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] validate_networks() for [('cbf23430-d3c4-4909-b958-81c6ba8296b8', None, None, None, None, None)] {{(pid=118321) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 12:00:53.436499 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.virt.hardware [None req-c20744f2-8203-4206-90f2-b1f5742e1f4b tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Flavor limits 0:0:0 {{(pid=118321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 12:00:53.436990 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.virt.hardware [None req-c20744f2-8203-4206-90f2-b1f5742e1f4b tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Image limits 0:0:0 {{(pid=118321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 12:00:53.437553 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.virt.hardware [None req-c20744f2-8203-4206-90f2-b1f5742e1f4b tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Flavor pref 0:0:0 {{(pid=118321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 12:00:53.438055 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.virt.hardware [None req-c20744f2-8203-4206-90f2-b1f5742e1f4b tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Image pref 0:0:0 {{(pid=118321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 12:00:53.438472 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.virt.hardware [None req-c20744f2-8203-4206-90f2-b1f5742e1f4b tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 12:00:53.447481 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c20744f2-8203-4206-90f2-b1f5742e1f4b tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:00:53.447929 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c20744f2-8203-4206-90f2-b1f5742e1f4b tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:00:53.448739 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c20744f2-8203-4206-90f2-b1f5742e1f4b tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:00:53.449849 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c20744f2-8203-4206-90f2-b1f5742e1f4b tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:00:53.466157 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.quota [None req-c20744f2-8203-4206-90f2-b1f5742e1f4b tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Getting quotas for project 79c8c84b3f704d528ea772607da56ddf. Resources: {'cores', 'ram', 'instances'} {{(pid=118321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 12:00:53.470112 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.quota [None req-c20744f2-8203-4206-90f2-b1f5742e1f4b tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Getting quotas for user fccd3de89cd94e5fa4c488c16d993241 and project 79c8c84b3f704d528ea772607da56ddf. Resources: {'cores', 'ram', 'instances'} {{(pid=118321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 12:00:53.529198 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-c20744f2-8203-4206-90f2-b1f5742e1f4b tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Going to run 1 instances... {{(pid=118321) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 12:00:53.531336 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-c20744f2-8203-4206-90f2-b1f5742e1f4b tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] [instance: 929579db-279b-44f9-bdb4-ccac4a6f9b59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='68c71257-6b93-4612-90ae-cc77325c6063',volume_size=None,volume_type=None)] {{(pid=118321) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 12:00:53.747860 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-88070b96-f588-4559-85c5-b8541e6c25f5 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:00:53.748671 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-88070b96-f588-4559-85c5-b8541e6c25f5 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] [instance: 6dc56556-ace0-40cd-8f2e-d8fece4412e9] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:00:53.756824 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-88070b96-f588-4559-85c5-b8541e6c25f5 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:00:53.757271 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-88070b96-f588-4559-85c5-b8541e6c25f5 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:00:53.758032 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-88070b96-f588-4559-85c5-b8541e6c25f5 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:00:53.758461 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-88070b96-f588-4559-85c5-b8541e6c25f5 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:00:53.897722 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-88070b96-f588-4559-85c5-b8541e6c25f5 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa171a9679a3460bb2ee9369e4051690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ae388052ee406c8d6cc749a1ed8c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:00:53.905524 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-88070b96-f588-4559-85c5-b8541e6c25f5 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] 10.222.0.26 "GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9" status: 200 len: 1442 microversion: 2.1 time: 0.162958 Jul 11 12:00:53.906101 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1524/3043] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:00:53 2022] GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9 => generated 1442 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 12:00:53.922736 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-74264136-e2d7-4c71-a828-f7fe2fe282d4 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:00:53.923376 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-74264136-e2d7-4c71-a828-f7fe2fe282d4 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] [instance: 6dc56556-ace0-40cd-8f2e-d8fece4412e9] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:00:53.929542 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-74264136-e2d7-4c71-a828-f7fe2fe282d4 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:00:53.929983 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-74264136-e2d7-4c71-a828-f7fe2fe282d4 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:00:53.930730 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-74264136-e2d7-4c71-a828-f7fe2fe282d4 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:00:53.931158 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-74264136-e2d7-4c71-a828-f7fe2fe282d4 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:00:53.950640 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-c20744f2-8203-4206-90f2-b1f5742e1f4b tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.109121 Jul 11 12:00:53.956320 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1520/3044] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jul 11 12:00:52 2022] POST /compute/v2.1/servers => generated 405 bytes in 1115 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 11 12:00:53.961466 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-b54617aa-a1dd-4aaf-9d53-d1909dc0a495 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:00:53.962294 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-b54617aa-a1dd-4aaf-9d53-d1909dc0a495 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] [instance: 929579db-279b-44f9-bdb4-ccac4a6f9b59] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:00:54.017018 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-b54617aa-a1dd-4aaf-9d53-d1909dc0a495 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccd3de89cd94e5fa4c488c16d993241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c8c84b3f704d528ea772607da56ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:00:54.023868 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-b54617aa-a1dd-4aaf-9d53-d1909dc0a495 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] 10.222.0.26 "GET /compute/v2.1/servers/929579db-279b-44f9-bdb4-ccac4a6f9b59" status: 200 len: 1095 microversion: 2.1 time: 0.066216 Jul 11 12:00:54.024456 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1521/3045] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:00:53 2022] GET /compute/v2.1/servers/929579db-279b-44f9-bdb4-ccac4a6f9b59 => generated 1095 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:00:54.113013 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-74264136-e2d7-4c71-a828-f7fe2fe282d4 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa171a9679a3460bb2ee9369e4051690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ae388052ee406c8d6cc749a1ed8c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:00:54.125225 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-74264136-e2d7-4c71-a828-f7fe2fe282d4 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] 10.222.0.26 "GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9" status: 200 len: 1442 microversion: 2.1 time: 0.205842 Jul 11 12:00:54.126467 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1525/3046] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:00:53 2022] GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9 => generated 1442 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:00:55.044229 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-fde5e96a-374d-44e8-b48b-3fd6c60966ff tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:00:55.044829 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-fde5e96a-374d-44e8-b48b-3fd6c60966ff tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] [instance: 929579db-279b-44f9-bdb4-ccac4a6f9b59] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:00:55.135019 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-fde5e96a-374d-44e8-b48b-3fd6c60966ff tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccd3de89cd94e5fa4c488c16d993241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c8c84b3f704d528ea772607da56ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:00:55.142293 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-fde5e96a-374d-44e8-b48b-3fd6c60966ff tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] 10.222.0.26 "GET /compute/v2.1/servers/929579db-279b-44f9-bdb4-ccac4a6f9b59" status: 200 len: 1095 microversion: 2.1 time: 0.101895 Jul 11 12:00:55.142861 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1522/3047] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:00:55 2022] GET /compute/v2.1/servers/929579db-279b-44f9-bdb4-ccac4a6f9b59 => generated 1095 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:00:56.161046 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-7eeb57c8-3409-450a-9c2a-04776b818e50 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:00:56.161616 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-7eeb57c8-3409-450a-9c2a-04776b818e50 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] [instance: 929579db-279b-44f9-bdb4-ccac4a6f9b59] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:00:56.168062 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7eeb57c8-3409-450a-9c2a-04776b818e50 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:00:56.168522 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7eeb57c8-3409-450a-9c2a-04776b818e50 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:00:56.169303 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7eeb57c8-3409-450a-9c2a-04776b818e50 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:00:56.169745 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7eeb57c8-3409-450a-9c2a-04776b818e50 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:00:56.232231 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-7eeb57c8-3409-450a-9c2a-04776b818e50 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccd3de89cd94e5fa4c488c16d993241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c8c84b3f704d528ea772607da56ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:00:56.239645 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-7eeb57c8-3409-450a-9c2a-04776b818e50 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] 10.222.0.26 "GET /compute/v2.1/servers/929579db-279b-44f9-bdb4-ccac4a6f9b59" status: 200 len: 1193 microversion: 2.1 time: 0.082644 Jul 11 12:00:56.240214 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1526/3048] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:00:56 2022] GET /compute/v2.1/servers/929579db-279b-44f9-bdb4-ccac4a6f9b59 => generated 1193 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:00:56.468745 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [req-91dc492e-e398-4fa7-b715-f84d5bf602c3 req-8aed0551-f71b-4bdd-9455-603a7daef575 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dc56556-ace0-40cd-8f2e-d8fece4412e9", "tag": "e8bfdf4d-ab82-479d-85eb-97c40021c54f"}]} {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 12:00:56.481235 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [req-91dc492e-e398-4fa7-b715-f84d5bf602c3 req-8aed0551-f71b-4bdd-9455-603a7daef575 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:00:56.481235 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [req-91dc492e-e398-4fa7-b715-f84d5bf602c3 req-8aed0551-f71b-4bdd-9455-603a7daef575 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:00:56.491640 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.compute.server_external_events [req-91dc492e-e398-4fa7-b715-f84d5bf602c3 req-8aed0551-f71b-4bdd-9455-603a7daef575 service nova] Creating event network-changed:e8bfdf4d-ab82-479d-85eb-97c40021c54f for instance 6dc56556-ace0-40cd-8f2e-d8fece4412e9 on hv-cinder-84842 Jul 11 12:00:56.497774 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [req-91dc492e-e398-4fa7-b715-f84d5bf602c3 req-8aed0551-f71b-4bdd-9455-603a7daef575 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033435 Jul 11 12:00:56.498551 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1523/3049] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 12:00:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 12:00:57.259791 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-c68337cc-da6d-4848-b510-0fcc0ef72b10 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:00:57.260417 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-c68337cc-da6d-4848-b510-0fcc0ef72b10 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] [instance: 929579db-279b-44f9-bdb4-ccac4a6f9b59] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:00:57.268366 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c68337cc-da6d-4848-b510-0fcc0ef72b10 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:00:57.268832 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c68337cc-da6d-4848-b510-0fcc0ef72b10 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:00:57.269622 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c68337cc-da6d-4848-b510-0fcc0ef72b10 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:00:57.270220 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c68337cc-da6d-4848-b510-0fcc0ef72b10 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:00:57.363139 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-c68337cc-da6d-4848-b510-0fcc0ef72b10 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccd3de89cd94e5fa4c488c16d993241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c8c84b3f704d528ea772607da56ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:00:57.375975 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-c68337cc-da6d-4848-b510-0fcc0ef72b10 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] 10.222.0.26 "GET /compute/v2.1/servers/929579db-279b-44f9-bdb4-ccac4a6f9b59" status: 200 len: 1211 microversion: 2.1 time: 0.119905 Jul 11 12:00:57.377339 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1527/3050] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:00:57 2022] GET /compute/v2.1/servers/929579db-279b-44f9-bdb4-ccac4a6f9b59 => generated 1211 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 12:00:58.394065 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-a47dc11f-291c-40d7-bc54-1b02ed2c8a68 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:00:58.394784 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-a47dc11f-291c-40d7-bc54-1b02ed2c8a68 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] [instance: 929579db-279b-44f9-bdb4-ccac4a6f9b59] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:00:58.404308 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a47dc11f-291c-40d7-bc54-1b02ed2c8a68 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:00:58.404308 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a47dc11f-291c-40d7-bc54-1b02ed2c8a68 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:00:58.405125 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a47dc11f-291c-40d7-bc54-1b02ed2c8a68 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:00:58.405565 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a47dc11f-291c-40d7-bc54-1b02ed2c8a68 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:00:58.612135 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-a47dc11f-291c-40d7-bc54-1b02ed2c8a68 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccd3de89cd94e5fa4c488c16d993241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c8c84b3f704d528ea772607da56ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:00:58.619715 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-a47dc11f-291c-40d7-bc54-1b02ed2c8a68 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] 10.222.0.26 "GET /compute/v2.1/servers/929579db-279b-44f9-bdb4-ccac4a6f9b59" status: 200 len: 1266 microversion: 2.1 time: 0.230487 Jul 11 12:00:58.620374 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1524/3051] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:00:58 2022] GET /compute/v2.1/servers/929579db-279b-44f9-bdb4-ccac4a6f9b59 => generated 1266 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:00:59.067620 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [req-96546b89-3789-461a-af8a-fbe89f5f01a3 req-5dfb00af-c86e-45ee-923f-fbb7a189ad0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "929579db-279b-44f9-bdb4-ccac4a6f9b59", "tag": "0db96d4f-53ea-428e-8092-56b0e11d97b5"}]} {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 12:00:59.089039 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [req-96546b89-3789-461a-af8a-fbe89f5f01a3 req-5dfb00af-c86e-45ee-923f-fbb7a189ad0c service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:00:59.090221 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [req-96546b89-3789-461a-af8a-fbe89f5f01a3 req-5dfb00af-c86e-45ee-923f-fbb7a189ad0c service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:00:59.101657 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.compute.server_external_events [req-96546b89-3789-461a-af8a-fbe89f5f01a3 req-5dfb00af-c86e-45ee-923f-fbb7a189ad0c service nova] Creating event network-changed:0db96d4f-53ea-428e-8092-56b0e11d97b5 for instance 929579db-279b-44f9-bdb4-ccac4a6f9b59 on hv-cinder-84842 Jul 11 12:00:59.112744 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [req-96546b89-3789-461a-af8a-fbe89f5f01a3 req-5dfb00af-c86e-45ee-923f-fbb7a189ad0c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049928 Jul 11 12:00:59.113698 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1528/3052] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 12:00:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 12:00:59.640364 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-bec5fc2b-24c5-4b6e-b4a0-3db87cb522c9 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:00:59.640971 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-bec5fc2b-24c5-4b6e-b4a0-3db87cb522c9 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] [instance: 929579db-279b-44f9-bdb4-ccac4a6f9b59] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:00:59.647503 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bec5fc2b-24c5-4b6e-b4a0-3db87cb522c9 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:00:59.647949 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bec5fc2b-24c5-4b6e-b4a0-3db87cb522c9 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:00:59.648764 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bec5fc2b-24c5-4b6e-b4a0-3db87cb522c9 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:00:59.649203 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bec5fc2b-24c5-4b6e-b4a0-3db87cb522c9 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:00:59.879162 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-bec5fc2b-24c5-4b6e-b4a0-3db87cb522c9 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccd3de89cd94e5fa4c488c16d993241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c8c84b3f704d528ea772607da56ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:00:59.887395 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-bec5fc2b-24c5-4b6e-b4a0-3db87cb522c9 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] 10.222.0.26 "GET /compute/v2.1/servers/929579db-279b-44f9-bdb4-ccac4a6f9b59" status: 200 len: 1266 microversion: 2.1 time: 0.250084 Jul 11 12:00:59.887395 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1525/3053] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:00:59 2022] GET /compute/v2.1/servers/929579db-279b-44f9-bdb4-ccac4a6f9b59 => generated 1266 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 12:01:00.907399 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-60536e45-e85b-44c6-b7af-43a4aaa970a2 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:01:00.908102 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-60536e45-e85b-44c6-b7af-43a4aaa970a2 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] [instance: 929579db-279b-44f9-bdb4-ccac4a6f9b59] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:01:00.915600 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-60536e45-e85b-44c6-b7af-43a4aaa970a2 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:01:00.918922 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-60536e45-e85b-44c6-b7af-43a4aaa970a2 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:01:00.918922 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-60536e45-e85b-44c6-b7af-43a4aaa970a2 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:01:00.918922 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-60536e45-e85b-44c6-b7af-43a4aaa970a2 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:01:01.053789 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-60536e45-e85b-44c6-b7af-43a4aaa970a2 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccd3de89cd94e5fa4c488c16d993241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c8c84b3f704d528ea772607da56ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:01:01.062281 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-60536e45-e85b-44c6-b7af-43a4aaa970a2 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] 10.222.0.26 "GET /compute/v2.1/servers/929579db-279b-44f9-bdb4-ccac4a6f9b59" status: 200 len: 1266 microversion: 2.1 time: 0.159426 Jul 11 12:01:01.062815 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1529/3054] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:01:00 2022] GET /compute/v2.1/servers/929579db-279b-44f9-bdb4-ccac4a6f9b59 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:01:02.080474 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-7e4d666e-2a3f-45b5-b212-0e86514f9761 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:01:02.081826 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-7e4d666e-2a3f-45b5-b212-0e86514f9761 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] [instance: 929579db-279b-44f9-bdb4-ccac4a6f9b59] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:01:02.087913 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7e4d666e-2a3f-45b5-b212-0e86514f9761 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:01:02.088354 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7e4d666e-2a3f-45b5-b212-0e86514f9761 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:01:02.089101 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7e4d666e-2a3f-45b5-b212-0e86514f9761 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:01:02.089571 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7e4d666e-2a3f-45b5-b212-0e86514f9761 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:01:02.222633 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-7e4d666e-2a3f-45b5-b212-0e86514f9761 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccd3de89cd94e5fa4c488c16d993241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c8c84b3f704d528ea772607da56ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:01:02.230169 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-7e4d666e-2a3f-45b5-b212-0e86514f9761 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] 10.222.0.26 "GET /compute/v2.1/servers/929579db-279b-44f9-bdb4-ccac4a6f9b59" status: 200 len: 1266 microversion: 2.1 time: 0.154313 Jul 11 12:01:02.230896 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1526/3055] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:01:02 2022] GET /compute/v2.1/servers/929579db-279b-44f9-bdb4-ccac4a6f9b59 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:01:03.246700 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-c66d1912-cc07-448b-9bd9-74f307f18610 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:01:03.247349 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-c66d1912-cc07-448b-9bd9-74f307f18610 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] [instance: 929579db-279b-44f9-bdb4-ccac4a6f9b59] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:01:03.254409 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c66d1912-cc07-448b-9bd9-74f307f18610 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:01:03.254777 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c66d1912-cc07-448b-9bd9-74f307f18610 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:01:03.255584 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c66d1912-cc07-448b-9bd9-74f307f18610 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:01:03.256021 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c66d1912-cc07-448b-9bd9-74f307f18610 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:01:03.393786 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-c66d1912-cc07-448b-9bd9-74f307f18610 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccd3de89cd94e5fa4c488c16d993241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c8c84b3f704d528ea772607da56ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:01:03.402151 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-c66d1912-cc07-448b-9bd9-74f307f18610 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] 10.222.0.26 "GET /compute/v2.1/servers/929579db-279b-44f9-bdb4-ccac4a6f9b59" status: 200 len: 1266 microversion: 2.1 time: 0.159363 Jul 11 12:01:03.402746 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1530/3056] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:01:03 2022] GET /compute/v2.1/servers/929579db-279b-44f9-bdb4-ccac4a6f9b59 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:01:04.421639 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-953a582c-ffef-49e5-9851-2a92bed9c410 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:01:04.422294 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-953a582c-ffef-49e5-9851-2a92bed9c410 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] [instance: 929579db-279b-44f9-bdb4-ccac4a6f9b59] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:01:04.424790 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell0:SELECT=2 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:01:04.425481 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=4 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:01:04.430263 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-953a582c-ffef-49e5-9851-2a92bed9c410 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:01:04.430712 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-953a582c-ffef-49e5-9851-2a92bed9c410 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:01:04.431495 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-953a582c-ffef-49e5-9851-2a92bed9c410 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:01:04.431925 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-953a582c-ffef-49e5-9851-2a92bed9c410 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:01:04.434454 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=68 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:01:04.578607 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-953a582c-ffef-49e5-9851-2a92bed9c410 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccd3de89cd94e5fa4c488c16d993241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c8c84b3f704d528ea772607da56ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:01:04.591385 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-953a582c-ffef-49e5-9851-2a92bed9c410 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] 10.222.0.26 "GET /compute/v2.1/servers/929579db-279b-44f9-bdb4-ccac4a6f9b59" status: 200 len: 1266 microversion: 2.1 time: 0.168877 Jul 11 12:01:04.591385 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1527/3057] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:01:04 2022] GET /compute/v2.1/servers/929579db-279b-44f9-bdb4-ccac4a6f9b59 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:01:05.605087 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-e563fd9d-024a-41c2-9b49-2075a51f6e37 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:01:05.605688 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-e563fd9d-024a-41c2-9b49-2075a51f6e37 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] [instance: 929579db-279b-44f9-bdb4-ccac4a6f9b59] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:01:05.608180 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:01:05.613153 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e563fd9d-024a-41c2-9b49-2075a51f6e37 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:01:05.616558 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e563fd9d-024a-41c2-9b49-2075a51f6e37 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:01:05.616558 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e563fd9d-024a-41c2-9b49-2075a51f6e37 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:01:05.616558 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-e563fd9d-024a-41c2-9b49-2075a51f6e37 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:01:05.620051 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=91 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:01:05.752223 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-e563fd9d-024a-41c2-9b49-2075a51f6e37 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccd3de89cd94e5fa4c488c16d993241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c8c84b3f704d528ea772607da56ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:01:05.760548 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-e563fd9d-024a-41c2-9b49-2075a51f6e37 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] 10.222.0.26 "GET /compute/v2.1/servers/929579db-279b-44f9-bdb4-ccac4a6f9b59" status: 200 len: 1266 microversion: 2.1 time: 0.159257 Jul 11 12:01:05.761476 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1531/3058] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:01:05 2022] GET /compute/v2.1/servers/929579db-279b-44f9-bdb4-ccac4a6f9b59 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:01:06.784841 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-c2da66ce-0011-441a-beb6-6c8a07bc217a tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:01:06.786349 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-c2da66ce-0011-441a-beb6-6c8a07bc217a tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] [instance: 929579db-279b-44f9-bdb4-ccac4a6f9b59] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:01:06.790506 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell0:SELECT=10 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:01:06.797129 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c2da66ce-0011-441a-beb6-6c8a07bc217a tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:01:06.798188 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c2da66ce-0011-441a-beb6-6c8a07bc217a tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:01:06.799119 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c2da66ce-0011-441a-beb6-6c8a07bc217a tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:01:06.799724 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c2da66ce-0011-441a-beb6-6c8a07bc217a tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:01:06.952008 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-c2da66ce-0011-441a-beb6-6c8a07bc217a tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccd3de89cd94e5fa4c488c16d993241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c8c84b3f704d528ea772607da56ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:01:06.959387 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-c2da66ce-0011-441a-beb6-6c8a07bc217a tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] 10.222.0.26 "GET /compute/v2.1/servers/929579db-279b-44f9-bdb4-ccac4a6f9b59" status: 200 len: 1266 microversion: 2.1 time: 0.180953 Jul 11 12:01:06.959976 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1528/3059] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:01:06 2022] GET /compute/v2.1/servers/929579db-279b-44f9-bdb4-ccac4a6f9b59 => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:01:07.976479 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-f8c31783-defe-4815-aec4-e4e8f9c75bd6 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:01:07.977054 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-f8c31783-defe-4815-aec4-e4e8f9c75bd6 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] [instance: 929579db-279b-44f9-bdb4-ccac4a6f9b59] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:01:07.985505 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f8c31783-defe-4815-aec4-e4e8f9c75bd6 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:01:07.985954 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f8c31783-defe-4815-aec4-e4e8f9c75bd6 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:01:07.986734 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f8c31783-defe-4815-aec4-e4e8f9c75bd6 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:01:07.987167 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f8c31783-defe-4815-aec4-e4e8f9c75bd6 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:01:08.130902 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-f8c31783-defe-4815-aec4-e4e8f9c75bd6 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccd3de89cd94e5fa4c488c16d993241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c8c84b3f704d528ea772607da56ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:01:08.138401 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-f8c31783-defe-4815-aec4-e4e8f9c75bd6 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] 10.222.0.26 "GET /compute/v2.1/servers/929579db-279b-44f9-bdb4-ccac4a6f9b59" status: 200 len: 1266 microversion: 2.1 time: 0.165826 Jul 11 12:01:08.138973 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1532/3060] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:01:07 2022] GET /compute/v2.1/servers/929579db-279b-44f9-bdb4-ccac4a6f9b59 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:01:08.958576 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [req-e48c0b0d-199d-44a9-a422-fd6de2105dac req-58d5d9d9-e464-428d-a80b-b0c08f7d9ae5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "929579db-279b-44f9-bdb4-ccac4a6f9b59", "name": "network-vif-plugged", "status": "completed", "tag": "0db96d4f-53ea-428e-8092-56b0e11d97b5"}]} {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 12:01:08.967525 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [req-e48c0b0d-199d-44a9-a422-fd6de2105dac req-58d5d9d9-e464-428d-a80b-b0c08f7d9ae5 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:01:08.968025 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [req-e48c0b0d-199d-44a9-a422-fd6de2105dac req-58d5d9d9-e464-428d-a80b-b0c08f7d9ae5 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:01:08.978903 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.compute.server_external_events [req-e48c0b0d-199d-44a9-a422-fd6de2105dac req-58d5d9d9-e464-428d-a80b-b0c08f7d9ae5 service nova] Creating event network-vif-plugged:0db96d4f-53ea-428e-8092-56b0e11d97b5 for instance 929579db-279b-44f9-bdb4-ccac4a6f9b59 on hv-cinder-84842 Jul 11 12:01:08.984154 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [req-e48c0b0d-199d-44a9-a422-fd6de2105dac req-58d5d9d9-e464-428d-a80b-b0c08f7d9ae5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029454 Jul 11 12:01:08.990165 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1529/3061] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 12:01:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 12:01:09.157925 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-301a22ed-7c4f-4e76-b2fc-3f3c9098402e tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:01:09.158540 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-301a22ed-7c4f-4e76-b2fc-3f3c9098402e tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] [instance: 929579db-279b-44f9-bdb4-ccac4a6f9b59] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:01:09.165052 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-301a22ed-7c4f-4e76-b2fc-3f3c9098402e tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:01:09.165497 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-301a22ed-7c4f-4e76-b2fc-3f3c9098402e tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:01:09.166436 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-301a22ed-7c4f-4e76-b2fc-3f3c9098402e tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:01:09.166858 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-301a22ed-7c4f-4e76-b2fc-3f3c9098402e tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:01:09.315122 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-301a22ed-7c4f-4e76-b2fc-3f3c9098402e tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccd3de89cd94e5fa4c488c16d993241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c8c84b3f704d528ea772607da56ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:01:09.323366 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-301a22ed-7c4f-4e76-b2fc-3f3c9098402e tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] 10.222.0.26 "GET /compute/v2.1/servers/929579db-279b-44f9-bdb4-ccac4a6f9b59" status: 200 len: 1266 microversion: 2.1 time: 0.169340 Jul 11 12:01:09.332750 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1533/3062] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:01:09 2022] GET /compute/v2.1/servers/929579db-279b-44f9-bdb4-ccac4a6f9b59 => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:01:10.341018 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-3d435261-34ca-4f3b-97f5-b9423c10c5bd tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:01:10.341725 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-3d435261-34ca-4f3b-97f5-b9423c10c5bd tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] [instance: 929579db-279b-44f9-bdb4-ccac4a6f9b59] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:01:10.349556 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3d435261-34ca-4f3b-97f5-b9423c10c5bd tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:01:10.350004 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3d435261-34ca-4f3b-97f5-b9423c10c5bd tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:01:10.350763 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3d435261-34ca-4f3b-97f5-b9423c10c5bd tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:01:10.351195 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3d435261-34ca-4f3b-97f5-b9423c10c5bd tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:01:10.481371 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-3d435261-34ca-4f3b-97f5-b9423c10c5bd tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccd3de89cd94e5fa4c488c16d993241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c8c84b3f704d528ea772607da56ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:01:10.488862 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-3d435261-34ca-4f3b-97f5-b9423c10c5bd tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] 10.222.0.26 "GET /compute/v2.1/servers/929579db-279b-44f9-bdb4-ccac4a6f9b59" status: 200 len: 1266 microversion: 2.1 time: 0.152410 Jul 11 12:01:10.489464 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1530/3063] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:01:10 2022] GET /compute/v2.1/servers/929579db-279b-44f9-bdb4-ccac4a6f9b59 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:01:11.505927 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-11212825-9a55-4b96-8865-41bd704c8573 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:01:11.506547 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-11212825-9a55-4b96-8865-41bd704c8573 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] [instance: 929579db-279b-44f9-bdb4-ccac4a6f9b59] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:01:11.513048 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-11212825-9a55-4b96-8865-41bd704c8573 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:01:11.513502 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-11212825-9a55-4b96-8865-41bd704c8573 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:01:11.514263 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-11212825-9a55-4b96-8865-41bd704c8573 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:01:11.514703 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-11212825-9a55-4b96-8865-41bd704c8573 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:01:11.644932 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-11212825-9a55-4b96-8865-41bd704c8573 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccd3de89cd94e5fa4c488c16d993241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c8c84b3f704d528ea772607da56ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:01:11.652637 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-11212825-9a55-4b96-8865-41bd704c8573 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] 10.222.0.26 "GET /compute/v2.1/servers/929579db-279b-44f9-bdb4-ccac4a6f9b59" status: 200 len: 1452 microversion: 2.1 time: 0.150652 Jul 11 12:01:11.653228 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1534/3064] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:01:11 2022] GET /compute/v2.1/servers/929579db-279b-44f9-bdb4-ccac4a6f9b59 => generated 1452 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:01:11.668465 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-a689fd2b-269e-4eab-99ae-f1a63f79cd78 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:01:11.669069 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-a689fd2b-269e-4eab-99ae-f1a63f79cd78 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] [instance: 929579db-279b-44f9-bdb4-ccac4a6f9b59] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:01:11.675953 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a689fd2b-269e-4eab-99ae-f1a63f79cd78 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:01:11.676396 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a689fd2b-269e-4eab-99ae-f1a63f79cd78 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:01:11.677142 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a689fd2b-269e-4eab-99ae-f1a63f79cd78 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:01:11.677570 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a689fd2b-269e-4eab-99ae-f1a63f79cd78 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:01:11.808708 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-a689fd2b-269e-4eab-99ae-f1a63f79cd78 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccd3de89cd94e5fa4c488c16d993241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c8c84b3f704d528ea772607da56ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:01:11.816702 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-a689fd2b-269e-4eab-99ae-f1a63f79cd78 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] 10.222.0.26 "GET /compute/v2.1/servers/929579db-279b-44f9-bdb4-ccac4a6f9b59" status: 200 len: 1452 microversion: 2.1 time: 0.152311 Jul 11 12:01:11.817262 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1531/3065] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:01:11 2022] GET /compute/v2.1/servers/929579db-279b-44f9-bdb4-ccac4a6f9b59 => generated 1452 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:01:14.112753 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [req-02ed98a0-d276-4f1d-9718-b17bfbf47c31 req-73b13a1d-cba9-4f5f-b32c-8a175adc0fd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "929579db-279b-44f9-bdb4-ccac4a6f9b59", "tag": "0db96d4f-53ea-428e-8092-56b0e11d97b5"}]} {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 12:01:14.121162 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [req-02ed98a0-d276-4f1d-9718-b17bfbf47c31 req-73b13a1d-cba9-4f5f-b32c-8a175adc0fd7 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:01:14.121608 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [req-02ed98a0-d276-4f1d-9718-b17bfbf47c31 req-73b13a1d-cba9-4f5f-b32c-8a175adc0fd7 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:01:14.132600 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.compute.server_external_events [req-02ed98a0-d276-4f1d-9718-b17bfbf47c31 req-73b13a1d-cba9-4f5f-b32c-8a175adc0fd7 service nova] Creating event network-changed:0db96d4f-53ea-428e-8092-56b0e11d97b5 for instance 929579db-279b-44f9-bdb4-ccac4a6f9b59 on hv-cinder-84842 Jul 11 12:01:14.137449 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [req-02ed98a0-d276-4f1d-9718-b17bfbf47c31 req-73b13a1d-cba9-4f5f-b32c-8a175adc0fd7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028337 Jul 11 12:01:14.138246 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1535/3066] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 12:01:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 12:02:39.045194 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 12:02:39.045870 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Mon Jul 11 12:02:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 12:03:03.699983 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 12:03:03.700560 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Mon Jul 11 12:03:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 12:03:12.284426 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_api:SELECT=9 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:03:12.285169 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=25 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:03:12.289092 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-11433beb-97fd-40b7-97b2-69f00f815689 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 12:03:12.289616 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-11433beb-97fd-40b7-97b2-69f00f815689 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] [instance: 6dc56556-ace0-40cd-8f2e-d8fece4412e9] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:03:12.295405 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-11433beb-97fd-40b7-97b2-69f00f815689 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:12.302400 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-11433beb-97fd-40b7-97b2-69f00f815689 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:12.302400 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-11433beb-97fd-40b7-97b2-69f00f815689 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:12.302400 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-11433beb-97fd-40b7-97b2-69f00f815689 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:12.318843 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.objects.instance [None req-11433beb-97fd-40b7-97b2-69f00f815689 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lazy-loading 'flavor' on Instance uuid 6dc56556-ace0-40cd-8f2e-d8fece4412e9 {{(pid=118321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 12:03:12.595126 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-11433beb-97fd-40b7-97b2-69f00f815689 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] 10.222.0.26 "POST /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9/action" status: 202 len: 0 microversion: 2.1 time: 0.312187 Jul 11 12:03:12.595743 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1532/3067] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Jul 11 12:03:12 2022] POST /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9/action => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 12:03:12.603061 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR oslo.messaging._drivers.impl_rabbit [-] [73153c7c-8222-4333-b8ec-ad525dae098f] AMQP server on 10.222.0.26:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 11 12:03:12.603712 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_api:SELECT=9 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:03:12.604472 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=25 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:03:12.608853 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-cebc3fb9-729c-453d-9d60-54bc0521ba88 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:03:12.609523 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-cebc3fb9-729c-453d-9d60-54bc0521ba88 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] [instance: 6dc56556-ace0-40cd-8f2e-d8fece4412e9] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:03:12.615571 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cebc3fb9-729c-453d-9d60-54bc0521ba88 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:12.616019 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cebc3fb9-729c-453d-9d60-54bc0521ba88 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:12.616784 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cebc3fb9-729c-453d-9d60-54bc0521ba88 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:12.617215 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-cebc3fb9-729c-453d-9d60-54bc0521ba88 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:12.749472 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-cebc3fb9-729c-453d-9d60-54bc0521ba88 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa171a9679a3460bb2ee9369e4051690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ae388052ee406c8d6cc749a1ed8c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:03:12.757408 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-cebc3fb9-729c-453d-9d60-54bc0521ba88 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] 10.222.0.26 "GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9" status: 200 len: 1567 microversion: 2.1 time: 0.157139 Jul 11 12:03:12.760871 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1536/3068] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:03:12 2022] GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:03:13.776550 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-2417fe89-441e-41ee-b4ce-42a0809ea644 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:03:13.777281 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-2417fe89-441e-41ee-b4ce-42a0809ea644 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] [instance: 6dc56556-ace0-40cd-8f2e-d8fece4412e9] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:03:13.784127 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2417fe89-441e-41ee-b4ce-42a0809ea644 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:13.784575 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2417fe89-441e-41ee-b4ce-42a0809ea644 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:13.785329 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2417fe89-441e-41ee-b4ce-42a0809ea644 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:13.785761 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2417fe89-441e-41ee-b4ce-42a0809ea644 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:13.912930 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-2417fe89-441e-41ee-b4ce-42a0809ea644 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa171a9679a3460bb2ee9369e4051690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ae388052ee406c8d6cc749a1ed8c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:03:13.920413 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-2417fe89-441e-41ee-b4ce-42a0809ea644 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] 10.222.0.26 "GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9" status: 200 len: 1567 microversion: 2.1 time: 0.148803 Jul 11 12:03:13.920972 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1533/3069] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:03:13 2022] GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9 => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:03:14.937336 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-d2ed44db-6e1e-42d2-82e5-df027b7ce1ef tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:03:14.937960 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-d2ed44db-6e1e-42d2-82e5-df027b7ce1ef tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] [instance: 6dc56556-ace0-40cd-8f2e-d8fece4412e9] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:03:14.949576 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d2ed44db-6e1e-42d2-82e5-df027b7ce1ef tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:14.950041 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d2ed44db-6e1e-42d2-82e5-df027b7ce1ef tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:14.950798 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d2ed44db-6e1e-42d2-82e5-df027b7ce1ef tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:14.951228 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d2ed44db-6e1e-42d2-82e5-df027b7ce1ef tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:14.951862 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO oslo.messaging._drivers.impl_rabbit [-] [73153c7c-8222-4333-b8ec-ad525dae098f] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 52580. Jul 11 12:03:15.083569 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-d2ed44db-6e1e-42d2-82e5-df027b7ce1ef tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa171a9679a3460bb2ee9369e4051690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ae388052ee406c8d6cc749a1ed8c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:03:15.091028 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-d2ed44db-6e1e-42d2-82e5-df027b7ce1ef tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] 10.222.0.26 "GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9" status: 200 len: 1567 microversion: 2.1 time: 0.157489 Jul 11 12:03:15.091581 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1537/3070] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:03:14 2022] GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:03:16.108086 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-7eb0ecb6-daba-4464-90fe-1d2a255842ea tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:03:16.108703 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-7eb0ecb6-daba-4464-90fe-1d2a255842ea tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] [instance: 6dc56556-ace0-40cd-8f2e-d8fece4412e9] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:03:16.115125 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7eb0ecb6-daba-4464-90fe-1d2a255842ea tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:16.115603 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7eb0ecb6-daba-4464-90fe-1d2a255842ea tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:16.116364 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7eb0ecb6-daba-4464-90fe-1d2a255842ea tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:16.116794 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-7eb0ecb6-daba-4464-90fe-1d2a255842ea tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:16.330078 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-7eb0ecb6-daba-4464-90fe-1d2a255842ea tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa171a9679a3460bb2ee9369e4051690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ae388052ee406c8d6cc749a1ed8c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:03:16.338232 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-7eb0ecb6-daba-4464-90fe-1d2a255842ea tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] 10.222.0.26 "GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9" status: 200 len: 1567 microversion: 2.1 time: 0.233980 Jul 11 12:03:16.338809 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1534/3071] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:03:16 2022] GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9 => generated 1567 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:03:17.354569 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-31209375-4e29-4ce5-a227-0acd5416a22b tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:03:17.355175 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-31209375-4e29-4ce5-a227-0acd5416a22b tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] [instance: 6dc56556-ace0-40cd-8f2e-d8fece4412e9] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:03:17.361626 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-31209375-4e29-4ce5-a227-0acd5416a22b tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:17.362071 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-31209375-4e29-4ce5-a227-0acd5416a22b tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:17.362818 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-31209375-4e29-4ce5-a227-0acd5416a22b tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:17.363268 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-31209375-4e29-4ce5-a227-0acd5416a22b tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:17.490964 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-31209375-4e29-4ce5-a227-0acd5416a22b tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa171a9679a3460bb2ee9369e4051690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ae388052ee406c8d6cc749a1ed8c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:03:17.498361 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-31209375-4e29-4ce5-a227-0acd5416a22b tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] 10.222.0.26 "GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9" status: 200 len: 1567 microversion: 2.1 time: 0.147615 Jul 11 12:03:17.498917 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1538/3072] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:03:17 2022] GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9 => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:03:18.515517 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-f131738a-623c-45b2-83e6-7d8f5115d115 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:03:18.516122 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-f131738a-623c-45b2-83e6-7d8f5115d115 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] [instance: 6dc56556-ace0-40cd-8f2e-d8fece4412e9] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:03:18.524068 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f131738a-623c-45b2-83e6-7d8f5115d115 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:18.524512 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f131738a-623c-45b2-83e6-7d8f5115d115 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:18.525260 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f131738a-623c-45b2-83e6-7d8f5115d115 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:18.525689 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-f131738a-623c-45b2-83e6-7d8f5115d115 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:18.654904 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-f131738a-623c-45b2-83e6-7d8f5115d115 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa171a9679a3460bb2ee9369e4051690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ae388052ee406c8d6cc749a1ed8c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:03:18.662873 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-f131738a-623c-45b2-83e6-7d8f5115d115 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] 10.222.0.26 "GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9" status: 200 len: 1567 microversion: 2.1 time: 0.151346 Jul 11 12:03:18.663471 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1535/3073] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:03:18 2022] GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:03:19.680485 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-26309dd9-fac1-47d3-a3a4-4c304d165004 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:03:19.681090 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-26309dd9-fac1-47d3-a3a4-4c304d165004 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] [instance: 6dc56556-ace0-40cd-8f2e-d8fece4412e9] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:03:19.687630 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-26309dd9-fac1-47d3-a3a4-4c304d165004 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:19.688075 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-26309dd9-fac1-47d3-a3a4-4c304d165004 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:19.688830 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-26309dd9-fac1-47d3-a3a4-4c304d165004 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:19.689259 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-26309dd9-fac1-47d3-a3a4-4c304d165004 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:19.816452 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-26309dd9-fac1-47d3-a3a4-4c304d165004 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa171a9679a3460bb2ee9369e4051690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ae388052ee406c8d6cc749a1ed8c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:03:19.823806 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-26309dd9-fac1-47d3-a3a4-4c304d165004 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] 10.222.0.26 "GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9" status: 200 len: 1567 microversion: 2.1 time: 0.147226 Jul 11 12:03:19.824367 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1539/3074] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:03:19 2022] GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9 => generated 1567 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:03:20.094878 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-5ed584fd-b6a7-4ded-94b5-04d0915499cd tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:03:20.095410 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-5ed584fd-b6a7-4ded-94b5-04d0915499cd tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] [instance: 929579db-279b-44f9-bdb4-ccac4a6f9b59] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:03:20.106129 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5ed584fd-b6a7-4ded-94b5-04d0915499cd tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:20.106582 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5ed584fd-b6a7-4ded-94b5-04d0915499cd tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:20.110607 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5ed584fd-b6a7-4ded-94b5-04d0915499cd tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:20.110607 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-5ed584fd-b6a7-4ded-94b5-04d0915499cd tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:20.132842 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-5ed584fd-b6a7-4ded-94b5-04d0915499cd tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] [instance: 929579db-279b-44f9-bdb4-ccac4a6f9b59] Going to try to terminate instance {{(pid=118321) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 12:03:20.409189 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-5ed584fd-b6a7-4ded-94b5-04d0915499cd tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] 10.222.0.26 "DELETE /compute/v2.1/servers/929579db-279b-44f9-bdb4-ccac4a6f9b59" status: 204 len: 0 microversion: 2.1 time: 0.317815 Jul 11 12:03:20.410357 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1536/3075] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 11 12:03:20 2022] DELETE /compute/v2.1/servers/929579db-279b-44f9-bdb4-ccac4a6f9b59 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 11 12:03:20.418295 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-14d088e0-53bd-4f24-8a58-666c89503832 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:03:20.418924 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-14d088e0-53bd-4f24-8a58-666c89503832 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] [instance: 929579db-279b-44f9-bdb4-ccac4a6f9b59] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:03:20.426045 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-14d088e0-53bd-4f24-8a58-666c89503832 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:20.428886 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-14d088e0-53bd-4f24-8a58-666c89503832 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:20.428886 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-14d088e0-53bd-4f24-8a58-666c89503832 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:20.428886 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-14d088e0-53bd-4f24-8a58-666c89503832 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:20.781323 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-14d088e0-53bd-4f24-8a58-666c89503832 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccd3de89cd94e5fa4c488c16d993241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c8c84b3f704d528ea772607da56ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:03:20.789559 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-14d088e0-53bd-4f24-8a58-666c89503832 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] 10.222.0.26 "GET /compute/v2.1/servers/929579db-279b-44f9-bdb4-ccac4a6f9b59" status: 200 len: 1577 microversion: 2.1 time: 0.375019 Jul 11 12:03:20.790128 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1540/3076] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:03:20 2022] GET /compute/v2.1/servers/929579db-279b-44f9-bdb4-ccac4a6f9b59 => generated 1577 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:03:20.841292 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-1e4356d3-5859-43bf-a5c5-007201e3f8de tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:03:20.841991 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-1e4356d3-5859-43bf-a5c5-007201e3f8de tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] [instance: 6dc56556-ace0-40cd-8f2e-d8fece4412e9] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:03:20.848471 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1e4356d3-5859-43bf-a5c5-007201e3f8de tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:20.848919 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1e4356d3-5859-43bf-a5c5-007201e3f8de tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:20.849689 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1e4356d3-5859-43bf-a5c5-007201e3f8de tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:20.850103 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-1e4356d3-5859-43bf-a5c5-007201e3f8de tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:20.980427 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-1e4356d3-5859-43bf-a5c5-007201e3f8de tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa171a9679a3460bb2ee9369e4051690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ae388052ee406c8d6cc749a1ed8c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:03:20.988210 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-1e4356d3-5859-43bf-a5c5-007201e3f8de tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] 10.222.0.26 "GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9" status: 200 len: 1567 microversion: 2.1 time: 0.150488 Jul 11 12:03:20.988778 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1537/3077] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:03:20 2022] GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:03:21.805977 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-65fd9222-0516-4164-a42f-34139971c130 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:03:21.806517 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-65fd9222-0516-4164-a42f-34139971c130 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] [instance: 929579db-279b-44f9-bdb4-ccac4a6f9b59] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:03:21.812870 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-65fd9222-0516-4164-a42f-34139971c130 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:21.813314 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-65fd9222-0516-4164-a42f-34139971c130 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:21.814058 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-65fd9222-0516-4164-a42f-34139971c130 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:21.814488 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-65fd9222-0516-4164-a42f-34139971c130 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:21.942890 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-65fd9222-0516-4164-a42f-34139971c130 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccd3de89cd94e5fa4c488c16d993241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c8c84b3f704d528ea772607da56ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:03:21.950182 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-65fd9222-0516-4164-a42f-34139971c130 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] 10.222.0.26 "GET /compute/v2.1/servers/929579db-279b-44f9-bdb4-ccac4a6f9b59" status: 200 len: 1577 microversion: 2.1 time: 0.148146 Jul 11 12:03:21.950744 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1541/3078] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:03:21 2022] GET /compute/v2.1/servers/929579db-279b-44f9-bdb4-ccac4a6f9b59 => generated 1577 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:03:22.005715 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-b96c63a1-0148-4ac0-8b61-c829f0dd1688 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:03:22.006328 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-b96c63a1-0148-4ac0-8b61-c829f0dd1688 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] [instance: 6dc56556-ace0-40cd-8f2e-d8fece4412e9] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:03:22.012835 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b96c63a1-0148-4ac0-8b61-c829f0dd1688 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:22.013285 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b96c63a1-0148-4ac0-8b61-c829f0dd1688 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:22.014045 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b96c63a1-0148-4ac0-8b61-c829f0dd1688 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:22.014475 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b96c63a1-0148-4ac0-8b61-c829f0dd1688 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:22.228256 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-b96c63a1-0148-4ac0-8b61-c829f0dd1688 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa171a9679a3460bb2ee9369e4051690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ae388052ee406c8d6cc749a1ed8c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:03:22.235788 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-b96c63a1-0148-4ac0-8b61-c829f0dd1688 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] 10.222.0.26 "GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9" status: 200 len: 1567 microversion: 2.1 time: 0.234468 Jul 11 12:03:22.245342 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1538/3079] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:03:22 2022] GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9 => generated 1567 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:03:22.966950 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-0148f70e-4ed0-4096-bc57-2f8201dafc13 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:03:22.967512 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-0148f70e-4ed0-4096-bc57-2f8201dafc13 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] [instance: 929579db-279b-44f9-bdb4-ccac4a6f9b59] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:03:22.974504 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0148f70e-4ed0-4096-bc57-2f8201dafc13 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:22.974955 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0148f70e-4ed0-4096-bc57-2f8201dafc13 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:22.975742 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0148f70e-4ed0-4096-bc57-2f8201dafc13 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:22.976179 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0148f70e-4ed0-4096-bc57-2f8201dafc13 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:23.061591 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-0148f70e-4ed0-4096-bc57-2f8201dafc13 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccd3de89cd94e5fa4c488c16d993241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c8c84b3f704d528ea772607da56ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:03:23.071528 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-0148f70e-4ed0-4096-bc57-2f8201dafc13 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] 10.222.0.26 "GET /compute/v2.1/servers/929579db-279b-44f9-bdb4-ccac4a6f9b59" status: 200 len: 1510 microversion: 2.1 time: 0.108279 Jul 11 12:03:23.072865 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1542/3080] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:03:22 2022] GET /compute/v2.1/servers/929579db-279b-44f9-bdb4-ccac4a6f9b59 => generated 1510 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:03:23.091752 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [req-03645f5b-3822-4035-a185-e229bd958abd req-b12ba091-c92b-46b8-90ff-b5d1ff5c3fb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "929579db-279b-44f9-bdb4-ccac4a6f9b59", "name": "network-vif-deleted", "tag": "0db96d4f-53ea-428e-8092-56b0e11d97b5"}]} {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 12:03:23.101230 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [req-03645f5b-3822-4035-a185-e229bd958abd req-b12ba091-c92b-46b8-90ff-b5d1ff5c3fb2 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:23.101679 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [req-03645f5b-3822-4035-a185-e229bd958abd req-b12ba091-c92b-46b8-90ff-b5d1ff5c3fb2 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:23.113475 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.compute.server_external_events [req-03645f5b-3822-4035-a185-e229bd958abd req-b12ba091-c92b-46b8-90ff-b5d1ff5c3fb2 service nova] Creating event network-vif-deleted:0db96d4f-53ea-428e-8092-56b0e11d97b5 for instance 929579db-279b-44f9-bdb4-ccac4a6f9b59 on hv-cinder-84842 Jul 11 12:03:23.119171 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [req-03645f5b-3822-4035-a185-e229bd958abd req-b12ba091-c92b-46b8-90ff-b5d1ff5c3fb2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034210 Jul 11 12:03:23.120444 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1539/3081] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 12:03:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 12:03:23.254300 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-095ebcbe-2b56-4135-b735-159991fe4eab tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:03:23.254930 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-095ebcbe-2b56-4135-b735-159991fe4eab tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] [instance: 6dc56556-ace0-40cd-8f2e-d8fece4412e9] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:03:23.261164 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-095ebcbe-2b56-4135-b735-159991fe4eab tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:23.261621 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-095ebcbe-2b56-4135-b735-159991fe4eab tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:23.262465 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-095ebcbe-2b56-4135-b735-159991fe4eab tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:23.262906 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-095ebcbe-2b56-4135-b735-159991fe4eab tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:23.409131 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-095ebcbe-2b56-4135-b735-159991fe4eab tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa171a9679a3460bb2ee9369e4051690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ae388052ee406c8d6cc749a1ed8c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:03:23.416738 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-095ebcbe-2b56-4135-b735-159991fe4eab tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] 10.222.0.26 "GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9" status: 200 len: 1567 microversion: 2.1 time: 0.167570 Jul 11 12:03:23.417891 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1543/3082] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:03:23 2022] GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9 => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:03:24.090350 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-8606001b-cc98-4e01-8a5b-f27c87a24086 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:03:24.091039 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-8606001b-cc98-4e01-8a5b-f27c87a24086 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] [instance: 929579db-279b-44f9-bdb4-ccac4a6f9b59] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:03:24.098364 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8606001b-cc98-4e01-8a5b-f27c87a24086 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:24.099155 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8606001b-cc98-4e01-8a5b-f27c87a24086 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:24.099561 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8606001b-cc98-4e01-8a5b-f27c87a24086 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:24.099983 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8606001b-cc98-4e01-8a5b-f27c87a24086 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:24.164961 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-8606001b-cc98-4e01-8a5b-f27c87a24086 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccd3de89cd94e5fa4c488c16d993241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c8c84b3f704d528ea772607da56ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:03:24.172509 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-8606001b-cc98-4e01-8a5b-f27c87a24086 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] 10.222.0.26 "GET /compute/v2.1/servers/929579db-279b-44f9-bdb4-ccac4a6f9b59" status: 200 len: 1226 microversion: 2.1 time: 0.086380 Jul 11 12:03:24.173084 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1540/3083] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:03:24 2022] GET /compute/v2.1/servers/929579db-279b-44f9-bdb4-ccac4a6f9b59 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:03:24.433555 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-35e1bf0d-feb9-410b-9448-aeafeff40cf1 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:03:24.434164 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-35e1bf0d-feb9-410b-9448-aeafeff40cf1 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] [instance: 6dc56556-ace0-40cd-8f2e-d8fece4412e9] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:03:24.440541 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-35e1bf0d-feb9-410b-9448-aeafeff40cf1 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:24.441495 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-35e1bf0d-feb9-410b-9448-aeafeff40cf1 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:24.442236 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-35e1bf0d-feb9-410b-9448-aeafeff40cf1 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:24.442662 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-35e1bf0d-feb9-410b-9448-aeafeff40cf1 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:24.571280 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-35e1bf0d-feb9-410b-9448-aeafeff40cf1 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa171a9679a3460bb2ee9369e4051690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ae388052ee406c8d6cc749a1ed8c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:03:24.578723 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-35e1bf0d-feb9-410b-9448-aeafeff40cf1 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] 10.222.0.26 "GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9" status: 200 len: 1567 microversion: 2.1 time: 0.148991 Jul 11 12:03:24.579307 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1544/3084] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:03:24 2022] GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9 => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:03:25.189796 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-ca375944-5857-45cf-8529-b4dd7e8e19b2 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:03:25.190385 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-ca375944-5857-45cf-8529-b4dd7e8e19b2 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] [instance: 929579db-279b-44f9-bdb4-ccac4a6f9b59] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:03:25.196412 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ca375944-5857-45cf-8529-b4dd7e8e19b2 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:25.199171 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ca375944-5857-45cf-8529-b4dd7e8e19b2 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:25.199171 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ca375944-5857-45cf-8529-b4dd7e8e19b2 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:25.199171 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ca375944-5857-45cf-8529-b4dd7e8e19b2 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:25.229525 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ca375944-5857-45cf-8529-b4dd7e8e19b2 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:25.229994 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ca375944-5857-45cf-8529-b4dd7e8e19b2 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:25.230440 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.objects.instance [None req-ca375944-5857-45cf-8529-b4dd7e8e19b2 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lazy-loading 'fault' on Instance uuid 929579db-279b-44f9-bdb4-ccac4a6f9b59 {{(pid=118321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 12:03:25.274071 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-ca375944-5857-45cf-8529-b4dd7e8e19b2 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccd3de89cd94e5fa4c488c16d993241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c8c84b3f704d528ea772607da56ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:03:25.280435 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-ca375944-5857-45cf-8529-b4dd7e8e19b2 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] 10.222.0.26 "GET /compute/v2.1/servers/929579db-279b-44f9-bdb4-ccac4a6f9b59" status: 200 len: 1231 microversion: 2.1 time: 0.094574 Jul 11 12:03:25.281015 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1541/3085] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:03:25 2022] GET /compute/v2.1/servers/929579db-279b-44f9-bdb4-ccac4a6f9b59 => generated 1231 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:03:25.596075 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-baaabec3-f0d2-4a22-9262-594330b826b2 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:03:25.596677 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-baaabec3-f0d2-4a22-9262-594330b826b2 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] [instance: 6dc56556-ace0-40cd-8f2e-d8fece4412e9] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:03:25.603120 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-baaabec3-f0d2-4a22-9262-594330b826b2 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:25.603595 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-baaabec3-f0d2-4a22-9262-594330b826b2 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:25.604343 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-baaabec3-f0d2-4a22-9262-594330b826b2 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:25.604776 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-baaabec3-f0d2-4a22-9262-594330b826b2 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:25.738976 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-baaabec3-f0d2-4a22-9262-594330b826b2 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa171a9679a3460bb2ee9369e4051690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ae388052ee406c8d6cc749a1ed8c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:03:25.746482 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-baaabec3-f0d2-4a22-9262-594330b826b2 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] 10.222.0.26 "GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9" status: 200 len: 1567 microversion: 2.1 time: 0.154377 Jul 11 12:03:25.747054 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1545/3086] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:03:25 2022] GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:03:26.297290 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-8fd334f2-80d7-4ab6-ae2c-14ebdb7914e5 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:03:26.297895 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-8fd334f2-80d7-4ab6-ae2c-14ebdb7914e5 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] [instance: 929579db-279b-44f9-bdb4-ccac4a6f9b59] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:03:26.304675 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8fd334f2-80d7-4ab6-ae2c-14ebdb7914e5 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:26.305114 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8fd334f2-80d7-4ab6-ae2c-14ebdb7914e5 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:26.305978 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8fd334f2-80d7-4ab6-ae2c-14ebdb7914e5 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:26.306408 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8fd334f2-80d7-4ab6-ae2c-14ebdb7914e5 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:26.320872 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.wsgi [None req-8fd334f2-80d7-4ab6-ae2c-14ebdb7914e5 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] HTTP exception thrown: Instance 929579db-279b-44f9-bdb4-ccac4a6f9b59 could not be found. Jul 11 12:03:26.322537 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-8fd334f2-80d7-4ab6-ae2c-14ebdb7914e5 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Request method failure captured: Jul 11 12:03:26.322537 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: request: GET /compute/v2.1/servers/929579db-279b-44f9-bdb4-ccac4a6f9b59 HTTP/1.1 Jul 11 12:03:26.322537 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Accept: application/json Jul 11 12:03:26.322537 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Accept-Encoding: identity Jul 11 12:03:26.322537 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Connection: close Jul 11 12:03:26.322537 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Content-Length: 0 Jul 11 12:03:26.322537 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Content-Type: application/json Jul 11 12:03:26.322537 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Host: 10.222.0.26 Jul 11 12:03:26.322537 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Openstack-System-Scope: None Jul 11 12:03:26.322537 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: User-Agent: python-urllib3/1.26.9 Jul 11 12:03:26.322537 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Auth-Token: gAAAAABizBDaJa--juSQOgepvWxEhFkHWWGDjwcDjE-IRMfk5vcpdIECWk87YnSeGR4IZ-36W9XdviUlQ7pk5DESoYIKRIDcJ4LlxhsBp3q7eh0PdGROFICBLM28bsvQiBpLtzWh7Yi8BhxeRNyNFmDYyG7K9v4C_YIh6sKgK4gBrMujZ7r58tU Jul 11 12:03:26.322537 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Domain-Id: None Jul 11 12:03:26.322537 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Domain-Name: None Jul 11 12:03:26.322537 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Identity-Status: Confirmed Jul 11 12:03:26.322537 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Is-Admin-Project: True Jul 11 12:03:26.322537 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Domain-Id: default Jul 11 12:03:26.322537 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Domain-Name: Default Jul 11 12:03:26.322537 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Id: 79c8c84b3f704d528ea772607da56ddf Jul 11 12:03:26.322537 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Name: tempest-TestVolumeBootPattern-1886729966 Jul 11 12:03:26.322537 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Role: member,reader Jul 11 12:03:26.322537 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Roles: member,reader Jul 11 12:03:26.324166 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_79c8c84b3f704d528ea772607da56ddf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/79c8c84b3f704d528ea772607da56ddf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/79c8c84b3f704d528ea772607da56ddf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/79c8c84b3f704d528ea772607da56ddf"}]}] Jul 11 12:03:26.324166 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Tenant: tempest-TestVolumeBootPattern-1886729966 Jul 11 12:03:26.324166 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Tenant-Id: 79c8c84b3f704d528ea772607da56ddf Jul 11 12:03:26.324166 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Tenant-Name: tempest-TestVolumeBootPattern-1886729966 Jul 11 12:03:26.324166 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User: tempest-TestVolumeBootPattern-1886729966-project Jul 11 12:03:26.324166 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Domain-Id: default Jul 11 12:03:26.324166 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Domain-Name: Default Jul 11 12:03:26.324166 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Id: fccd3de89cd94e5fa4c488c16d993241 Jul 11 12:03:26.324166 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Name: tempest-TestVolumeBootPattern-1886729966-project Jul 11 12:03:26.324166 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: method: > Jul 11 12:03:26.324166 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: exception: Instance 929579db-279b-44f9-bdb4-ccac4a6f9b59 could not be found. Jul 11 12:03:26.324166 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: action_args: {'id': '929579db-279b-44f9-bdb4-ccac4a6f9b59'} Jul 11 12:03:26.324930 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 12:03:26.324930 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 12:03:26.324930 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 12:03:26.324930 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 12:03:26.324930 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 12:03:26.324930 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 12:03:26.324930 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 12:03:26.324930 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 12:03:26.324930 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 12:03:26.324930 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 12:03:26.324930 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 929579db-279b-44f9-bdb4-ccac4a6f9b59 could not be found. Jul 11 12:03:26.324930 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 12:03:26.324930 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 12:03:26.324930 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 12:03:26.324930 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 12:03:26.324930 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 12:03:26.324930 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 12:03:26.324930 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 12:03:26.324930 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 12:03:26.324930 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 12:03:26.326291 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 12:03:26.326291 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 12:03:26.326291 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 12:03:26.326291 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 12:03:26.326291 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 12:03:26.326291 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 12:03:26.326291 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 12:03:26.326291 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 929579db-279b-44f9-bdb4-ccac4a6f9b59 could not be found. Jul 11 12:03:26.326291 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 12:03:26.326291 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 12:03:26.326291 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 12:03:26.326291 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 12:03:26.326291 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 12:03:26.326291 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 12:03:26.326291 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 12:03:26.326291 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 12:03:26.326291 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 929579db-279b-44f9-bdb4-ccac4a6f9b59 could not be found. Jul 11 12:03:26.326291 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 12:03:26.327508 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-8fd334f2-80d7-4ab6-ae2c-14ebdb7914e5 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Returning 404 to user: Instance 929579db-279b-44f9-bdb4-ccac4a6f9b59 could not be found. {{(pid=118321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 12:03:26.327508 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-8fd334f2-80d7-4ab6-ae2c-14ebdb7914e5 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] 10.222.0.26 "GET /compute/v2.1/servers/929579db-279b-44f9-bdb4-ccac4a6f9b59" status: 404 len: 111 microversion: 2.1 time: 0.030465 Jul 11 12:03:26.327508 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1542/3087] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:03:26 2022] GET /compute/v2.1/servers/929579db-279b-44f9-bdb4-ccac4a6f9b59 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 12:03:26.421909 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-983ebec8-5db2-472f-8701-da093d27cefe tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1603970200", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1764556180", "security_groups": [{"name": "tempest-secgroup-smoke-242625149"}], "block_device_mapping_v2": [{"uuid": "68c71257-6b93-4612-90ae-cc77325c6063", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "cbf23430-d3c4-4909-b958-81c6ba8296b8"}]}} {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 12:03:26.535168 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.network.neutron [None req-983ebec8-5db2-472f-8701-da093d27cefe tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] validate_networks() for [('cbf23430-d3c4-4909-b958-81c6ba8296b8', None, None, None, None, None)] {{(pid=118322) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 12:03:26.763766 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-8f73e7ac-9aa1-4a9c-82d4-d057fb23e7d4 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:03:26.764372 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-8f73e7ac-9aa1-4a9c-82d4-d057fb23e7d4 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] [instance: 6dc56556-ace0-40cd-8f2e-d8fece4412e9] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:03:26.771070 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8f73e7ac-9aa1-4a9c-82d4-d057fb23e7d4 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:26.771548 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8f73e7ac-9aa1-4a9c-82d4-d057fb23e7d4 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:26.772295 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8f73e7ac-9aa1-4a9c-82d4-d057fb23e7d4 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:26.772728 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-8f73e7ac-9aa1-4a9c-82d4-d057fb23e7d4 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:26.899365 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.virt.hardware [None req-983ebec8-5db2-472f-8701-da093d27cefe tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Flavor limits 0:0:0 {{(pid=118322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 12:03:26.899863 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.virt.hardware [None req-983ebec8-5db2-472f-8701-da093d27cefe tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Image limits 0:0:0 {{(pid=118322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 12:03:26.900288 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.virt.hardware [None req-983ebec8-5db2-472f-8701-da093d27cefe tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Flavor pref 0:0:0 {{(pid=118322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 12:03:26.900731 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.virt.hardware [None req-983ebec8-5db2-472f-8701-da093d27cefe tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Image pref 0:0:0 {{(pid=118322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 12:03:26.901146 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.virt.hardware [None req-983ebec8-5db2-472f-8701-da093d27cefe tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 12:03:26.902259 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-8f73e7ac-9aa1-4a9c-82d4-d057fb23e7d4 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa171a9679a3460bb2ee9369e4051690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ae388052ee406c8d6cc749a1ed8c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:03:26.910279 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-8f73e7ac-9aa1-4a9c-82d4-d057fb23e7d4 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] 10.222.0.26 "GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9" status: 200 len: 1508 microversion: 2.1 time: 0.149812 Jul 11 12:03:26.910509 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-983ebec8-5db2-472f-8701-da093d27cefe tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:26.910840 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1543/3088] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:03:26 2022] GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9 => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 12:03:26.910963 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-983ebec8-5db2-472f-8701-da093d27cefe tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:26.911870 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-983ebec8-5db2-472f-8701-da093d27cefe tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:26.912319 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-983ebec8-5db2-472f-8701-da093d27cefe tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:26.926556 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-304ae87f-da3a-4c86-8ad5-eabb7b5cf5dd tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 12:03:26.927146 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-304ae87f-da3a-4c86-8ad5-eabb7b5cf5dd tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] [instance: 6dc56556-ace0-40cd-8f2e-d8fece4412e9] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:03:26.929691 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.quota [None req-983ebec8-5db2-472f-8701-da093d27cefe tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Getting quotas for project 79c8c84b3f704d528ea772607da56ddf. Resources: {'cores', 'ram', 'instances'} {{(pid=118322) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 12:03:26.933090 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-304ae87f-da3a-4c86-8ad5-eabb7b5cf5dd tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:26.933533 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-304ae87f-da3a-4c86-8ad5-eabb7b5cf5dd tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:26.933703 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.quota [None req-983ebec8-5db2-472f-8701-da093d27cefe tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Getting quotas for user fccd3de89cd94e5fa4c488c16d993241 and project 79c8c84b3f704d528ea772607da56ddf. Resources: {'cores', 'ram', 'instances'} {{(pid=118322) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 12:03:26.934285 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-304ae87f-da3a-4c86-8ad5-eabb7b5cf5dd tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:26.934712 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-304ae87f-da3a-4c86-8ad5-eabb7b5cf5dd tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:26.990784 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-983ebec8-5db2-472f-8701-da093d27cefe tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Going to run 1 instances... {{(pid=118322) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 12:03:26.992900 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-983ebec8-5db2-472f-8701-da093d27cefe tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] [instance: a3e27550-bea7-476f-9f87-0959b4f70f5f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='68c71257-6b93-4612-90ae-cc77325c6063',volume_size=None,volume_type=None)] {{(pid=118322) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 12:03:27.134676 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:03:27.247334 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-304ae87f-da3a-4c86-8ad5-eabb7b5cf5dd tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] 10.222.0.26 "POST /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9/action" status: 202 len: 0 microversion: 2.1 time: 0.324857 Jul 11 12:03:27.248193 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1544/3089] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Jul 11 12:03:26 2022] POST /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9/action => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 11 12:03:27.262002 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-61693bc7-ae95-4d2e-9f28-b47b7c78ba99 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:03:27.262731 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-61693bc7-ae95-4d2e-9f28-b47b7c78ba99 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] [instance: 6dc56556-ace0-40cd-8f2e-d8fece4412e9] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:03:27.271697 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-61693bc7-ae95-4d2e-9f28-b47b7c78ba99 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:27.275409 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-61693bc7-ae95-4d2e-9f28-b47b7c78ba99 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:27.275409 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-61693bc7-ae95-4d2e-9f28-b47b7c78ba99 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:27.275409 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-61693bc7-ae95-4d2e-9f28-b47b7c78ba99 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:27.499431 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-983ebec8-5db2-472f-8701-da093d27cefe tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.081354 Jul 11 12:03:27.500205 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1546/3090] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jul 11 12:03:26 2022] POST /compute/v2.1/servers => generated 405 bytes in 1083 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 11 12:03:27.510992 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-56195149-85bc-4651-9ee9-5c87f5244543 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:03:27.517709 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-56195149-85bc-4651-9ee9-5c87f5244543 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] [instance: a3e27550-bea7-476f-9f87-0959b4f70f5f] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:03:27.580682 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-56195149-85bc-4651-9ee9-5c87f5244543 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccd3de89cd94e5fa4c488c16d993241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c8c84b3f704d528ea772607da56ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:03:27.587961 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-56195149-85bc-4651-9ee9-5c87f5244543 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] 10.222.0.26 "GET /compute/v2.1/servers/a3e27550-bea7-476f-9f87-0959b4f70f5f" status: 200 len: 1095 microversion: 2.1 time: 0.081214 Jul 11 12:03:27.598028 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1547/3091] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:03:27 2022] GET /compute/v2.1/servers/a3e27550-bea7-476f-9f87-0959b4f70f5f => generated 1095 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 12:03:27.712981 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-61693bc7-ae95-4d2e-9f28-b47b7c78ba99 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa171a9679a3460bb2ee9369e4051690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ae388052ee406c8d6cc749a1ed8c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:03:27.720904 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-61693bc7-ae95-4d2e-9f28-b47b7c78ba99 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] 10.222.0.26 "GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9" status: 200 len: 1516 microversion: 2.1 time: 0.467538 Jul 11 12:03:27.721469 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1545/3092] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:03:27 2022] GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9 => generated 1516 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:03:28.605182 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-09f110fe-2358-45c3-8a16-1976fc4b2c8c tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:03:28.605750 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-09f110fe-2358-45c3-8a16-1976fc4b2c8c tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] [instance: a3e27550-bea7-476f-9f87-0959b4f70f5f] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:03:28.612161 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-09f110fe-2358-45c3-8a16-1976fc4b2c8c tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:28.613486 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-09f110fe-2358-45c3-8a16-1976fc4b2c8c tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:28.614276 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-09f110fe-2358-45c3-8a16-1976fc4b2c8c tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:28.614713 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-09f110fe-2358-45c3-8a16-1976fc4b2c8c tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:28.678598 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-09f110fe-2358-45c3-8a16-1976fc4b2c8c tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccd3de89cd94e5fa4c488c16d993241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c8c84b3f704d528ea772607da56ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:03:28.685908 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-09f110fe-2358-45c3-8a16-1976fc4b2c8c tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] 10.222.0.26 "GET /compute/v2.1/servers/a3e27550-bea7-476f-9f87-0959b4f70f5f" status: 200 len: 1145 microversion: 2.1 time: 0.084727 Jul 11 12:03:28.686476 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1548/3093] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:03:28 2022] GET /compute/v2.1/servers/a3e27550-bea7-476f-9f87-0959b4f70f5f => generated 1145 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:03:28.737308 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-668390ad-aef3-4eb4-a442-bac2601705b5 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:03:28.738303 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-668390ad-aef3-4eb4-a442-bac2601705b5 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] [instance: 6dc56556-ace0-40cd-8f2e-d8fece4412e9] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:03:28.744833 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-668390ad-aef3-4eb4-a442-bac2601705b5 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:28.745280 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-668390ad-aef3-4eb4-a442-bac2601705b5 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:28.746043 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-668390ad-aef3-4eb4-a442-bac2601705b5 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:28.746468 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-668390ad-aef3-4eb4-a442-bac2601705b5 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:28.881692 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-668390ad-aef3-4eb4-a442-bac2601705b5 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa171a9679a3460bb2ee9369e4051690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ae388052ee406c8d6cc749a1ed8c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:03:28.889136 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-668390ad-aef3-4eb4-a442-bac2601705b5 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] 10.222.0.26 "GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9" status: 200 len: 1518 microversion: 2.1 time: 0.155847 Jul 11 12:03:28.889691 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1546/3094] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:03:28 2022] GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9 => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:03:29.567041 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [req-0747a0fc-0791-4bb8-9412-0e6b035c3870 req-df292ba8-f614-4fdc-a822-997362ba6c65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dc56556-ace0-40cd-8f2e-d8fece4412e9", "name": "network-vif-unplugged", "status": "completed", "tag": "e8bfdf4d-ab82-479d-85eb-97c40021c54f"}]} {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 12:03:29.576400 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [req-0747a0fc-0791-4bb8-9412-0e6b035c3870 req-df292ba8-f614-4fdc-a822-997362ba6c65 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:29.577045 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [req-0747a0fc-0791-4bb8-9412-0e6b035c3870 req-df292ba8-f614-4fdc-a822-997362ba6c65 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:29.588978 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.compute.server_external_events [req-0747a0fc-0791-4bb8-9412-0e6b035c3870 req-df292ba8-f614-4fdc-a822-997362ba6c65 service nova] Unable to find a host for instance 6dc56556-ace0-40cd-8f2e-d8fece4412e9. Dropping event network-vif-unplugged {{(pid=118322) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 11 12:03:29.589456 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [req-0747a0fc-0791-4bb8-9412-0e6b035c3870 req-df292ba8-f614-4fdc-a822-997362ba6c65 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029021 Jul 11 12:03:29.590039 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1549/3095] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 12:03:29 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 11 12:03:29.703042 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-6db40cab-53c0-44a2-9ae3-2d32203439ce tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:03:29.704005 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-6db40cab-53c0-44a2-9ae3-2d32203439ce tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] [instance: a3e27550-bea7-476f-9f87-0959b4f70f5f] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:03:29.711688 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6db40cab-53c0-44a2-9ae3-2d32203439ce tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:29.712212 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6db40cab-53c0-44a2-9ae3-2d32203439ce tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:29.713653 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6db40cab-53c0-44a2-9ae3-2d32203439ce tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:29.714158 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6db40cab-53c0-44a2-9ae3-2d32203439ce tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:29.818933 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-6db40cab-53c0-44a2-9ae3-2d32203439ce tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccd3de89cd94e5fa4c488c16d993241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c8c84b3f704d528ea772607da56ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:03:29.826855 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-6db40cab-53c0-44a2-9ae3-2d32203439ce tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] 10.222.0.26 "GET /compute/v2.1/servers/a3e27550-bea7-476f-9f87-0959b4f70f5f" status: 200 len: 1211 microversion: 2.1 time: 0.127482 Jul 11 12:03:29.827845 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1547/3096] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:03:29 2022] GET /compute/v2.1/servers/a3e27550-bea7-476f-9f87-0959b4f70f5f => generated 1211 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:03:29.907126 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-d390edbb-9f5c-428f-9c48-2b9a958f0930 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:03:29.907765 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-d390edbb-9f5c-428f-9c48-2b9a958f0930 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] [instance: 6dc56556-ace0-40cd-8f2e-d8fece4412e9] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:03:29.917207 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d390edbb-9f5c-428f-9c48-2b9a958f0930 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:29.917650 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d390edbb-9f5c-428f-9c48-2b9a958f0930 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:29.918598 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d390edbb-9f5c-428f-9c48-2b9a958f0930 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:29.919020 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d390edbb-9f5c-428f-9c48-2b9a958f0930 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:30.062177 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-d390edbb-9f5c-428f-9c48-2b9a958f0930 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa171a9679a3460bb2ee9369e4051690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ae388052ee406c8d6cc749a1ed8c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:03:30.077181 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-d390edbb-9f5c-428f-9c48-2b9a958f0930 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] 10.222.0.26 "GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9" status: 200 len: 1518 microversion: 2.1 time: 0.170252 Jul 11 12:03:30.077181 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1550/3097] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:03:29 2022] GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9 => generated 1518 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:03:30.846080 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-e83551db-9f57-4963-8003-da407089f8ed tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:03:30.848151 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-e83551db-9f57-4963-8003-da407089f8ed tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] [instance: a3e27550-bea7-476f-9f87-0959b4f70f5f] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:03:30.856006 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e83551db-9f57-4963-8003-da407089f8ed tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:30.856919 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e83551db-9f57-4963-8003-da407089f8ed tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:30.857781 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e83551db-9f57-4963-8003-da407089f8ed tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:30.858425 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-e83551db-9f57-4963-8003-da407089f8ed tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:31.091665 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-3b74f9ae-bc73-49b2-ac52-2addcd901a12 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:03:31.092279 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-3b74f9ae-bc73-49b2-ac52-2addcd901a12 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] [instance: 6dc56556-ace0-40cd-8f2e-d8fece4412e9] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:03:31.098751 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3b74f9ae-bc73-49b2-ac52-2addcd901a12 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:31.099201 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3b74f9ae-bc73-49b2-ac52-2addcd901a12 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:31.099992 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3b74f9ae-bc73-49b2-ac52-2addcd901a12 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:31.100531 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-3b74f9ae-bc73-49b2-ac52-2addcd901a12 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:31.158335 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-e83551db-9f57-4963-8003-da407089f8ed tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccd3de89cd94e5fa4c488c16d993241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c8c84b3f704d528ea772607da56ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:03:31.168351 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-e83551db-9f57-4963-8003-da407089f8ed tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] 10.222.0.26 "GET /compute/v2.1/servers/a3e27550-bea7-476f-9f87-0959b4f70f5f" status: 200 len: 1278 microversion: 2.1 time: 0.325786 Jul 11 12:03:31.169147 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1548/3098] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:03:30 2022] GET /compute/v2.1/servers/a3e27550-bea7-476f-9f87-0959b4f70f5f => generated 1278 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:03:31.237304 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-3b74f9ae-bc73-49b2-ac52-2addcd901a12 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa171a9679a3460bb2ee9369e4051690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ae388052ee406c8d6cc749a1ed8c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:03:31.245665 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-3b74f9ae-bc73-49b2-ac52-2addcd901a12 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] 10.222.0.26 "GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9" status: 200 len: 1574 microversion: 2.1 time: 0.157853 Jul 11 12:03:31.246244 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1551/3099] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:03:31 2022] GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9 => generated 1574 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 12:03:31.612258 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [req-9def18c1-a2a9-4e87-a742-ccfad2596683 req-78f6bb0a-6436-475d-bd43-29e2298e14d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3e27550-bea7-476f-9f87-0959b4f70f5f", "tag": "1af9c038-cece-4cea-a40d-f3d876bdddc2"}]} {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 12:03:31.621206 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [req-9def18c1-a2a9-4e87-a742-ccfad2596683 req-78f6bb0a-6436-475d-bd43-29e2298e14d2 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:31.621654 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [req-9def18c1-a2a9-4e87-a742-ccfad2596683 req-78f6bb0a-6436-475d-bd43-29e2298e14d2 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:31.636380 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.compute.server_external_events [req-9def18c1-a2a9-4e87-a742-ccfad2596683 req-78f6bb0a-6436-475d-bd43-29e2298e14d2 service nova] Creating event network-changed:1af9c038-cece-4cea-a40d-f3d876bdddc2 for instance a3e27550-bea7-476f-9f87-0959b4f70f5f on hv-cinder-84842 Jul 11 12:03:31.641270 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [req-9def18c1-a2a9-4e87-a742-ccfad2596683 req-78f6bb0a-6436-475d-bd43-29e2298e14d2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032606 Jul 11 12:03:31.641870 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1549/3100] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 12:03:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 12:03:32.186057 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-da08e2a6-d033-4ba4-89a7-d2ce98fc538f tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:03:32.186954 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-da08e2a6-d033-4ba4-89a7-d2ce98fc538f tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] [instance: a3e27550-bea7-476f-9f87-0959b4f70f5f] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:03:32.193573 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-da08e2a6-d033-4ba4-89a7-d2ce98fc538f tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:32.194022 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-da08e2a6-d033-4ba4-89a7-d2ce98fc538f tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:32.194791 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-da08e2a6-d033-4ba4-89a7-d2ce98fc538f tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:32.195416 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-da08e2a6-d033-4ba4-89a7-d2ce98fc538f tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:32.264065 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-68046a4e-4c77-4bf0-9343-584b04d713d7 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:03:32.265604 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-68046a4e-4c77-4bf0-9343-584b04d713d7 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] [instance: 6dc56556-ace0-40cd-8f2e-d8fece4412e9] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:03:32.274553 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-68046a4e-4c77-4bf0-9343-584b04d713d7 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:32.275083 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-68046a4e-4c77-4bf0-9343-584b04d713d7 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:32.279580 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-68046a4e-4c77-4bf0-9343-584b04d713d7 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:32.279580 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-68046a4e-4c77-4bf0-9343-584b04d713d7 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:32.340803 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-da08e2a6-d033-4ba4-89a7-d2ce98fc538f tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccd3de89cd94e5fa4c488c16d993241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c8c84b3f704d528ea772607da56ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:03:32.349364 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-da08e2a6-d033-4ba4-89a7-d2ce98fc538f tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] 10.222.0.26 "GET /compute/v2.1/servers/a3e27550-bea7-476f-9f87-0959b4f70f5f" status: 200 len: 1266 microversion: 2.1 time: 0.167128 Jul 11 12:03:32.350940 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1552/3101] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:03:32 2022] GET /compute/v2.1/servers/a3e27550-bea7-476f-9f87-0959b4f70f5f => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:03:32.501383 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-68046a4e-4c77-4bf0-9343-584b04d713d7 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa171a9679a3460bb2ee9369e4051690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ae388052ee406c8d6cc749a1ed8c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:03:32.509535 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-68046a4e-4c77-4bf0-9343-584b04d713d7 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] 10.222.0.26 "GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9" status: 200 len: 1574 microversion: 2.1 time: 0.250349 Jul 11 12:03:32.510110 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1550/3102] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:03:32 2022] GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9 => generated 1574 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:03:33.367554 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-54fa1da0-9eb2-418e-be47-593f3fe04433 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:03:33.368208 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-54fa1da0-9eb2-418e-be47-593f3fe04433 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] [instance: a3e27550-bea7-476f-9f87-0959b4f70f5f] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:03:33.374615 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-54fa1da0-9eb2-418e-be47-593f3fe04433 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:33.375054 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-54fa1da0-9eb2-418e-be47-593f3fe04433 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:33.375829 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-54fa1da0-9eb2-418e-be47-593f3fe04433 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:33.376260 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-54fa1da0-9eb2-418e-be47-593f3fe04433 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:33.506620 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-54fa1da0-9eb2-418e-be47-593f3fe04433 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccd3de89cd94e5fa4c488c16d993241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c8c84b3f704d528ea772607da56ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:03:33.514065 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-54fa1da0-9eb2-418e-be47-593f3fe04433 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] 10.222.0.26 "GET /compute/v2.1/servers/a3e27550-bea7-476f-9f87-0959b4f70f5f" status: 200 len: 1266 microversion: 2.1 time: 0.150301 Jul 11 12:03:33.514644 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1553/3103] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:03:33 2022] GET /compute/v2.1/servers/a3e27550-bea7-476f-9f87-0959b4f70f5f => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:03:33.525985 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-3827e8cb-b28c-456b-93e2-7366e08d83fe tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:03:33.526593 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-3827e8cb-b28c-456b-93e2-7366e08d83fe tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] [instance: 6dc56556-ace0-40cd-8f2e-d8fece4412e9] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:03:33.533073 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3827e8cb-b28c-456b-93e2-7366e08d83fe tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:33.533511 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3827e8cb-b28c-456b-93e2-7366e08d83fe tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:33.534262 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3827e8cb-b28c-456b-93e2-7366e08d83fe tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:33.534701 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3827e8cb-b28c-456b-93e2-7366e08d83fe tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:33.667389 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-3827e8cb-b28c-456b-93e2-7366e08d83fe tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa171a9679a3460bb2ee9369e4051690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ae388052ee406c8d6cc749a1ed8c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:03:33.674818 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-3827e8cb-b28c-456b-93e2-7366e08d83fe tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] 10.222.0.26 "GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9" status: 200 len: 1574 microversion: 2.1 time: 0.152574 Jul 11 12:03:33.675405 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1551/3104] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:03:33 2022] GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9 => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:03:34.530390 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-13e10723-5305-46a0-8acc-aebac88ebf35 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:03:34.531006 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-13e10723-5305-46a0-8acc-aebac88ebf35 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] [instance: a3e27550-bea7-476f-9f87-0959b4f70f5f] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:03:34.538365 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-13e10723-5305-46a0-8acc-aebac88ebf35 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:34.538819 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-13e10723-5305-46a0-8acc-aebac88ebf35 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:34.539630 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-13e10723-5305-46a0-8acc-aebac88ebf35 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:34.540071 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-13e10723-5305-46a0-8acc-aebac88ebf35 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:34.669680 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-13e10723-5305-46a0-8acc-aebac88ebf35 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccd3de89cd94e5fa4c488c16d993241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c8c84b3f704d528ea772607da56ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:03:34.673027 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=100 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:03:34.677281 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-13e10723-5305-46a0-8acc-aebac88ebf35 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] 10.222.0.26 "GET /compute/v2.1/servers/a3e27550-bea7-476f-9f87-0959b4f70f5f" status: 200 len: 1266 microversion: 2.1 time: 0.150739 Jul 11 12:03:34.677851 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1554/3105] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:03:34 2022] GET /compute/v2.1/servers/a3e27550-bea7-476f-9f87-0959b4f70f5f => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:03:34.691720 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-3a85a7a0-60cc-4280-bb16-c559852792da tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:03:34.692323 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-3a85a7a0-60cc-4280-bb16-c559852792da tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] [instance: 6dc56556-ace0-40cd-8f2e-d8fece4412e9] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:03:34.700298 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3a85a7a0-60cc-4280-bb16-c559852792da tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:34.700777 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3a85a7a0-60cc-4280-bb16-c559852792da tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:34.701534 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3a85a7a0-60cc-4280-bb16-c559852792da tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:34.701970 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3a85a7a0-60cc-4280-bb16-c559852792da tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:34.842249 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-3a85a7a0-60cc-4280-bb16-c559852792da tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa171a9679a3460bb2ee9369e4051690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ae388052ee406c8d6cc749a1ed8c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:03:34.850237 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-3a85a7a0-60cc-4280-bb16-c559852792da tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] 10.222.0.26 "GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9" status: 200 len: 1574 microversion: 2.1 time: 0.162286 Jul 11 12:03:34.850801 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1552/3106] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:03:34 2022] GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9 => generated 1574 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:03:35.693696 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-208f8c06-70a9-4b10-bb85-76ad530f0798 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:03:35.694338 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-208f8c06-70a9-4b10-bb85-76ad530f0798 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] [instance: a3e27550-bea7-476f-9f87-0959b4f70f5f] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:03:35.701185 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-208f8c06-70a9-4b10-bb85-76ad530f0798 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:35.701636 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-208f8c06-70a9-4b10-bb85-76ad530f0798 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:35.702391 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-208f8c06-70a9-4b10-bb85-76ad530f0798 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:35.702836 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-208f8c06-70a9-4b10-bb85-76ad530f0798 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:35.832249 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-208f8c06-70a9-4b10-bb85-76ad530f0798 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccd3de89cd94e5fa4c488c16d993241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c8c84b3f704d528ea772607da56ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:03:35.839540 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-208f8c06-70a9-4b10-bb85-76ad530f0798 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] 10.222.0.26 "GET /compute/v2.1/servers/a3e27550-bea7-476f-9f87-0959b4f70f5f" status: 200 len: 1266 microversion: 2.1 time: 0.149685 Jul 11 12:03:35.840141 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1555/3107] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:03:35 2022] GET /compute/v2.1/servers/a3e27550-bea7-476f-9f87-0959b4f70f5f => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 12:03:35.867057 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-12b4cd9a-71ee-4428-8df3-f3bf41be312d tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:03:35.867695 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-12b4cd9a-71ee-4428-8df3-f3bf41be312d tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] [instance: 6dc56556-ace0-40cd-8f2e-d8fece4412e9] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:03:35.874026 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-12b4cd9a-71ee-4428-8df3-f3bf41be312d tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:35.874476 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-12b4cd9a-71ee-4428-8df3-f3bf41be312d tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:35.875225 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-12b4cd9a-71ee-4428-8df3-f3bf41be312d tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:35.875683 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-12b4cd9a-71ee-4428-8df3-f3bf41be312d tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:36.003201 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-12b4cd9a-71ee-4428-8df3-f3bf41be312d tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa171a9679a3460bb2ee9369e4051690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ae388052ee406c8d6cc749a1ed8c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:03:36.011211 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-12b4cd9a-71ee-4428-8df3-f3bf41be312d tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] 10.222.0.26 "GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9" status: 200 len: 1574 microversion: 2.1 time: 0.147962 Jul 11 12:03:36.011806 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1553/3108] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:03:35 2022] GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9 => generated 1574 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:03:36.856092 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-bfbdfca8-dc46-410c-9d99-409632a2770c tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:03:36.856702 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-bfbdfca8-dc46-410c-9d99-409632a2770c tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] [instance: a3e27550-bea7-476f-9f87-0959b4f70f5f] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:03:36.863682 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-bfbdfca8-dc46-410c-9d99-409632a2770c tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:36.864131 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-bfbdfca8-dc46-410c-9d99-409632a2770c tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:36.864883 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-bfbdfca8-dc46-410c-9d99-409632a2770c tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:36.865316 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-bfbdfca8-dc46-410c-9d99-409632a2770c tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:36.919987 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell0:SELECT=2 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:03:36.995820 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-bfbdfca8-dc46-410c-9d99-409632a2770c tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccd3de89cd94e5fa4c488c16d993241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c8c84b3f704d528ea772607da56ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:03:37.003090 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-bfbdfca8-dc46-410c-9d99-409632a2770c tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] 10.222.0.26 "GET /compute/v2.1/servers/a3e27550-bea7-476f-9f87-0959b4f70f5f" status: 200 len: 1266 microversion: 2.1 time: 0.150777 Jul 11 12:03:37.004291 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1556/3109] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:03:36 2022] GET /compute/v2.1/servers/a3e27550-bea7-476f-9f87-0959b4f70f5f => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:03:37.027792 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-71fea2d8-7260-40b3-98a2-ced492242222 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:03:37.028404 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-71fea2d8-7260-40b3-98a2-ced492242222 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] [instance: 6dc56556-ace0-40cd-8f2e-d8fece4412e9] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:03:37.035483 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-71fea2d8-7260-40b3-98a2-ced492242222 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:37.035943 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-71fea2d8-7260-40b3-98a2-ced492242222 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:37.036704 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-71fea2d8-7260-40b3-98a2-ced492242222 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:37.037141 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-71fea2d8-7260-40b3-98a2-ced492242222 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:37.166550 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-71fea2d8-7260-40b3-98a2-ced492242222 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa171a9679a3460bb2ee9369e4051690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ae388052ee406c8d6cc749a1ed8c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:03:37.173978 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-71fea2d8-7260-40b3-98a2-ced492242222 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] 10.222.0.26 "GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9" status: 200 len: 1574 microversion: 2.1 time: 0.149989 Jul 11 12:03:37.174543 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1554/3110] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:03:37 2022] GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9 => generated 1574 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:03:38.021155 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-7a6ab2cf-2d0f-4907-b591-b01fa4ce345a tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:03:38.021767 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-7a6ab2cf-2d0f-4907-b591-b01fa4ce345a tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] [instance: a3e27550-bea7-476f-9f87-0959b4f70f5f] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:03:38.023606 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell0:SELECT=8 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:03:38.028866 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7a6ab2cf-2d0f-4907-b591-b01fa4ce345a tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:38.029341 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7a6ab2cf-2d0f-4907-b591-b01fa4ce345a tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:38.030077 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7a6ab2cf-2d0f-4907-b591-b01fa4ce345a tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:38.030514 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7a6ab2cf-2d0f-4907-b591-b01fa4ce345a tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:38.161988 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-7a6ab2cf-2d0f-4907-b591-b01fa4ce345a tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccd3de89cd94e5fa4c488c16d993241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c8c84b3f704d528ea772607da56ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:03:38.169498 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-7a6ab2cf-2d0f-4907-b591-b01fa4ce345a tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] 10.222.0.26 "GET /compute/v2.1/servers/a3e27550-bea7-476f-9f87-0959b4f70f5f" status: 200 len: 1266 microversion: 2.1 time: 0.152866 Jul 11 12:03:38.169951 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1557/3111] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:03:38 2022] GET /compute/v2.1/servers/a3e27550-bea7-476f-9f87-0959b4f70f5f => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:03:38.189975 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-088b49e2-a1a7-4c92-bdd7-09cd2573370b tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:03:38.190470 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-088b49e2-a1a7-4c92-bdd7-09cd2573370b tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] [instance: 6dc56556-ace0-40cd-8f2e-d8fece4412e9] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:03:38.197729 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-088b49e2-a1a7-4c92-bdd7-09cd2573370b tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:38.200398 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-088b49e2-a1a7-4c92-bdd7-09cd2573370b tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:38.201346 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-088b49e2-a1a7-4c92-bdd7-09cd2573370b tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:38.201804 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-088b49e2-a1a7-4c92-bdd7-09cd2573370b tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:38.337908 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-088b49e2-a1a7-4c92-bdd7-09cd2573370b tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa171a9679a3460bb2ee9369e4051690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ae388052ee406c8d6cc749a1ed8c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:03:38.345414 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-088b49e2-a1a7-4c92-bdd7-09cd2573370b tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] 10.222.0.26 "GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9" status: 200 len: 1574 microversion: 2.1 time: 0.159517 Jul 11 12:03:38.346033 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1555/3112] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:03:38 2022] GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9 => generated 1574 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:03:39.185810 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-dd7f7dad-0917-4a8a-8f6d-060a1341048c tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:03:39.186421 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-dd7f7dad-0917-4a8a-8f6d-060a1341048c tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] [instance: a3e27550-bea7-476f-9f87-0959b4f70f5f] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:03:39.193021 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-dd7f7dad-0917-4a8a-8f6d-060a1341048c tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:39.193465 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-dd7f7dad-0917-4a8a-8f6d-060a1341048c tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:39.194213 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-dd7f7dad-0917-4a8a-8f6d-060a1341048c tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:39.194644 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-dd7f7dad-0917-4a8a-8f6d-060a1341048c tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:39.337136 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-dd7f7dad-0917-4a8a-8f6d-060a1341048c tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccd3de89cd94e5fa4c488c16d993241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c8c84b3f704d528ea772607da56ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:03:39.344535 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-dd7f7dad-0917-4a8a-8f6d-060a1341048c tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] 10.222.0.26 "GET /compute/v2.1/servers/a3e27550-bea7-476f-9f87-0959b4f70f5f" status: 200 len: 1266 microversion: 2.1 time: 0.162560 Jul 11 12:03:39.345093 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1558/3113] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:03:39 2022] GET /compute/v2.1/servers/a3e27550-bea7-476f-9f87-0959b4f70f5f => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:03:39.361899 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-a3a17d19-89b6-41b2-a837-6281e568d651 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:03:39.362517 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-a3a17d19-89b6-41b2-a837-6281e568d651 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] [instance: 6dc56556-ace0-40cd-8f2e-d8fece4412e9] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:03:39.369147 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a3a17d19-89b6-41b2-a837-6281e568d651 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:39.369498 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a3a17d19-89b6-41b2-a837-6281e568d651 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:39.370266 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a3a17d19-89b6-41b2-a837-6281e568d651 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:39.370703 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a3a17d19-89b6-41b2-a837-6281e568d651 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:39.502130 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-a3a17d19-89b6-41b2-a837-6281e568d651 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa171a9679a3460bb2ee9369e4051690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ae388052ee406c8d6cc749a1ed8c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:03:39.510266 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-a3a17d19-89b6-41b2-a837-6281e568d651 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] 10.222.0.26 "GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9" status: 200 len: 1574 microversion: 2.1 time: 0.152293 Jul 11 12:03:39.510842 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1556/3114] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:03:39 2022] GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9 => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:03:40.361283 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-2888f219-46d0-4b06-bace-40572ba04d8a tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:03:40.361891 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-2888f219-46d0-4b06-bace-40572ba04d8a tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] [instance: a3e27550-bea7-476f-9f87-0959b4f70f5f] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:03:40.369019 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2888f219-46d0-4b06-bace-40572ba04d8a tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:40.369466 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2888f219-46d0-4b06-bace-40572ba04d8a tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:40.370217 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2888f219-46d0-4b06-bace-40572ba04d8a tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:40.370650 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-2888f219-46d0-4b06-bace-40572ba04d8a tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:40.507789 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-2888f219-46d0-4b06-bace-40572ba04d8a tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccd3de89cd94e5fa4c488c16d993241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c8c84b3f704d528ea772607da56ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:03:40.515112 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-2888f219-46d0-4b06-bace-40572ba04d8a tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] 10.222.0.26 "GET /compute/v2.1/servers/a3e27550-bea7-476f-9f87-0959b4f70f5f" status: 200 len: 1266 microversion: 2.1 time: 0.157680 Jul 11 12:03:40.515719 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1559/3115] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:03:40 2022] GET /compute/v2.1/servers/a3e27550-bea7-476f-9f87-0959b4f70f5f => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:03:40.527836 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-837ef6d4-d265-4d59-8b07-1ea8caeb1e47 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:03:40.528446 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-837ef6d4-d265-4d59-8b07-1ea8caeb1e47 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] [instance: 6dc56556-ace0-40cd-8f2e-d8fece4412e9] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:03:40.534793 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-837ef6d4-d265-4d59-8b07-1ea8caeb1e47 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:40.535812 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-837ef6d4-d265-4d59-8b07-1ea8caeb1e47 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:40.536564 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-837ef6d4-d265-4d59-8b07-1ea8caeb1e47 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:40.536998 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-837ef6d4-d265-4d59-8b07-1ea8caeb1e47 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:40.664668 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-837ef6d4-d265-4d59-8b07-1ea8caeb1e47 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa171a9679a3460bb2ee9369e4051690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ae388052ee406c8d6cc749a1ed8c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:03:40.672062 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-837ef6d4-d265-4d59-8b07-1ea8caeb1e47 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] 10.222.0.26 "GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9" status: 200 len: 1574 microversion: 2.1 time: 0.148030 Jul 11 12:03:40.672621 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1557/3116] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:03:40 2022] GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9 => generated 1574 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:03:41.531871 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-ace62382-ec06-454e-90be-0c567174142e tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:03:41.532581 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-ace62382-ec06-454e-90be-0c567174142e tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] [instance: a3e27550-bea7-476f-9f87-0959b4f70f5f] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:03:41.539143 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ace62382-ec06-454e-90be-0c567174142e tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:41.539655 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ace62382-ec06-454e-90be-0c567174142e tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:41.540414 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ace62382-ec06-454e-90be-0c567174142e tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:41.540852 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-ace62382-ec06-454e-90be-0c567174142e tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:41.688905 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-dad4c94a-a3eb-4f38-894d-ed5e7583f6f2 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:03:41.689525 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-dad4c94a-a3eb-4f38-894d-ed5e7583f6f2 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] [instance: 6dc56556-ace0-40cd-8f2e-d8fece4412e9] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:03:41.694147 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-ace62382-ec06-454e-90be-0c567174142e tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccd3de89cd94e5fa4c488c16d993241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c8c84b3f704d528ea772607da56ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:03:41.699635 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-dad4c94a-a3eb-4f38-894d-ed5e7583f6f2 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:41.700651 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-dad4c94a-a3eb-4f38-894d-ed5e7583f6f2 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:41.702122 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-dad4c94a-a3eb-4f38-894d-ed5e7583f6f2 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:41.703318 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-dad4c94a-a3eb-4f38-894d-ed5e7583f6f2 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:41.704168 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-ace62382-ec06-454e-90be-0c567174142e tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] 10.222.0.26 "GET /compute/v2.1/servers/a3e27550-bea7-476f-9f87-0959b4f70f5f" status: 200 len: 1266 microversion: 2.1 time: 0.175847 Jul 11 12:03:41.705745 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1560/3117] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:03:41 2022] GET /compute/v2.1/servers/a3e27550-bea7-476f-9f87-0959b4f70f5f => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:03:41.772539 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [req-4d856270-daf6-4a12-b383-ee073e4032cd req-58aaba07-16ca-4036-8923-a7b2faffdf6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dc56556-ace0-40cd-8f2e-d8fece4412e9", "name": "network-vif-plugged", "status": "completed", "tag": "e8bfdf4d-ab82-479d-85eb-97c40021c54f"}]} {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 12:03:41.784668 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [req-4d856270-daf6-4a12-b383-ee073e4032cd req-58aaba07-16ca-4036-8923-a7b2faffdf6b service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:41.785193 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [req-4d856270-daf6-4a12-b383-ee073e4032cd req-58aaba07-16ca-4036-8923-a7b2faffdf6b service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:41.812646 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.compute.server_external_events [req-4d856270-daf6-4a12-b383-ee073e4032cd req-58aaba07-16ca-4036-8923-a7b2faffdf6b service nova] Creating event network-vif-plugged:e8bfdf4d-ab82-479d-85eb-97c40021c54f for instance 6dc56556-ace0-40cd-8f2e-d8fece4412e9 on hv-cinder-84842 Jul 11 12:03:41.812646 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [req-4d856270-daf6-4a12-b383-ee073e4032cd req-58aaba07-16ca-4036-8923-a7b2faffdf6b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034647 Jul 11 12:03:41.812646 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1561/3118] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 12:03:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 12:03:41.854758 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-dad4c94a-a3eb-4f38-894d-ed5e7583f6f2 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa171a9679a3460bb2ee9369e4051690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ae388052ee406c8d6cc749a1ed8c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:03:41.861977 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-dad4c94a-a3eb-4f38-894d-ed5e7583f6f2 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] 10.222.0.26 "GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9" status: 200 len: 1574 microversion: 2.1 time: 0.177007 Jul 11 12:03:41.862573 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1558/3119] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:03:41 2022] GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9 => generated 1574 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 12:03:42.723643 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-70b1b479-93b8-48fa-acda-5db257c36424 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:03:42.724334 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-70b1b479-93b8-48fa-acda-5db257c36424 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] [instance: a3e27550-bea7-476f-9f87-0959b4f70f5f] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:03:42.726682 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=3 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:03:42.731660 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-70b1b479-93b8-48fa-acda-5db257c36424 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:42.732112 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-70b1b479-93b8-48fa-acda-5db257c36424 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:42.732861 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-70b1b479-93b8-48fa-acda-5db257c36424 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:42.733295 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-70b1b479-93b8-48fa-acda-5db257c36424 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:42.864335 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-70b1b479-93b8-48fa-acda-5db257c36424 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccd3de89cd94e5fa4c488c16d993241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c8c84b3f704d528ea772607da56ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:03:42.871641 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-70b1b479-93b8-48fa-acda-5db257c36424 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] 10.222.0.26 "GET /compute/v2.1/servers/a3e27550-bea7-476f-9f87-0959b4f70f5f" status: 200 len: 1266 microversion: 2.1 time: 0.152847 Jul 11 12:03:42.872207 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1562/3120] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:03:42 2022] GET /compute/v2.1/servers/a3e27550-bea7-476f-9f87-0959b4f70f5f => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:03:42.879790 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-cf1f1ac5-a1ba-4602-864f-110c4d9c98aa tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:03:42.880428 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-cf1f1ac5-a1ba-4602-864f-110c4d9c98aa tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] [instance: 6dc56556-ace0-40cd-8f2e-d8fece4412e9] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:03:42.882838 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:03:42.887514 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-cf1f1ac5-a1ba-4602-864f-110c4d9c98aa tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:42.887957 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-cf1f1ac5-a1ba-4602-864f-110c4d9c98aa tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:42.888704 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-cf1f1ac5-a1ba-4602-864f-110c4d9c98aa tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:42.889134 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-cf1f1ac5-a1ba-4602-864f-110c4d9c98aa tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:43.017510 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-cf1f1ac5-a1ba-4602-864f-110c4d9c98aa tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa171a9679a3460bb2ee9369e4051690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ae388052ee406c8d6cc749a1ed8c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:03:43.024869 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-cf1f1ac5-a1ba-4602-864f-110c4d9c98aa tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] 10.222.0.26 "GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9" status: 200 len: 1574 microversion: 2.1 time: 0.149493 Jul 11 12:03:43.025439 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1559/3121] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:03:42 2022] GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9 => generated 1574 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:03:43.824620 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [req-d2a92804-481b-4537-88b9-0848fadcd2b1 req-1a6b552d-290a-4f91-9dcb-ebab7cb6c86d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3e27550-bea7-476f-9f87-0959b4f70f5f", "name": "network-vif-plugged", "status": "completed", "tag": "1af9c038-cece-4cea-a40d-f3d876bdddc2"}]} {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 12:03:43.833904 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [req-d2a92804-481b-4537-88b9-0848fadcd2b1 req-1a6b552d-290a-4f91-9dcb-ebab7cb6c86d service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:43.834348 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [req-d2a92804-481b-4537-88b9-0848fadcd2b1 req-1a6b552d-290a-4f91-9dcb-ebab7cb6c86d service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:43.845505 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.compute.server_external_events [req-d2a92804-481b-4537-88b9-0848fadcd2b1 req-1a6b552d-290a-4f91-9dcb-ebab7cb6c86d service nova] Creating event network-vif-plugged:1af9c038-cece-4cea-a40d-f3d876bdddc2 for instance a3e27550-bea7-476f-9f87-0959b4f70f5f on hv-cinder-84842 Jul 11 12:03:43.850423 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [req-d2a92804-481b-4537-88b9-0848fadcd2b1 req-1a6b552d-290a-4f91-9dcb-ebab7cb6c86d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029513 Jul 11 12:03:43.851069 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1563/3122] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 12:03:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 12:03:43.889111 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-2db07f0d-9d60-434e-be8e-871f8556ba35 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:03:43.889715 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-2db07f0d-9d60-434e-be8e-871f8556ba35 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] [instance: a3e27550-bea7-476f-9f87-0959b4f70f5f] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:03:43.897019 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2db07f0d-9d60-434e-be8e-871f8556ba35 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:43.897460 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2db07f0d-9d60-434e-be8e-871f8556ba35 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:43.898216 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2db07f0d-9d60-434e-be8e-871f8556ba35 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:43.898643 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2db07f0d-9d60-434e-be8e-871f8556ba35 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:44.033187 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-2db07f0d-9d60-434e-be8e-871f8556ba35 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccd3de89cd94e5fa4c488c16d993241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c8c84b3f704d528ea772607da56ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:03:44.041520 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-2db07f0d-9d60-434e-be8e-871f8556ba35 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] 10.222.0.26 "GET /compute/v2.1/servers/a3e27550-bea7-476f-9f87-0959b4f70f5f" status: 200 len: 1266 microversion: 2.1 time: 0.156188 Jul 11 12:03:44.042032 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1560/3123] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:03:43 2022] GET /compute/v2.1/servers/a3e27550-bea7-476f-9f87-0959b4f70f5f => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 12:03:44.042498 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-dcc72966-222a-4eb5-8c12-5ac9d5e4c058 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:03:44.043193 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-dcc72966-222a-4eb5-8c12-5ac9d5e4c058 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] [instance: 6dc56556-ace0-40cd-8f2e-d8fece4412e9] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:03:44.049448 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-dcc72966-222a-4eb5-8c12-5ac9d5e4c058 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:44.053958 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-dcc72966-222a-4eb5-8c12-5ac9d5e4c058 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:44.053958 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-dcc72966-222a-4eb5-8c12-5ac9d5e4c058 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:44.053958 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-dcc72966-222a-4eb5-8c12-5ac9d5e4c058 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:44.181102 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-dcc72966-222a-4eb5-8c12-5ac9d5e4c058 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa171a9679a3460bb2ee9369e4051690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ae388052ee406c8d6cc749a1ed8c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:03:44.189142 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-dcc72966-222a-4eb5-8c12-5ac9d5e4c058 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] 10.222.0.26 "GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9" status: 200 len: 1561 microversion: 2.1 time: 0.150102 Jul 11 12:03:44.189719 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1564/3124] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:03:44 2022] GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 12:03:45.059067 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-68ea327e-f2c2-46e8-99c6-43966c1f189e tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:03:45.059705 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-68ea327e-f2c2-46e8-99c6-43966c1f189e tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] [instance: a3e27550-bea7-476f-9f87-0959b4f70f5f] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:03:45.066179 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-68ea327e-f2c2-46e8-99c6-43966c1f189e tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:45.066664 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-68ea327e-f2c2-46e8-99c6-43966c1f189e tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:45.067454 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-68ea327e-f2c2-46e8-99c6-43966c1f189e tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:45.067893 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-68ea327e-f2c2-46e8-99c6-43966c1f189e tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:45.199628 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-68ea327e-f2c2-46e8-99c6-43966c1f189e tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccd3de89cd94e5fa4c488c16d993241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c8c84b3f704d528ea772607da56ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:03:45.207900 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-68ea327e-f2c2-46e8-99c6-43966c1f189e tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] 10.222.0.26 "GET /compute/v2.1/servers/a3e27550-bea7-476f-9f87-0959b4f70f5f" status: 200 len: 1266 microversion: 2.1 time: 0.152641 Jul 11 12:03:45.208471 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1561/3125] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:03:45 2022] GET /compute/v2.1/servers/a3e27550-bea7-476f-9f87-0959b4f70f5f => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:03:46.225212 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-be12e338-ac16-4fb8-b637-c547e5f20e51 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:03:46.225832 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-be12e338-ac16-4fb8-b637-c547e5f20e51 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] [instance: a3e27550-bea7-476f-9f87-0959b4f70f5f] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:03:46.232020 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-be12e338-ac16-4fb8-b637-c547e5f20e51 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:46.235195 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-be12e338-ac16-4fb8-b637-c547e5f20e51 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:46.235195 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-be12e338-ac16-4fb8-b637-c547e5f20e51 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:46.235195 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-be12e338-ac16-4fb8-b637-c547e5f20e51 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:46.375890 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-be12e338-ac16-4fb8-b637-c547e5f20e51 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccd3de89cd94e5fa4c488c16d993241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c8c84b3f704d528ea772607da56ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:03:46.383305 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-be12e338-ac16-4fb8-b637-c547e5f20e51 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] 10.222.0.26 "GET /compute/v2.1/servers/a3e27550-bea7-476f-9f87-0959b4f70f5f" status: 200 len: 1453 microversion: 2.1 time: 0.162438 Jul 11 12:03:46.383871 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1565/3126] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:03:46 2022] GET /compute/v2.1/servers/a3e27550-bea7-476f-9f87-0959b4f70f5f => generated 1453 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:03:46.398737 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-c2ecf838-3cd8-4048-ad59-832497cfda5d tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:03:46.399373 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-c2ecf838-3cd8-4048-ad59-832497cfda5d tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] [instance: a3e27550-bea7-476f-9f87-0959b4f70f5f] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:03:46.405683 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c2ecf838-3cd8-4048-ad59-832497cfda5d tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:46.406126 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c2ecf838-3cd8-4048-ad59-832497cfda5d tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:46.406874 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c2ecf838-3cd8-4048-ad59-832497cfda5d tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:46.407329 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c2ecf838-3cd8-4048-ad59-832497cfda5d tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:46.411740 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=100 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:03:46.541398 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-c2ecf838-3cd8-4048-ad59-832497cfda5d tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccd3de89cd94e5fa4c488c16d993241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c8c84b3f704d528ea772607da56ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:03:46.548792 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-c2ecf838-3cd8-4048-ad59-832497cfda5d tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] 10.222.0.26 "GET /compute/v2.1/servers/a3e27550-bea7-476f-9f87-0959b4f70f5f" status: 200 len: 1453 microversion: 2.1 time: 0.153808 Jul 11 12:03:46.549357 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1562/3127] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:03:46 2022] GET /compute/v2.1/servers/a3e27550-bea7-476f-9f87-0959b4f70f5f => generated 1453 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:03:48.619563 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [req-6eb0dfc9-7f8d-4f6d-8bc4-92a1118f8aec req-1b78b104-068d-41a9-81d4-a43b17c5a3a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3e27550-bea7-476f-9f87-0959b4f70f5f", "tag": "1af9c038-cece-4cea-a40d-f3d876bdddc2"}]} {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 12:03:48.628261 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [req-6eb0dfc9-7f8d-4f6d-8bc4-92a1118f8aec req-1b78b104-068d-41a9-81d4-a43b17c5a3a6 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:03:48.628703 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [req-6eb0dfc9-7f8d-4f6d-8bc4-92a1118f8aec req-1b78b104-068d-41a9-81d4-a43b17c5a3a6 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:03:48.641224 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.compute.server_external_events [req-6eb0dfc9-7f8d-4f6d-8bc4-92a1118f8aec req-1b78b104-068d-41a9-81d4-a43b17c5a3a6 service nova] Creating event network-changed:1af9c038-cece-4cea-a40d-f3d876bdddc2 for instance a3e27550-bea7-476f-9f87-0959b4f70f5f on hv-cinder-84842 Jul 11 12:03:48.646802 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [req-6eb0dfc9-7f8d-4f6d-8bc4-92a1118f8aec req-1b78b104-068d-41a9-81d4-a43b17c5a3a6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030895 Jul 11 12:03:48.647665 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1566/3128] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 12:03:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 12:04:58.136949 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_api:SELECT=7 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:04:58.137952 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=4 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:04:58.142025 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-566e5fe5-9de6-457d-889b-920101cf55b2 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:04:58.142525 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-566e5fe5-9de6-457d-889b-920101cf55b2 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] [instance: 6dc56556-ace0-40cd-8f2e-d8fece4412e9] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:04:58.143941 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_api:SELECT=9 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:04:58.144774 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=60 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:04:58.151119 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-566e5fe5-9de6-457d-889b-920101cf55b2 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:04:58.151119 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-566e5fe5-9de6-457d-889b-920101cf55b2 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:04:58.151820 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-566e5fe5-9de6-457d-889b-920101cf55b2 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:04:58.152253 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-566e5fe5-9de6-457d-889b-920101cf55b2 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:04:58.178707 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-566e5fe5-9de6-457d-889b-920101cf55b2 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] [instance: 6dc56556-ace0-40cd-8f2e-d8fece4412e9] Going to try to terminate instance {{(pid=118321) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 12:04:58.211348 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [req-08ff2b52-4de9-40fd-937b-7278b31289a5 req-82d06904-f78a-4699-9a60-52488831db45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dc56556-ace0-40cd-8f2e-d8fece4412e9", "tag": "e8bfdf4d-ab82-479d-85eb-97c40021c54f"}]} {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 12:04:58.219876 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [req-08ff2b52-4de9-40fd-937b-7278b31289a5 req-82d06904-f78a-4699-9a60-52488831db45 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:04:58.220322 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [req-08ff2b52-4de9-40fd-937b-7278b31289a5 req-82d06904-f78a-4699-9a60-52488831db45 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:04:58.231751 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.compute.server_external_events [req-08ff2b52-4de9-40fd-937b-7278b31289a5 req-82d06904-f78a-4699-9a60-52488831db45 service nova] Creating event network-changed:e8bfdf4d-ab82-479d-85eb-97c40021c54f for instance 6dc56556-ace0-40cd-8f2e-d8fece4412e9 on hv-cinder-84842 Jul 11 12:04:58.236841 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [req-08ff2b52-4de9-40fd-937b-7278b31289a5 req-82d06904-f78a-4699-9a60-52488831db45 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099618 Jul 11 12:04:58.237424 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1567/3129] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 12:04:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 12:04:58.488654 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-566e5fe5-9de6-457d-889b-920101cf55b2 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9" status: 204 len: 0 microversion: 2.1 time: 0.353508 Jul 11 12:04:58.494457 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1563/3130] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 11 12:04:58 2022] DELETE /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 11 12:04:58.504741 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-1097d932-76e8-49bd-9256-0c03cdc83cb0 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:04:58.504741 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-1097d932-76e8-49bd-9256-0c03cdc83cb0 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] [instance: 6dc56556-ace0-40cd-8f2e-d8fece4412e9] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:04:58.507704 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1097d932-76e8-49bd-9256-0c03cdc83cb0 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:04:58.508276 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1097d932-76e8-49bd-9256-0c03cdc83cb0 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:04:58.509000 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1097d932-76e8-49bd-9256-0c03cdc83cb0 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:04:58.509443 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-1097d932-76e8-49bd-9256-0c03cdc83cb0 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:04:58.695152 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-1097d932-76e8-49bd-9256-0c03cdc83cb0 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa171a9679a3460bb2ee9369e4051690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ae388052ee406c8d6cc749a1ed8c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:04:58.702643 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-1097d932-76e8-49bd-9256-0c03cdc83cb0 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] 10.222.0.26 "GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9" status: 200 len: 1567 microversion: 2.1 time: 0.206540 Jul 11 12:04:58.703207 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1568/3131] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:04:58 2022] GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9 => generated 1567 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 12:04:59.721669 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-715206e2-637a-47b9-b5e9-4d77315ebadb tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:04:59.722361 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-715206e2-637a-47b9-b5e9-4d77315ebadb tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] [instance: 6dc56556-ace0-40cd-8f2e-d8fece4412e9] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:04:59.729509 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-715206e2-637a-47b9-b5e9-4d77315ebadb tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:04:59.729956 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-715206e2-637a-47b9-b5e9-4d77315ebadb tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:04:59.730710 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-715206e2-637a-47b9-b5e9-4d77315ebadb tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:04:59.731143 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-715206e2-637a-47b9-b5e9-4d77315ebadb tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:04:59.939100 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-715206e2-637a-47b9-b5e9-4d77315ebadb tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa171a9679a3460bb2ee9369e4051690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ae388052ee406c8d6cc749a1ed8c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:04:59.946855 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-715206e2-637a-47b9-b5e9-4d77315ebadb tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] 10.222.0.26 "GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9" status: 200 len: 1567 microversion: 2.1 time: 0.229404 Jul 11 12:04:59.952499 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1564/3132] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:04:59 2022] GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9 => generated 1567 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:05:00.499110 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [req-086356f8-60f0-40b4-ad7c-daad569879fb req-78dc11fc-d322-4647-bbcd-53179a15f8c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dc56556-ace0-40cd-8f2e-d8fece4412e9", "name": "network-vif-deleted", "tag": "e8bfdf4d-ab82-479d-85eb-97c40021c54f"}]} {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 12:05:00.507716 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [req-086356f8-60f0-40b4-ad7c-daad569879fb req-78dc11fc-d322-4647-bbcd-53179a15f8c9 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:05:00.508216 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [req-086356f8-60f0-40b4-ad7c-daad569879fb req-78dc11fc-d322-4647-bbcd-53179a15f8c9 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:05:00.519588 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.compute.server_external_events [req-086356f8-60f0-40b4-ad7c-daad569879fb req-78dc11fc-d322-4647-bbcd-53179a15f8c9 service nova] Creating event network-vif-deleted:e8bfdf4d-ab82-479d-85eb-97c40021c54f for instance 6dc56556-ace0-40cd-8f2e-d8fece4412e9 on hv-cinder-84842 Jul 11 12:05:00.525057 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [req-086356f8-60f0-40b4-ad7c-daad569879fb req-78dc11fc-d322-4647-bbcd-53179a15f8c9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029089 Jul 11 12:05:00.525784 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1569/3133] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 12:05:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 12:05:00.964419 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-bde545be-b84d-4616-bcf8-24ae55411ed5 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:05:00.965136 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-bde545be-b84d-4616-bcf8-24ae55411ed5 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] [instance: 6dc56556-ace0-40cd-8f2e-d8fece4412e9] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:05:00.971759 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bde545be-b84d-4616-bcf8-24ae55411ed5 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:05:00.972203 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bde545be-b84d-4616-bcf8-24ae55411ed5 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:05:00.972953 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bde545be-b84d-4616-bcf8-24ae55411ed5 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:05:00.973379 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bde545be-b84d-4616-bcf8-24ae55411ed5 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:05:01.036336 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-bde545be-b84d-4616-bcf8-24ae55411ed5 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa171a9679a3460bb2ee9369e4051690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ae388052ee406c8d6cc749a1ed8c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:05:01.044351 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-bde545be-b84d-4616-bcf8-24ae55411ed5 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] 10.222.0.26 "GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9" status: 200 len: 1218 microversion: 2.1 time: 0.084115 Jul 11 12:05:01.044918 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1565/3134] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:05:00 2022] GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:05:02.062116 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-5ad94c17-7cda-41a3-ac4c-c4b4f26391cd tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:05:02.062803 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-5ad94c17-7cda-41a3-ac4c-c4b4f26391cd tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] [instance: 6dc56556-ace0-40cd-8f2e-d8fece4412e9] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:05:02.068967 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5ad94c17-7cda-41a3-ac4c-c4b4f26391cd tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:05:02.069414 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5ad94c17-7cda-41a3-ac4c-c4b4f26391cd tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:05:02.070161 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5ad94c17-7cda-41a3-ac4c-c4b4f26391cd tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:05:02.070591 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-5ad94c17-7cda-41a3-ac4c-c4b4f26391cd tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:05:02.084310 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.wsgi [None req-5ad94c17-7cda-41a3-ac4c-c4b4f26391cd tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] HTTP exception thrown: Instance 6dc56556-ace0-40cd-8f2e-d8fece4412e9 could not be found. Jul 11 12:05:02.085933 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-5ad94c17-7cda-41a3-ac4c-c4b4f26391cd tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Request method failure captured: Jul 11 12:05:02.085933 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: request: GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9 HTTP/1.1 Jul 11 12:05:02.085933 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Accept: application/json Jul 11 12:05:02.085933 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Accept-Encoding: identity Jul 11 12:05:02.085933 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Connection: close Jul 11 12:05:02.085933 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Content-Length: 0 Jul 11 12:05:02.085933 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Content-Type: application/json Jul 11 12:05:02.085933 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Host: 10.222.0.26 Jul 11 12:05:02.085933 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Openstack-System-Scope: None Jul 11 12:05:02.085933 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: User-Agent: python-urllib3/1.26.9 Jul 11 12:05:02.085933 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Auth-Token: gAAAAABizBC7yWLiOhjtoVIY9tybvWg60pBOXwn4I95dLTC53qGdkk11Y6FZZkTevi4gHakaABWlWM6WScLewEF6fnytZ7Abq8uHRt7cX3eR5-HploTLbBSQ4q-V1gS_UPLUosN3TWnoJH5kKWvJPoBT0xq6VMW-MYhhxkIRabMKz8b9tWwbFaY Jul 11 12:05:02.085933 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Domain-Id: None Jul 11 12:05:02.085933 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Domain-Name: None Jul 11 12:05:02.085933 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Identity-Status: Confirmed Jul 11 12:05:02.085933 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Is-Admin-Project: True Jul 11 12:05:02.085933 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Domain-Id: default Jul 11 12:05:02.085933 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Domain-Name: Default Jul 11 12:05:02.085933 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Id: 59ae388052ee406c8d6cc749a1ed8c02 Jul 11 12:05:02.085933 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Name: tempest-TestShelveInstance-414289644 Jul 11 12:05:02.085933 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Role: member,reader Jul 11 12:05:02.085933 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Roles: member,reader Jul 11 12:05:02.088321 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_59ae388052ee406c8d6cc749a1ed8c02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/59ae388052ee406c8d6cc749a1ed8c02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/59ae388052ee406c8d6cc749a1ed8c02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/59ae388052ee406c8d6cc749a1ed8c02"}]}] Jul 11 12:05:02.088321 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Tenant: tempest-TestShelveInstance-414289644 Jul 11 12:05:02.088321 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Tenant-Id: 59ae388052ee406c8d6cc749a1ed8c02 Jul 11 12:05:02.088321 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Tenant-Name: tempest-TestShelveInstance-414289644 Jul 11 12:05:02.088321 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User: tempest-TestShelveInstance-414289644-project Jul 11 12:05:02.088321 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Domain-Id: default Jul 11 12:05:02.088321 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Domain-Name: Default Jul 11 12:05:02.088321 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Id: fa171a9679a3460bb2ee9369e4051690 Jul 11 12:05:02.088321 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Name: tempest-TestShelveInstance-414289644-project Jul 11 12:05:02.088321 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: method: > Jul 11 12:05:02.088321 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: exception: Instance 6dc56556-ace0-40cd-8f2e-d8fece4412e9 could not be found. Jul 11 12:05:02.088321 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: action_args: {'id': '6dc56556-ace0-40cd-8f2e-d8fece4412e9'} Jul 11 12:05:02.089190 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 12:05:02.089190 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 12:05:02.089190 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 12:05:02.089190 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 12:05:02.089190 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 12:05:02.089190 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 12:05:02.089190 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 12:05:02.089190 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 12:05:02.089190 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 12:05:02.089190 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 12:05:02.089190 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dc56556-ace0-40cd-8f2e-d8fece4412e9 could not be found. Jul 11 12:05:02.089190 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 12:05:02.089190 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 12:05:02.089190 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 12:05:02.089190 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 12:05:02.089190 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 12:05:02.089190 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 12:05:02.089190 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 12:05:02.089190 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 12:05:02.089190 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 12:05:02.090598 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 12:05:02.090598 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 12:05:02.090598 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 12:05:02.090598 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 12:05:02.090598 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 12:05:02.090598 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 12:05:02.090598 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 12:05:02.090598 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dc56556-ace0-40cd-8f2e-d8fece4412e9 could not be found. Jul 11 12:05:02.090598 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 12:05:02.090598 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 12:05:02.090598 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 12:05:02.090598 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 12:05:02.090598 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 12:05:02.090598 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 12:05:02.090598 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 12:05:02.090598 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 12:05:02.090598 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dc56556-ace0-40cd-8f2e-d8fece4412e9 could not be found. Jul 11 12:05:02.090598 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 12:05:02.092014 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-5ad94c17-7cda-41a3-ac4c-c4b4f26391cd tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Returning 404 to user: Instance 6dc56556-ace0-40cd-8f2e-d8fece4412e9 could not be found. {{(pid=118322) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 12:05:02.092014 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-5ad94c17-7cda-41a3-ac4c-c4b4f26391cd tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] 10.222.0.26 "GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9" status: 404 len: 111 microversion: 2.1 time: 0.030868 Jul 11 12:05:02.092014 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1570/3135] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:05:02 2022] GET /compute/v2.1/servers/6dc56556-ace0-40cd-8f2e-d8fece4412e9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 12:05:02.412464 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-c2a90a9e-196e-4864-a6ee-e2582577b3a7 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] Calling method '.version_select at 0x7fb010245940>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:05:02.494177 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-c2a90a9e-196e-4864-a6ee-e2582577b3a7 tempest-TestShelveInstance-414289644 tempest-TestShelveInstance-414289644-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-247202412" status: 202 len: 0 microversion: 2.1 time: 0.188443 Jul 11 12:05:02.494774 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1566/3136] 10.222.0.26 () {58 vars in 1250 bytes} [Mon Jul 11 12:05:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-247202412 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 12:05:34.776352 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-064b4287-fc7c-4b68-bee1-9afc31a91ed6 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-408128958", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1764556180", "security_groups": [{"name": "tempest-secgroup-smoke-242625149"}], "block_device_mapping_v2": [{"uuid": "14503e3d-4ee6-4fea-bdac-19a8b2e10f91", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "cbf23430-d3c4-4909-b958-81c6ba8296b8"}]}} {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 12:05:34.784370 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_api:SELECT=8 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:05:34.788877 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=12 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:05:34.888791 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.network.neutron [None req-064b4287-fc7c-4b68-bee1-9afc31a91ed6 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] validate_networks() for [('cbf23430-d3c4-4909-b958-81c6ba8296b8', None, None, None, None, None)] {{(pid=118322) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 12:05:35.351749 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.virt.hardware [None req-064b4287-fc7c-4b68-bee1-9afc31a91ed6 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Flavor limits 0:0:0 {{(pid=118322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 12:05:35.352180 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.virt.hardware [None req-064b4287-fc7c-4b68-bee1-9afc31a91ed6 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Image limits 0:0:0 {{(pid=118322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 12:05:35.352656 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.virt.hardware [None req-064b4287-fc7c-4b68-bee1-9afc31a91ed6 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Flavor pref 0:0:0 {{(pid=118322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 12:05:35.353066 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.virt.hardware [None req-064b4287-fc7c-4b68-bee1-9afc31a91ed6 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Image pref 0:0:0 {{(pid=118322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 12:05:35.353484 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.virt.hardware [None req-064b4287-fc7c-4b68-bee1-9afc31a91ed6 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118322) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 12:05:35.362859 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-064b4287-fc7c-4b68-bee1-9afc31a91ed6 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:05:35.363331 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-064b4287-fc7c-4b68-bee1-9afc31a91ed6 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:05:35.364132 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-064b4287-fc7c-4b68-bee1-9afc31a91ed6 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:05:35.364571 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-064b4287-fc7c-4b68-bee1-9afc31a91ed6 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:05:35.382581 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.quota [None req-064b4287-fc7c-4b68-bee1-9afc31a91ed6 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Getting quotas for project 79c8c84b3f704d528ea772607da56ddf. Resources: {'cores', 'ram', 'instances'} {{(pid=118322) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 12:05:35.386581 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.quota [None req-064b4287-fc7c-4b68-bee1-9afc31a91ed6 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Getting quotas for user fccd3de89cd94e5fa4c488c16d993241 and project 79c8c84b3f704d528ea772607da56ddf. Resources: {'cores', 'ram', 'instances'} {{(pid=118322) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 12:05:35.444764 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-064b4287-fc7c-4b68-bee1-9afc31a91ed6 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Going to run 1 instances... {{(pid=118322) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 12:05:35.445522 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-064b4287-fc7c-4b68-bee1-9afc31a91ed6 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] [instance: fc61e8d3-9ba9-49df-abb6-d241b489df43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='14503e3d-4ee6-4fea-bdac-19a8b2e10f91',volume_size=None,volume_type=None)] {{(pid=118322) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 12:05:35.792401 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-064b4287-fc7c-4b68-bee1-9afc31a91ed6 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.019970 Jul 11 12:05:35.793082 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1571/3137] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jul 11 12:05:34 2022] POST /compute/v2.1/servers => generated 405 bytes in 1021 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 11 12:05:35.801376 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:05:35.802118 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:05:35.806322 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-b9751562-03d6-45f0-834b-2c67c307899d tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:05:35.806925 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-b9751562-03d6-45f0-834b-2c67c307899d tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] [instance: fc61e8d3-9ba9-49df-abb6-d241b489df43] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:05:35.864125 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-b9751562-03d6-45f0-834b-2c67c307899d tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccd3de89cd94e5fa4c488c16d993241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c8c84b3f704d528ea772607da56ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:05:35.870329 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-b9751562-03d6-45f0-834b-2c67c307899d tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] 10.222.0.26 "GET /compute/v2.1/servers/fc61e8d3-9ba9-49df-abb6-d241b489df43" status: 200 len: 1094 microversion: 2.1 time: 0.070469 Jul 11 12:05:35.870913 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1567/3138] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:05:35 2022] GET /compute/v2.1/servers/fc61e8d3-9ba9-49df-abb6-d241b489df43 => generated 1094 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:05:36.887504 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-9ca55ecb-d28f-4490-90aa-5fb353735bb1 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:05:36.888120 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-9ca55ecb-d28f-4490-90aa-5fb353735bb1 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] [instance: fc61e8d3-9ba9-49df-abb6-d241b489df43] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:05:36.894622 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9ca55ecb-d28f-4490-90aa-5fb353735bb1 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:05:36.895119 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9ca55ecb-d28f-4490-90aa-5fb353735bb1 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:05:36.895923 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9ca55ecb-d28f-4490-90aa-5fb353735bb1 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:05:36.896366 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-9ca55ecb-d28f-4490-90aa-5fb353735bb1 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:05:36.958933 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-9ca55ecb-d28f-4490-90aa-5fb353735bb1 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccd3de89cd94e5fa4c488c16d993241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c8c84b3f704d528ea772607da56ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:05:36.966938 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-9ca55ecb-d28f-4490-90aa-5fb353735bb1 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] 10.222.0.26 "GET /compute/v2.1/servers/fc61e8d3-9ba9-49df-abb6-d241b489df43" status: 200 len: 1136 microversion: 2.1 time: 0.083798 Jul 11 12:05:36.967536 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1572/3139] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:05:36 2022] GET /compute/v2.1/servers/fc61e8d3-9ba9-49df-abb6-d241b489df43 => generated 1136 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:05:37.984410 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-3178a23c-fc35-4144-bc8c-658ba8e721e2 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:05:37.985011 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-3178a23c-fc35-4144-bc8c-658ba8e721e2 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] [instance: fc61e8d3-9ba9-49df-abb6-d241b489df43] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:05:37.993332 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3178a23c-fc35-4144-bc8c-658ba8e721e2 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:05:37.994179 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3178a23c-fc35-4144-bc8c-658ba8e721e2 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:05:37.994612 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3178a23c-fc35-4144-bc8c-658ba8e721e2 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:05:37.995607 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-3178a23c-fc35-4144-bc8c-658ba8e721e2 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:05:38.069249 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-3178a23c-fc35-4144-bc8c-658ba8e721e2 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccd3de89cd94e5fa4c488c16d993241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c8c84b3f704d528ea772607da56ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:05:38.087497 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-3178a23c-fc35-4144-bc8c-658ba8e721e2 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] 10.222.0.26 "GET /compute/v2.1/servers/fc61e8d3-9ba9-49df-abb6-d241b489df43" status: 200 len: 1210 microversion: 2.1 time: 0.097149 Jul 11 12:05:38.087497 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1568/3140] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:05:37 2022] GET /compute/v2.1/servers/fc61e8d3-9ba9-49df-abb6-d241b489df43 => generated 1210 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:05:39.096124 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-d65119a1-1ccd-4f9e-839a-e531ea2271fe tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:05:39.096858 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-d65119a1-1ccd-4f9e-839a-e531ea2271fe tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] [instance: fc61e8d3-9ba9-49df-abb6-d241b489df43] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:05:39.103342 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d65119a1-1ccd-4f9e-839a-e531ea2271fe tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:05:39.103862 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d65119a1-1ccd-4f9e-839a-e531ea2271fe tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:05:39.104685 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d65119a1-1ccd-4f9e-839a-e531ea2271fe tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:05:39.105191 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-d65119a1-1ccd-4f9e-839a-e531ea2271fe tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:05:39.240180 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-d65119a1-1ccd-4f9e-839a-e531ea2271fe tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccd3de89cd94e5fa4c488c16d993241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c8c84b3f704d528ea772607da56ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:05:39.249071 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-d65119a1-1ccd-4f9e-839a-e531ea2271fe tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] 10.222.0.26 "GET /compute/v2.1/servers/fc61e8d3-9ba9-49df-abb6-d241b489df43" status: 200 len: 1265 microversion: 2.1 time: 0.156583 Jul 11 12:05:39.249902 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1573/3141] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:05:39 2022] GET /compute/v2.1/servers/fc61e8d3-9ba9-49df-abb6-d241b489df43 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:05:39.446995 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [req-43539737-8c03-4623-be00-f322bb1a817a req-cf38e0a3-aa5e-43dd-896b-6f6fcb114119 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc61e8d3-9ba9-49df-abb6-d241b489df43", "tag": "f803f441-8d77-4505-a12c-43c56212b371"}]} {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 12:05:39.457169 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [req-43539737-8c03-4623-be00-f322bb1a817a req-cf38e0a3-aa5e-43dd-896b-6f6fcb114119 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:05:39.457608 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [req-43539737-8c03-4623-be00-f322bb1a817a req-cf38e0a3-aa5e-43dd-896b-6f6fcb114119 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:05:39.470426 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.compute.server_external_events [req-43539737-8c03-4623-be00-f322bb1a817a req-cf38e0a3-aa5e-43dd-896b-6f6fcb114119 service nova] Creating event network-changed:f803f441-8d77-4505-a12c-43c56212b371 for instance fc61e8d3-9ba9-49df-abb6-d241b489df43 on hv-cinder-84842 Jul 11 12:05:39.476197 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [req-43539737-8c03-4623-be00-f322bb1a817a req-cf38e0a3-aa5e-43dd-896b-6f6fcb114119 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034363 Jul 11 12:05:39.476787 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1569/3142] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 12:05:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 12:05:40.266320 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-28731fe0-fd43-4fec-9c9f-1788b82bcf0d tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:05:40.266877 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-28731fe0-fd43-4fec-9c9f-1788b82bcf0d tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] [instance: fc61e8d3-9ba9-49df-abb6-d241b489df43] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:05:40.273300 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-28731fe0-fd43-4fec-9c9f-1788b82bcf0d tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:05:40.273745 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-28731fe0-fd43-4fec-9c9f-1788b82bcf0d tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:05:40.274499 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-28731fe0-fd43-4fec-9c9f-1788b82bcf0d tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:05:40.275012 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-28731fe0-fd43-4fec-9c9f-1788b82bcf0d tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:05:40.407810 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-28731fe0-fd43-4fec-9c9f-1788b82bcf0d tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccd3de89cd94e5fa4c488c16d993241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c8c84b3f704d528ea772607da56ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:05:40.415087 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-28731fe0-fd43-4fec-9c9f-1788b82bcf0d tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] 10.222.0.26 "GET /compute/v2.1/servers/fc61e8d3-9ba9-49df-abb6-d241b489df43" status: 200 len: 1265 microversion: 2.1 time: 0.152725 Jul 11 12:05:40.415673 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1574/3143] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:05:40 2022] GET /compute/v2.1/servers/fc61e8d3-9ba9-49df-abb6-d241b489df43 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:05:41.432228 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-a770c404-01f3-4427-81cf-d86cfc855270 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:05:41.432914 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-a770c404-01f3-4427-81cf-d86cfc855270 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] [instance: fc61e8d3-9ba9-49df-abb6-d241b489df43] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:05:41.439538 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a770c404-01f3-4427-81cf-d86cfc855270 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:05:41.439983 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a770c404-01f3-4427-81cf-d86cfc855270 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:05:41.440727 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a770c404-01f3-4427-81cf-d86cfc855270 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:05:41.441152 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a770c404-01f3-4427-81cf-d86cfc855270 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:05:41.573668 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-a770c404-01f3-4427-81cf-d86cfc855270 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccd3de89cd94e5fa4c488c16d993241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c8c84b3f704d528ea772607da56ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:05:41.580909 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-a770c404-01f3-4427-81cf-d86cfc855270 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] 10.222.0.26 "GET /compute/v2.1/servers/fc61e8d3-9ba9-49df-abb6-d241b489df43" status: 200 len: 1265 microversion: 2.1 time: 0.152818 Jul 11 12:05:41.581471 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1570/3144] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:05:41 2022] GET /compute/v2.1/servers/fc61e8d3-9ba9-49df-abb6-d241b489df43 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:05:42.598371 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-568aa594-b020-4f29-9cf9-a50fad93db16 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:05:42.599013 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-568aa594-b020-4f29-9cf9-a50fad93db16 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] [instance: fc61e8d3-9ba9-49df-abb6-d241b489df43] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:05:42.608461 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-568aa594-b020-4f29-9cf9-a50fad93db16 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:05:42.609038 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-568aa594-b020-4f29-9cf9-a50fad93db16 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:05:42.610772 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-568aa594-b020-4f29-9cf9-a50fad93db16 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:05:42.611222 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-568aa594-b020-4f29-9cf9-a50fad93db16 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:05:42.738065 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-568aa594-b020-4f29-9cf9-a50fad93db16 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccd3de89cd94e5fa4c488c16d993241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c8c84b3f704d528ea772607da56ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:05:42.745473 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-568aa594-b020-4f29-9cf9-a50fad93db16 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] 10.222.0.26 "GET /compute/v2.1/servers/fc61e8d3-9ba9-49df-abb6-d241b489df43" status: 200 len: 1265 microversion: 2.1 time: 0.150944 Jul 11 12:05:42.746040 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1575/3145] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:05:42 2022] GET /compute/v2.1/servers/fc61e8d3-9ba9-49df-abb6-d241b489df43 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:05:43.762780 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-6b148144-6cdd-4448-a9e9-e4e3edd96df4 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:05:43.763440 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-6b148144-6cdd-4448-a9e9-e4e3edd96df4 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] [instance: fc61e8d3-9ba9-49df-abb6-d241b489df43] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:05:43.769903 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6b148144-6cdd-4448-a9e9-e4e3edd96df4 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:05:43.770345 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6b148144-6cdd-4448-a9e9-e4e3edd96df4 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:05:43.771121 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6b148144-6cdd-4448-a9e9-e4e3edd96df4 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:05:43.771572 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-6b148144-6cdd-4448-a9e9-e4e3edd96df4 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:05:43.897211 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-6b148144-6cdd-4448-a9e9-e4e3edd96df4 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccd3de89cd94e5fa4c488c16d993241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c8c84b3f704d528ea772607da56ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:05:43.904519 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-6b148144-6cdd-4448-a9e9-e4e3edd96df4 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] 10.222.0.26 "GET /compute/v2.1/servers/fc61e8d3-9ba9-49df-abb6-d241b489df43" status: 200 len: 1265 microversion: 2.1 time: 0.146175 Jul 11 12:05:43.905088 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1571/3146] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:05:43 2022] GET /compute/v2.1/servers/fc61e8d3-9ba9-49df-abb6-d241b489df43 => generated 1265 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:05:44.921493 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-0f96c183-200b-415c-9ec0-f37eaae077a5 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:05:44.922107 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-0f96c183-200b-415c-9ec0-f37eaae077a5 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] [instance: fc61e8d3-9ba9-49df-abb6-d241b489df43] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:05:44.928774 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0f96c183-200b-415c-9ec0-f37eaae077a5 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:05:44.929191 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0f96c183-200b-415c-9ec0-f37eaae077a5 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:05:44.929953 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0f96c183-200b-415c-9ec0-f37eaae077a5 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:05:44.930392 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-0f96c183-200b-415c-9ec0-f37eaae077a5 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:05:45.061039 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-0f96c183-200b-415c-9ec0-f37eaae077a5 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccd3de89cd94e5fa4c488c16d993241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c8c84b3f704d528ea772607da56ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:05:45.068454 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-0f96c183-200b-415c-9ec0-f37eaae077a5 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] 10.222.0.26 "GET /compute/v2.1/servers/fc61e8d3-9ba9-49df-abb6-d241b489df43" status: 200 len: 1265 microversion: 2.1 time: 0.150841 Jul 11 12:05:45.069026 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1576/3147] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:05:44 2022] GET /compute/v2.1/servers/fc61e8d3-9ba9-49df-abb6-d241b489df43 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:05:46.085489 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-b287d3eb-9c79-4c98-a1d2-6980e3bfc7de tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:05:46.086096 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-b287d3eb-9c79-4c98-a1d2-6980e3bfc7de tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] [instance: fc61e8d3-9ba9-49df-abb6-d241b489df43] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:05:46.088845 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell0:SELECT=2 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:05:46.093687 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b287d3eb-9c79-4c98-a1d2-6980e3bfc7de tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:05:46.094131 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b287d3eb-9c79-4c98-a1d2-6980e3bfc7de tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:05:46.094879 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b287d3eb-9c79-4c98-a1d2-6980e3bfc7de tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:05:46.095351 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-b287d3eb-9c79-4c98-a1d2-6980e3bfc7de tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:05:46.223429 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-b287d3eb-9c79-4c98-a1d2-6980e3bfc7de tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccd3de89cd94e5fa4c488c16d993241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c8c84b3f704d528ea772607da56ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:05:46.231376 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-b287d3eb-9c79-4c98-a1d2-6980e3bfc7de tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] 10.222.0.26 "GET /compute/v2.1/servers/fc61e8d3-9ba9-49df-abb6-d241b489df43" status: 200 len: 1265 microversion: 2.1 time: 0.149700 Jul 11 12:05:46.231944 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1572/3148] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:05:46 2022] GET /compute/v2.1/servers/fc61e8d3-9ba9-49df-abb6-d241b489df43 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:05:47.248443 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-c800ff2b-1583-4190-b040-dc2aaf1585e3 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:05:47.249053 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-c800ff2b-1583-4190-b040-dc2aaf1585e3 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] [instance: fc61e8d3-9ba9-49df-abb6-d241b489df43] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:05:47.250861 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell0:SELECT=2 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:05:47.251674 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell0:SELECT=6 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:05:47.256784 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c800ff2b-1583-4190-b040-dc2aaf1585e3 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:05:47.257232 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c800ff2b-1583-4190-b040-dc2aaf1585e3 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:05:47.257987 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c800ff2b-1583-4190-b040-dc2aaf1585e3 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:05:47.258421 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c800ff2b-1583-4190-b040-dc2aaf1585e3 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:05:47.387987 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-c800ff2b-1583-4190-b040-dc2aaf1585e3 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccd3de89cd94e5fa4c488c16d993241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c8c84b3f704d528ea772607da56ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:05:47.395509 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-c800ff2b-1583-4190-b040-dc2aaf1585e3 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] 10.222.0.26 "GET /compute/v2.1/servers/fc61e8d3-9ba9-49df-abb6-d241b489df43" status: 200 len: 1265 microversion: 2.1 time: 0.151356 Jul 11 12:05:47.396082 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1577/3149] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:05:47 2022] GET /compute/v2.1/servers/fc61e8d3-9ba9-49df-abb6-d241b489df43 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:05:48.411754 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-c9b01122-28c3-4264-8dd7-c15f374840cf tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:05:48.412401 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-c9b01122-28c3-4264-8dd7-c15f374840cf tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] [instance: fc61e8d3-9ba9-49df-abb6-d241b489df43] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:05:48.418815 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c9b01122-28c3-4264-8dd7-c15f374840cf tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:05:48.420869 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c9b01122-28c3-4264-8dd7-c15f374840cf tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:05:48.420869 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c9b01122-28c3-4264-8dd7-c15f374840cf tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:05:48.420869 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-c9b01122-28c3-4264-8dd7-c15f374840cf tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:05:48.557752 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-c9b01122-28c3-4264-8dd7-c15f374840cf tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccd3de89cd94e5fa4c488c16d993241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c8c84b3f704d528ea772607da56ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:05:48.565441 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-c9b01122-28c3-4264-8dd7-c15f374840cf tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] 10.222.0.26 "GET /compute/v2.1/servers/fc61e8d3-9ba9-49df-abb6-d241b489df43" status: 200 len: 1265 microversion: 2.1 time: 0.157480 Jul 11 12:05:48.566016 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1573/3150] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:05:48 2022] GET /compute/v2.1/servers/fc61e8d3-9ba9-49df-abb6-d241b489df43 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:05:49.582431 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-b2ba449e-b475-472e-9d10-b913d46604d5 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:05:49.583035 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-b2ba449e-b475-472e-9d10-b913d46604d5 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] [instance: fc61e8d3-9ba9-49df-abb6-d241b489df43] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:05:49.589729 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b2ba449e-b475-472e-9d10-b913d46604d5 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:05:49.590171 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b2ba449e-b475-472e-9d10-b913d46604d5 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:05:49.590916 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b2ba449e-b475-472e-9d10-b913d46604d5 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:05:49.591372 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-b2ba449e-b475-472e-9d10-b913d46604d5 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:05:49.719590 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-b2ba449e-b475-472e-9d10-b913d46604d5 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccd3de89cd94e5fa4c488c16d993241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c8c84b3f704d528ea772607da56ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:05:49.726954 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-b2ba449e-b475-472e-9d10-b913d46604d5 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] 10.222.0.26 "GET /compute/v2.1/servers/fc61e8d3-9ba9-49df-abb6-d241b489df43" status: 200 len: 1265 microversion: 2.1 time: 0.148337 Jul 11 12:05:49.727531 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1578/3151] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:05:49 2022] GET /compute/v2.1/servers/fc61e8d3-9ba9-49df-abb6-d241b489df43 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:05:50.482800 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [req-e2bf203b-b822-4d5e-9b77-8324a4cd86cc req-804fdebb-e705-4672-906b-620951f41359 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc61e8d3-9ba9-49df-abb6-d241b489df43", "name": "network-vif-plugged", "status": "completed", "tag": "f803f441-8d77-4505-a12c-43c56212b371"}]} {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 12:05:50.490653 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [req-e2bf203b-b822-4d5e-9b77-8324a4cd86cc req-804fdebb-e705-4672-906b-620951f41359 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:05:50.491735 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [req-e2bf203b-b822-4d5e-9b77-8324a4cd86cc req-804fdebb-e705-4672-906b-620951f41359 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:05:50.501952 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.compute.server_external_events [req-e2bf203b-b822-4d5e-9b77-8324a4cd86cc req-804fdebb-e705-4672-906b-620951f41359 service nova] Creating event network-vif-plugged:f803f441-8d77-4505-a12c-43c56212b371 for instance fc61e8d3-9ba9-49df-abb6-d241b489df43 on hv-cinder-84842 Jul 11 12:05:50.507723 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [req-e2bf203b-b822-4d5e-9b77-8324a4cd86cc req-804fdebb-e705-4672-906b-620951f41359 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146297 Jul 11 12:05:50.508344 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1574/3152] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 12:05:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 12:05:50.743548 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-f0faa295-1447-453c-b647-ca61ac69fcc5 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:05:50.744222 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-f0faa295-1447-453c-b647-ca61ac69fcc5 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] [instance: fc61e8d3-9ba9-49df-abb6-d241b489df43] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:05:50.750620 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f0faa295-1447-453c-b647-ca61ac69fcc5 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:05:50.751098 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f0faa295-1447-453c-b647-ca61ac69fcc5 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:05:50.751891 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f0faa295-1447-453c-b647-ca61ac69fcc5 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:05:50.752343 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f0faa295-1447-453c-b647-ca61ac69fcc5 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:05:50.887529 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-f0faa295-1447-453c-b647-ca61ac69fcc5 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccd3de89cd94e5fa4c488c16d993241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c8c84b3f704d528ea772607da56ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:05:50.894985 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-f0faa295-1447-453c-b647-ca61ac69fcc5 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] 10.222.0.26 "GET /compute/v2.1/servers/fc61e8d3-9ba9-49df-abb6-d241b489df43" status: 200 len: 1265 microversion: 2.1 time: 0.155269 Jul 11 12:05:50.895588 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1579/3153] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:05:50 2022] GET /compute/v2.1/servers/fc61e8d3-9ba9-49df-abb6-d241b489df43 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:05:51.915037 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-bc9dd788-ee47-4f95-b230-b56022bcb5bf tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:05:51.915791 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-bc9dd788-ee47-4f95-b230-b56022bcb5bf tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] [instance: fc61e8d3-9ba9-49df-abb6-d241b489df43] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:05:51.923297 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bc9dd788-ee47-4f95-b230-b56022bcb5bf tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:05:51.931575 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bc9dd788-ee47-4f95-b230-b56022bcb5bf tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:05:51.931575 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bc9dd788-ee47-4f95-b230-b56022bcb5bf tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:05:51.931575 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-bc9dd788-ee47-4f95-b230-b56022bcb5bf tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:05:52.058712 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-bc9dd788-ee47-4f95-b230-b56022bcb5bf tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccd3de89cd94e5fa4c488c16d993241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c8c84b3f704d528ea772607da56ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:05:52.066094 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-bc9dd788-ee47-4f95-b230-b56022bcb5bf tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] 10.222.0.26 "GET /compute/v2.1/servers/fc61e8d3-9ba9-49df-abb6-d241b489df43" status: 200 len: 1265 microversion: 2.1 time: 0.157058 Jul 11 12:05:52.066651 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1575/3154] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:05:51 2022] GET /compute/v2.1/servers/fc61e8d3-9ba9-49df-abb6-d241b489df43 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:05:53.083018 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-984f4c50-84e6-44bd-bb99-fea8a16ec6ff tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:05:53.083675 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-984f4c50-84e6-44bd-bb99-fea8a16ec6ff tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] [instance: fc61e8d3-9ba9-49df-abb6-d241b489df43] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:05:53.090815 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-984f4c50-84e6-44bd-bb99-fea8a16ec6ff tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:05:53.091348 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-984f4c50-84e6-44bd-bb99-fea8a16ec6ff tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:05:53.092117 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-984f4c50-84e6-44bd-bb99-fea8a16ec6ff tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:05:53.092551 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-984f4c50-84e6-44bd-bb99-fea8a16ec6ff tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:05:53.224315 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-984f4c50-84e6-44bd-bb99-fea8a16ec6ff tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccd3de89cd94e5fa4c488c16d993241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c8c84b3f704d528ea772607da56ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:05:53.234817 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-984f4c50-84e6-44bd-bb99-fea8a16ec6ff tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] 10.222.0.26 "GET /compute/v2.1/servers/fc61e8d3-9ba9-49df-abb6-d241b489df43" status: 200 len: 1451 microversion: 2.1 time: 0.155625 Jul 11 12:05:53.235447 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1580/3155] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:05:53 2022] GET /compute/v2.1/servers/fc61e8d3-9ba9-49df-abb6-d241b489df43 => generated 1451 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:05:53.250598 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-2c727a3a-73bb-463a-9710-cc7b70c877c6 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:05:53.251216 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-2c727a3a-73bb-463a-9710-cc7b70c877c6 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] [instance: fc61e8d3-9ba9-49df-abb6-d241b489df43] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:05:53.257667 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2c727a3a-73bb-463a-9710-cc7b70c877c6 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:05:53.258116 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2c727a3a-73bb-463a-9710-cc7b70c877c6 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:05:53.258870 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2c727a3a-73bb-463a-9710-cc7b70c877c6 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:05:53.259340 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2c727a3a-73bb-463a-9710-cc7b70c877c6 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:05:53.386919 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-2c727a3a-73bb-463a-9710-cc7b70c877c6 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccd3de89cd94e5fa4c488c16d993241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c8c84b3f704d528ea772607da56ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:05:53.394280 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-2c727a3a-73bb-463a-9710-cc7b70c877c6 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] 10.222.0.26 "GET /compute/v2.1/servers/fc61e8d3-9ba9-49df-abb6-d241b489df43" status: 200 len: 1451 microversion: 2.1 time: 0.147466 Jul 11 12:05:53.394847 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1576/3156] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:05:53 2022] GET /compute/v2.1/servers/fc61e8d3-9ba9-49df-abb6-d241b489df43 => generated 1451 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:05:55.196263 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [req-84a7f1de-9060-437f-9026-121e5b86414d req-4789fd61-4626-4679-94e2-f7fa7810e3b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc61e8d3-9ba9-49df-abb6-d241b489df43", "tag": "f803f441-8d77-4505-a12c-43c56212b371"}]} {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 12:05:55.205275 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [req-84a7f1de-9060-437f-9026-121e5b86414d req-4789fd61-4626-4679-94e2-f7fa7810e3b2 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:05:55.205716 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [req-84a7f1de-9060-437f-9026-121e5b86414d req-4789fd61-4626-4679-94e2-f7fa7810e3b2 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:05:55.217703 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.compute.server_external_events [req-84a7f1de-9060-437f-9026-121e5b86414d req-4789fd61-4626-4679-94e2-f7fa7810e3b2 service nova] Creating event network-changed:f803f441-8d77-4505-a12c-43c56212b371 for instance fc61e8d3-9ba9-49df-abb6-d241b489df43 on hv-cinder-84842 Jul 11 12:05:55.222717 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [req-84a7f1de-9060-437f-9026-121e5b86414d req-4789fd61-4626-4679-94e2-f7fa7810e3b2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030078 Jul 11 12:05:55.223348 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1581/3157] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 12:05:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 12:05:58.440315 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 12:05:58.441917 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Mon Jul 11 12:05:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 12:05:59.053579 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 12:05:59.054114 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Mon Jul 11 12:05:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 12:07:35.033090 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6e7662ca-0840-4af7-a170-09ca74b9449f] AMQP server on 10.222.0.26:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 11 12:07:35.038860 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_api:SELECT=22 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:07:35.038977 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR oslo.messaging._drivers.impl_rabbit [-] [73153c7c-8222-4333-b8ec-ad525dae098f] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 11 12:07:35.038977 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:07:35.039524 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG dbcounter [-] [118321] Writing DB stats nova_cell1:SELECT=46 {{(pid=118321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:07:35.043107 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-aff3d759-8df3-4bbd-af61-bdb7444265d1 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:07:35.043629 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-aff3d759-8df3-4bbd-af61-bdb7444265d1 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] [instance: fc61e8d3-9ba9-49df-abb6-d241b489df43] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:07:35.047087 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG dbcounter [-] [118322] Writing DB stats nova_cell1:SELECT=58 {{(pid=118322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:07:35.051844 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [req-00271591-5dd1-44a2-9ebe-a0207a091186 req-b19ccb74-9b06-4fc1-b9ad-ec4c0d9c00f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc61e8d3-9ba9-49df-abb6-d241b489df43", "tag": "f803f441-8d77-4505-a12c-43c56212b371"}]} {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 12:07:35.055640 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-aff3d759-8df3-4bbd-af61-bdb7444265d1 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:07:35.056102 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-aff3d759-8df3-4bbd-af61-bdb7444265d1 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:07:35.056891 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-aff3d759-8df3-4bbd-af61-bdb7444265d1 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:07:35.057344 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-aff3d759-8df3-4bbd-af61-bdb7444265d1 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:07:35.061071 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [req-00271591-5dd1-44a2-9ebe-a0207a091186 req-b19ccb74-9b06-4fc1-b9ad-ec4c0d9c00f8 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:07:35.063312 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [req-00271591-5dd1-44a2-9ebe-a0207a091186 req-b19ccb74-9b06-4fc1-b9ad-ec4c0d9c00f8 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:07:35.075374 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.compute.server_external_events [req-00271591-5dd1-44a2-9ebe-a0207a091186 req-b19ccb74-9b06-4fc1-b9ad-ec4c0d9c00f8 service nova] Creating event network-changed:f803f441-8d77-4505-a12c-43c56212b371 for instance fc61e8d3-9ba9-49df-abb6-d241b489df43 on hv-cinder-84842 Jul 11 12:07:35.080006 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [req-00271591-5dd1-44a2-9ebe-a0207a091186 req-b19ccb74-9b06-4fc1-b9ad-ec4c0d9c00f8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043795 Jul 11 12:07:35.080637 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1582/3158] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 12:07:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 12:07:35.088272 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-aff3d759-8df3-4bbd-af61-bdb7444265d1 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] [instance: fc61e8d3-9ba9-49df-abb6-d241b489df43] Going to try to terminate instance {{(pid=118321) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 12:07:35.387791 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-aff3d759-8df3-4bbd-af61-bdb7444265d1 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] 10.222.0.26 "DELETE /compute/v2.1/servers/fc61e8d3-9ba9-49df-abb6-d241b489df43" status: 204 len: 0 microversion: 2.1 time: 0.356460 Jul 11 12:07:35.388580 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1577/3159] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 11 12:07:35 2022] DELETE /compute/v2.1/servers/fc61e8d3-9ba9-49df-abb6-d241b489df43 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 11 12:07:35.399808 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-c9801802-767e-4d43-a0f0-f8963a425176 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:07:35.400750 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-c9801802-767e-4d43-a0f0-f8963a425176 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] [instance: fc61e8d3-9ba9-49df-abb6-d241b489df43] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:07:35.408135 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c9801802-767e-4d43-a0f0-f8963a425176 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:07:35.408620 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c9801802-767e-4d43-a0f0-f8963a425176 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:07:35.409405 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c9801802-767e-4d43-a0f0-f8963a425176 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:07:35.409845 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-c9801802-767e-4d43-a0f0-f8963a425176 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:07:35.557178 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-c9801802-767e-4d43-a0f0-f8963a425176 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccd3de89cd94e5fa4c488c16d993241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c8c84b3f704d528ea772607da56ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:07:35.564861 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-c9801802-767e-4d43-a0f0-f8963a425176 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] 10.222.0.26 "GET /compute/v2.1/servers/fc61e8d3-9ba9-49df-abb6-d241b489df43" status: 200 len: 1575 microversion: 2.1 time: 0.171723 Jul 11 12:07:35.565441 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1583/3160] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:07:35 2022] GET /compute/v2.1/servers/fc61e8d3-9ba9-49df-abb6-d241b489df43 => generated 1575 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:07:36.584530 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-d6005cd6-88a5-4e60-8b87-c034693967b9 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:07:36.585228 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-d6005cd6-88a5-4e60-8b87-c034693967b9 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] [instance: fc61e8d3-9ba9-49df-abb6-d241b489df43] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:07:36.592836 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d6005cd6-88a5-4e60-8b87-c034693967b9 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:07:36.593284 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d6005cd6-88a5-4e60-8b87-c034693967b9 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:07:36.594306 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d6005cd6-88a5-4e60-8b87-c034693967b9 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:07:36.594737 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-d6005cd6-88a5-4e60-8b87-c034693967b9 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:07:36.610688 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO oslo.messaging._drivers.impl_rabbit [-] [6e7662ca-0840-4af7-a170-09ca74b9449f] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 53006. Jul 11 12:07:36.733508 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-d6005cd6-88a5-4e60-8b87-c034693967b9 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccd3de89cd94e5fa4c488c16d993241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c8c84b3f704d528ea772607da56ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:07:36.741396 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-d6005cd6-88a5-4e60-8b87-c034693967b9 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] 10.222.0.26 "GET /compute/v2.1/servers/fc61e8d3-9ba9-49df-abb6-d241b489df43" status: 200 len: 1575 microversion: 2.1 time: 0.161213 Jul 11 12:07:36.741960 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1578/3161] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:07:36 2022] GET /compute/v2.1/servers/fc61e8d3-9ba9-49df-abb6-d241b489df43 => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:07:37.358912 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [req-6ad02514-e684-4bca-9c8c-50df0a6e6b4e req-4bc2874d-d2d8-4ae8-a301-29dd2dfd4c79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc61e8d3-9ba9-49df-abb6-d241b489df43", "name": "network-vif-deleted", "tag": "f803f441-8d77-4505-a12c-43c56212b371"}]} {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 12:07:37.370393 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [req-6ad02514-e684-4bca-9c8c-50df0a6e6b4e req-4bc2874d-d2d8-4ae8-a301-29dd2dfd4c79 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:07:37.370840 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [req-6ad02514-e684-4bca-9c8c-50df0a6e6b4e req-4bc2874d-d2d8-4ae8-a301-29dd2dfd4c79 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:07:37.382314 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.compute.server_external_events [req-6ad02514-e684-4bca-9c8c-50df0a6e6b4e req-4bc2874d-d2d8-4ae8-a301-29dd2dfd4c79 service nova] Creating event network-vif-deleted:f803f441-8d77-4505-a12c-43c56212b371 for instance fc61e8d3-9ba9-49df-abb6-d241b489df43 on hv-cinder-84842 Jul 11 12:07:37.385850 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO oslo.messaging._drivers.impl_rabbit [-] [73153c7c-8222-4333-b8ec-ad525dae098f] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 53010. Jul 11 12:07:37.387595 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [req-6ad02514-e684-4bca-9c8c-50df0a6e6b4e req-4bc2874d-d2d8-4ae8-a301-29dd2dfd4c79 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032631 Jul 11 12:07:37.388174 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1584/3162] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 12:07:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 12:07:37.759832 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-ad3bbf05-336a-42de-a659-b6b71b172ebc tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:07:37.760464 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-ad3bbf05-336a-42de-a659-b6b71b172ebc tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] [instance: fc61e8d3-9ba9-49df-abb6-d241b489df43] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:07:37.767311 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ad3bbf05-336a-42de-a659-b6b71b172ebc tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:07:37.769692 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ad3bbf05-336a-42de-a659-b6b71b172ebc tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:07:37.769692 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ad3bbf05-336a-42de-a659-b6b71b172ebc tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:07:37.769692 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-ad3bbf05-336a-42de-a659-b6b71b172ebc tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:07:37.833816 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-ad3bbf05-336a-42de-a659-b6b71b172ebc tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccd3de89cd94e5fa4c488c16d993241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c8c84b3f704d528ea772607da56ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:07:37.841200 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-ad3bbf05-336a-42de-a659-b6b71b172ebc tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] 10.222.0.26 "GET /compute/v2.1/servers/fc61e8d3-9ba9-49df-abb6-d241b489df43" status: 200 len: 1225 microversion: 2.1 time: 0.085174 Jul 11 12:07:37.846923 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1579/3163] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:07:37 2022] GET /compute/v2.1/servers/fc61e8d3-9ba9-49df-abb6-d241b489df43 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:07:38.859197 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-7e21bbb6-bee5-4b5b-8b20-002ecbed3f74 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:07:38.859884 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-7e21bbb6-bee5-4b5b-8b20-002ecbed3f74 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] [instance: fc61e8d3-9ba9-49df-abb6-d241b489df43] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:07:38.866072 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7e21bbb6-bee5-4b5b-8b20-002ecbed3f74 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:07:38.866527 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7e21bbb6-bee5-4b5b-8b20-002ecbed3f74 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:07:38.867314 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7e21bbb6-bee5-4b5b-8b20-002ecbed3f74 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:07:38.867754 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-7e21bbb6-bee5-4b5b-8b20-002ecbed3f74 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:07:38.880429 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.wsgi [None req-7e21bbb6-bee5-4b5b-8b20-002ecbed3f74 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] HTTP exception thrown: Instance fc61e8d3-9ba9-49df-abb6-d241b489df43 could not be found. Jul 11 12:07:38.882034 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-7e21bbb6-bee5-4b5b-8b20-002ecbed3f74 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Request method failure captured: Jul 11 12:07:38.882034 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: request: GET /compute/v2.1/servers/fc61e8d3-9ba9-49df-abb6-d241b489df43 HTTP/1.1 Jul 11 12:07:38.882034 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Accept: application/json Jul 11 12:07:38.882034 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Accept-Encoding: identity Jul 11 12:07:38.882034 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Connection: close Jul 11 12:07:38.882034 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Content-Length: 0 Jul 11 12:07:38.882034 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Content-Type: application/json Jul 11 12:07:38.882034 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Host: 10.222.0.26 Jul 11 12:07:38.882034 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Openstack-System-Scope: None Jul 11 12:07:38.882034 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: User-Agent: python-urllib3/1.26.9 Jul 11 12:07:38.882034 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Auth-Token: gAAAAABizBDaJa--juSQOgepvWxEhFkHWWGDjwcDjE-IRMfk5vcpdIECWk87YnSeGR4IZ-36W9XdviUlQ7pk5DESoYIKRIDcJ4LlxhsBp3q7eh0PdGROFICBLM28bsvQiBpLtzWh7Yi8BhxeRNyNFmDYyG7K9v4C_YIh6sKgK4gBrMujZ7r58tU Jul 11 12:07:38.882034 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Domain-Id: None Jul 11 12:07:38.882034 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Domain-Name: None Jul 11 12:07:38.882034 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Identity-Status: Confirmed Jul 11 12:07:38.882034 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Is-Admin-Project: True Jul 11 12:07:38.882034 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Domain-Id: default Jul 11 12:07:38.882034 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Domain-Name: Default Jul 11 12:07:38.882034 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Id: 79c8c84b3f704d528ea772607da56ddf Jul 11 12:07:38.882034 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Name: tempest-TestVolumeBootPattern-1886729966 Jul 11 12:07:38.882034 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Role: member,reader Jul 11 12:07:38.882034 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Roles: member,reader Jul 11 12:07:38.883527 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_79c8c84b3f704d528ea772607da56ddf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/79c8c84b3f704d528ea772607da56ddf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/79c8c84b3f704d528ea772607da56ddf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/79c8c84b3f704d528ea772607da56ddf"}]}] Jul 11 12:07:38.883527 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Tenant: tempest-TestVolumeBootPattern-1886729966 Jul 11 12:07:38.883527 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Tenant-Id: 79c8c84b3f704d528ea772607da56ddf Jul 11 12:07:38.883527 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Tenant-Name: tempest-TestVolumeBootPattern-1886729966 Jul 11 12:07:38.883527 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User: tempest-TestVolumeBootPattern-1886729966-project Jul 11 12:07:38.883527 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Domain-Id: default Jul 11 12:07:38.883527 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Domain-Name: Default Jul 11 12:07:38.883527 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Id: fccd3de89cd94e5fa4c488c16d993241 Jul 11 12:07:38.883527 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Name: tempest-TestVolumeBootPattern-1886729966-project Jul 11 12:07:38.883527 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: method: > Jul 11 12:07:38.883527 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: exception: Instance fc61e8d3-9ba9-49df-abb6-d241b489df43 could not be found. Jul 11 12:07:38.883527 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: action_args: {'id': 'fc61e8d3-9ba9-49df-abb6-d241b489df43'} Jul 11 12:07:38.884383 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 12:07:38.884383 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 12:07:38.884383 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 12:07:38.884383 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 12:07:38.884383 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 12:07:38.884383 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 12:07:38.884383 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 12:07:38.884383 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 12:07:38.884383 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 12:07:38.884383 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 12:07:38.884383 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc61e8d3-9ba9-49df-abb6-d241b489df43 could not be found. Jul 11 12:07:38.884383 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 12:07:38.884383 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 12:07:38.884383 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 12:07:38.884383 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 12:07:38.884383 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 12:07:38.884383 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 12:07:38.884383 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 12:07:38.884383 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 12:07:38.884383 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 12:07:38.885723 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 12:07:38.885723 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 12:07:38.885723 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 12:07:38.885723 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 12:07:38.885723 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 12:07:38.885723 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 12:07:38.885723 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 12:07:38.885723 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc61e8d3-9ba9-49df-abb6-d241b489df43 could not be found. Jul 11 12:07:38.885723 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 12:07:38.885723 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 12:07:38.885723 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 12:07:38.885723 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 12:07:38.885723 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 12:07:38.885723 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 12:07:38.885723 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 12:07:38.885723 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 12:07:38.885723 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc61e8d3-9ba9-49df-abb6-d241b489df43 could not be found. Jul 11 12:07:38.885723 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 12:07:38.887085 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-7e21bbb6-bee5-4b5b-8b20-002ecbed3f74 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Returning 404 to user: Instance fc61e8d3-9ba9-49df-abb6-d241b489df43 could not be found. {{(pid=118322) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 12:07:38.887085 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-7e21bbb6-bee5-4b5b-8b20-002ecbed3f74 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] 10.222.0.26 "GET /compute/v2.1/servers/fc61e8d3-9ba9-49df-abb6-d241b489df43" status: 404 len: 111 microversion: 2.1 time: 0.028904 Jul 11 12:07:38.887085 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1585/3164] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:07:38 2022] GET /compute/v2.1/servers/fc61e8d3-9ba9-49df-abb6-d241b489df43 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 12:07:42.461111 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-a6f05138-42e6-438e-88d6-e79f7c1e1621 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:07:42.461664 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-a6f05138-42e6-438e-88d6-e79f7c1e1621 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] [instance: a3e27550-bea7-476f-9f87-0959b4f70f5f] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:07:42.468402 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a6f05138-42e6-438e-88d6-e79f7c1e1621 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:07:42.469225 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a6f05138-42e6-438e-88d6-e79f7c1e1621 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:07:42.469908 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a6f05138-42e6-438e-88d6-e79f7c1e1621 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:07:42.470342 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a6f05138-42e6-438e-88d6-e79f7c1e1621 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:07:42.496135 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-a6f05138-42e6-438e-88d6-e79f7c1e1621 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] [instance: a3e27550-bea7-476f-9f87-0959b4f70f5f] Going to try to terminate instance {{(pid=118321) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 12:07:42.580033 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [req-b551d6d3-c51f-42b6-9b30-e50886eb2632 req-35e731c2-08c8-47b1-ae16-4d6bf5f86488 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3e27550-bea7-476f-9f87-0959b4f70f5f", "tag": "1af9c038-cece-4cea-a40d-f3d876bdddc2"}]} {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 12:07:42.589181 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [req-b551d6d3-c51f-42b6-9b30-e50886eb2632 req-35e731c2-08c8-47b1-ae16-4d6bf5f86488 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:07:42.590826 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [req-b551d6d3-c51f-42b6-9b30-e50886eb2632 req-35e731c2-08c8-47b1-ae16-4d6bf5f86488 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:07:42.600188 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.compute.server_external_events [req-b551d6d3-c51f-42b6-9b30-e50886eb2632 req-35e731c2-08c8-47b1-ae16-4d6bf5f86488 service nova] Creating event network-changed:1af9c038-cece-4cea-a40d-f3d876bdddc2 for instance a3e27550-bea7-476f-9f87-0959b4f70f5f on hv-cinder-84842 Jul 11 12:07:42.605180 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [req-b551d6d3-c51f-42b6-9b30-e50886eb2632 req-35e731c2-08c8-47b1-ae16-4d6bf5f86488 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144877 Jul 11 12:07:42.605762 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1586/3165] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 12:07:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 12:07:42.792079 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-a6f05138-42e6-438e-88d6-e79f7c1e1621 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a3e27550-bea7-476f-9f87-0959b4f70f5f" status: 204 len: 0 microversion: 2.1 time: 0.335029 Jul 11 12:07:42.797297 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1580/3166] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 11 12:07:42 2022] DELETE /compute/v2.1/servers/a3e27550-bea7-476f-9f87-0959b4f70f5f => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 11 12:07:42.801318 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-f39dee01-d8c8-45a1-80cb-d770029c4b02 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:07:42.802013 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-f39dee01-d8c8-45a1-80cb-d770029c4b02 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] [instance: a3e27550-bea7-476f-9f87-0959b4f70f5f] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:07:42.808885 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f39dee01-d8c8-45a1-80cb-d770029c4b02 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:07:42.809330 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f39dee01-d8c8-45a1-80cb-d770029c4b02 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:07:42.810091 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f39dee01-d8c8-45a1-80cb-d770029c4b02 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:07:42.810522 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-f39dee01-d8c8-45a1-80cb-d770029c4b02 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:07:42.942954 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.policy [None req-f39dee01-d8c8-45a1-80cb-d770029c4b02 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccd3de89cd94e5fa4c488c16d993241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c8c84b3f704d528ea772607da56ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118322) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:07:42.950465 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-f39dee01-d8c8-45a1-80cb-d770029c4b02 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] 10.222.0.26 "GET /compute/v2.1/servers/a3e27550-bea7-476f-9f87-0959b4f70f5f" status: 200 len: 1578 microversion: 2.1 time: 0.153328 Jul 11 12:07:42.951035 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1587/3167] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:07:42 2022] GET /compute/v2.1/servers/a3e27550-bea7-476f-9f87-0959b4f70f5f => generated 1578 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:07:43.968020 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-2bbb96f3-cf05-450b-b4bf-fd9095013638 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:07:43.968707 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-2bbb96f3-cf05-450b-b4bf-fd9095013638 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] [instance: a3e27550-bea7-476f-9f87-0959b4f70f5f] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:07:43.975827 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2bbb96f3-cf05-450b-b4bf-fd9095013638 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:07:43.976268 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2bbb96f3-cf05-450b-b4bf-fd9095013638 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:07:43.977016 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2bbb96f3-cf05-450b-b4bf-fd9095013638 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:07:43.977478 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2bbb96f3-cf05-450b-b4bf-fd9095013638 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:07:44.123242 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-2bbb96f3-cf05-450b-b4bf-fd9095013638 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccd3de89cd94e5fa4c488c16d993241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c8c84b3f704d528ea772607da56ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:07:44.130735 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-2bbb96f3-cf05-450b-b4bf-fd9095013638 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] 10.222.0.26 "GET /compute/v2.1/servers/a3e27550-bea7-476f-9f87-0959b4f70f5f" status: 200 len: 1578 microversion: 2.1 time: 0.166839 Jul 11 12:07:44.131321 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1581/3168] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:07:43 2022] GET /compute/v2.1/servers/a3e27550-bea7-476f-9f87-0959b4f70f5f => generated 1578 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:07:44.737800 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [req-7159c81b-2813-43ef-93db-12359e18bdb9 req-5b5f7e38-4075-4f3f-ae36-20f025c9eb43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3e27550-bea7-476f-9f87-0959b4f70f5f", "name": "network-vif-deleted", "tag": "1af9c038-cece-4cea-a40d-f3d876bdddc2"}]} {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 12:07:44.747058 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [req-7159c81b-2813-43ef-93db-12359e18bdb9 req-5b5f7e38-4075-4f3f-ae36-20f025c9eb43 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:07:44.747617 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [req-7159c81b-2813-43ef-93db-12359e18bdb9 req-5b5f7e38-4075-4f3f-ae36-20f025c9eb43 service nova] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:07:44.759042 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.compute.server_external_events [req-7159c81b-2813-43ef-93db-12359e18bdb9 req-5b5f7e38-4075-4f3f-ae36-20f025c9eb43 service nova] Creating event network-vif-deleted:1af9c038-cece-4cea-a40d-f3d876bdddc2 for instance a3e27550-bea7-476f-9f87-0959b4f70f5f on hv-cinder-84842 Jul 11 12:07:44.763851 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [req-7159c81b-2813-43ef-93db-12359e18bdb9 req-5b5f7e38-4075-4f3f-ae36-20f025c9eb43 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029812 Jul 11 12:07:44.764429 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1588/3169] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 11 12:07:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 12:07:45.148141 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-2291c8d5-6fd2-4259-a094-92952816ede0 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:07:45.148901 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-2291c8d5-6fd2-4259-a094-92952816ede0 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] [instance: a3e27550-bea7-476f-9f87-0959b4f70f5f] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:07:45.157332 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2291c8d5-6fd2-4259-a094-92952816ede0 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:07:45.157689 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2291c8d5-6fd2-4259-a094-92952816ede0 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:07:45.158462 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2291c8d5-6fd2-4259-a094-92952816ede0 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:07:45.158900 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-2291c8d5-6fd2-4259-a094-92952816ede0 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:07:45.221053 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.policy [None req-2291c8d5-6fd2-4259-a094-92952816ede0 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccd3de89cd94e5fa4c488c16d993241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c8c84b3f704d528ea772607da56ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 12:07:45.229083 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-2291c8d5-6fd2-4259-a094-92952816ede0 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] 10.222.0.26 "GET /compute/v2.1/servers/a3e27550-bea7-476f-9f87-0959b4f70f5f" status: 200 len: 1226 microversion: 2.1 time: 0.085000 Jul 11 12:07:45.229646 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1582/3170] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:07:45 2022] GET /compute/v2.1/servers/a3e27550-bea7-476f-9f87-0959b4f70f5f => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 12:07:46.246257 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-68e7284d-d0ae-4ff5-8f43-7f3a66070ee7 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:07:46.247005 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-68e7284d-d0ae-4ff5-8f43-7f3a66070ee7 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] [instance: a3e27550-bea7-476f-9f87-0959b4f70f5f] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:07:46.253758 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-68e7284d-d0ae-4ff5-8f43-7f3a66070ee7 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:07:46.254203 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-68e7284d-d0ae-4ff5-8f43-7f3a66070ee7 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:07:46.254944 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-68e7284d-d0ae-4ff5-8f43-7f3a66070ee7 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:07:46.255409 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-68e7284d-d0ae-4ff5-8f43-7f3a66070ee7 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:07:46.269536 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.wsgi [None req-68e7284d-d0ae-4ff5-8f43-7f3a66070ee7 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] HTTP exception thrown: Instance a3e27550-bea7-476f-9f87-0959b4f70f5f could not be found. Jul 11 12:07:46.271808 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-68e7284d-d0ae-4ff5-8f43-7f3a66070ee7 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Request method failure captured: Jul 11 12:07:46.271808 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: request: GET /compute/v2.1/servers/a3e27550-bea7-476f-9f87-0959b4f70f5f HTTP/1.1 Jul 11 12:07:46.271808 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Accept: application/json Jul 11 12:07:46.271808 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Accept-Encoding: identity Jul 11 12:07:46.271808 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Connection: close Jul 11 12:07:46.271808 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Content-Length: 0 Jul 11 12:07:46.271808 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Content-Type: application/json Jul 11 12:07:46.271808 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Host: 10.222.0.26 Jul 11 12:07:46.271808 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Openstack-System-Scope: None Jul 11 12:07:46.271808 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: User-Agent: python-urllib3/1.26.9 Jul 11 12:07:46.271808 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Auth-Token: gAAAAABizBDaJa--juSQOgepvWxEhFkHWWGDjwcDjE-IRMfk5vcpdIECWk87YnSeGR4IZ-36W9XdviUlQ7pk5DESoYIKRIDcJ4LlxhsBp3q7eh0PdGROFICBLM28bsvQiBpLtzWh7Yi8BhxeRNyNFmDYyG7K9v4C_YIh6sKgK4gBrMujZ7r58tU Jul 11 12:07:46.271808 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Domain-Id: None Jul 11 12:07:46.271808 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Domain-Name: None Jul 11 12:07:46.271808 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Identity-Status: Confirmed Jul 11 12:07:46.271808 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Is-Admin-Project: True Jul 11 12:07:46.271808 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Domain-Id: default Jul 11 12:07:46.271808 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Domain-Name: Default Jul 11 12:07:46.271808 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Id: 79c8c84b3f704d528ea772607da56ddf Jul 11 12:07:46.271808 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Name: tempest-TestVolumeBootPattern-1886729966 Jul 11 12:07:46.271808 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Role: member,reader Jul 11 12:07:46.271808 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Roles: member,reader Jul 11 12:07:46.273343 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_79c8c84b3f704d528ea772607da56ddf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/79c8c84b3f704d528ea772607da56ddf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/79c8c84b3f704d528ea772607da56ddf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/79c8c84b3f704d528ea772607da56ddf"}]}] Jul 11 12:07:46.273343 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Tenant: tempest-TestVolumeBootPattern-1886729966 Jul 11 12:07:46.273343 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Tenant-Id: 79c8c84b3f704d528ea772607da56ddf Jul 11 12:07:46.273343 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Tenant-Name: tempest-TestVolumeBootPattern-1886729966 Jul 11 12:07:46.273343 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User: tempest-TestVolumeBootPattern-1886729966-project Jul 11 12:07:46.273343 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Domain-Id: default Jul 11 12:07:46.273343 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Domain-Name: Default Jul 11 12:07:46.273343 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Id: fccd3de89cd94e5fa4c488c16d993241 Jul 11 12:07:46.273343 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Name: tempest-TestVolumeBootPattern-1886729966-project Jul 11 12:07:46.273343 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: method: > Jul 11 12:07:46.273343 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: exception: Instance a3e27550-bea7-476f-9f87-0959b4f70f5f could not be found. Jul 11 12:07:46.273343 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: action_args: {'id': 'a3e27550-bea7-476f-9f87-0959b4f70f5f'} Jul 11 12:07:46.274181 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 12:07:46.274181 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 12:07:46.274181 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 12:07:46.274181 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 12:07:46.274181 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 12:07:46.274181 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 12:07:46.274181 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 12:07:46.274181 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 12:07:46.274181 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 12:07:46.274181 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 12:07:46.274181 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3e27550-bea7-476f-9f87-0959b4f70f5f could not be found. Jul 11 12:07:46.274181 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 12:07:46.274181 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 12:07:46.274181 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 12:07:46.274181 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 12:07:46.274181 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 12:07:46.274181 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 12:07:46.274181 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 12:07:46.274181 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 12:07:46.274181 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 12:07:46.275576 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 12:07:46.275576 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 12:07:46.275576 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 12:07:46.275576 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 12:07:46.275576 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 12:07:46.275576 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 12:07:46.275576 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 12:07:46.275576 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3e27550-bea7-476f-9f87-0959b4f70f5f could not be found. Jul 11 12:07:46.275576 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 12:07:46.275576 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 12:07:46.275576 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 12:07:46.275576 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 12:07:46.275576 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 12:07:46.275576 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 12:07:46.275576 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 12:07:46.275576 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 12:07:46.275576 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3e27550-bea7-476f-9f87-0959b4f70f5f could not be found. Jul 11 12:07:46.275576 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 12:07:46.276768 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-68e7284d-d0ae-4ff5-8f43-7f3a66070ee7 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Returning 404 to user: Instance a3e27550-bea7-476f-9f87-0959b4f70f5f could not be found. {{(pid=118322) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 12:07:46.276768 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-68e7284d-d0ae-4ff5-8f43-7f3a66070ee7 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] 10.222.0.26 "GET /compute/v2.1/servers/a3e27550-bea7-476f-9f87-0959b4f70f5f" status: 404 len: 111 microversion: 2.1 time: 0.031400 Jul 11 12:07:46.276768 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1589/3171] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:07:46 2022] GET /compute/v2.1/servers/a3e27550-bea7-476f-9f87-0959b4f70f5f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 12:07:46.759270 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-a02c7750-52eb-4bf3-974f-b62d3203c06e tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Calling method '>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:07:46.759783 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.compute.api [None req-a02c7750-52eb-4bf3-974f-b62d3203c06e tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] [instance: 929579db-279b-44f9-bdb4-ccac4a6f9b59] Fetching instance by UUID {{(pid=118321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:07:46.766240 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a02c7750-52eb-4bf3-974f-b62d3203c06e tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:07:46.766695 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a02c7750-52eb-4bf3-974f-b62d3203c06e tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:07:46.767478 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a02c7750-52eb-4bf3-974f-b62d3203c06e tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:07:46.767911 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG oslo_concurrency.lockutils [None req-a02c7750-52eb-4bf3-974f-b62d3203c06e tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:07:46.781563 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.wsgi [None req-a02c7750-52eb-4bf3-974f-b62d3203c06e tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] HTTP exception thrown: Instance 929579db-279b-44f9-bdb4-ccac4a6f9b59 could not be found. Jul 11 12:07:46.783191 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-a02c7750-52eb-4bf3-974f-b62d3203c06e tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Request method failure captured: Jul 11 12:07:46.783191 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: request: DELETE /compute/v2.1/servers/929579db-279b-44f9-bdb4-ccac4a6f9b59 HTTP/1.1 Jul 11 12:07:46.783191 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Accept: application/json Jul 11 12:07:46.783191 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Accept-Encoding: identity Jul 11 12:07:46.783191 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Connection: close Jul 11 12:07:46.783191 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Content-Length: 0 Jul 11 12:07:46.783191 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Content-Type: application/json Jul 11 12:07:46.783191 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Host: 10.222.0.26 Jul 11 12:07:46.783191 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Openstack-System-Scope: None Jul 11 12:07:46.783191 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: User-Agent: python-urllib3/1.26.9 Jul 11 12:07:46.783191 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Auth-Token: gAAAAABizBDaJa--juSQOgepvWxEhFkHWWGDjwcDjE-IRMfk5vcpdIECWk87YnSeGR4IZ-36W9XdviUlQ7pk5DESoYIKRIDcJ4LlxhsBp3q7eh0PdGROFICBLM28bsvQiBpLtzWh7Yi8BhxeRNyNFmDYyG7K9v4C_YIh6sKgK4gBrMujZ7r58tU Jul 11 12:07:46.783191 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Domain-Id: None Jul 11 12:07:46.783191 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Domain-Name: None Jul 11 12:07:46.783191 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Identity-Status: Confirmed Jul 11 12:07:46.783191 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Is-Admin-Project: True Jul 11 12:07:46.783191 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Domain-Id: default Jul 11 12:07:46.783191 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Domain-Name: Default Jul 11 12:07:46.783191 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Id: 79c8c84b3f704d528ea772607da56ddf Jul 11 12:07:46.783191 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Project-Name: tempest-TestVolumeBootPattern-1886729966 Jul 11 12:07:46.783191 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Role: member,reader Jul 11 12:07:46.783191 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Roles: member,reader Jul 11 12:07:46.784612 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_79c8c84b3f704d528ea772607da56ddf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/79c8c84b3f704d528ea772607da56ddf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/79c8c84b3f704d528ea772607da56ddf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/79c8c84b3f704d528ea772607da56ddf"}]}] Jul 11 12:07:46.784612 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Tenant: tempest-TestVolumeBootPattern-1886729966 Jul 11 12:07:46.784612 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Tenant-Id: 79c8c84b3f704d528ea772607da56ddf Jul 11 12:07:46.784612 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-Tenant-Name: tempest-TestVolumeBootPattern-1886729966 Jul 11 12:07:46.784612 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User: tempest-TestVolumeBootPattern-1886729966-project Jul 11 12:07:46.784612 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Domain-Id: default Jul 11 12:07:46.784612 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Domain-Name: Default Jul 11 12:07:46.784612 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Id: fccd3de89cd94e5fa4c488c16d993241 Jul 11 12:07:46.784612 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: X-User-Name: tempest-TestVolumeBootPattern-1886729966-project Jul 11 12:07:46.784612 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: method: > Jul 11 12:07:46.784612 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: exception: Instance 929579db-279b-44f9-bdb4-ccac4a6f9b59 could not be found. Jul 11 12:07:46.784612 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: action_args: {'id': '929579db-279b-44f9-bdb4-ccac4a6f9b59'} Jul 11 12:07:46.785444 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 12:07:46.785444 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 12:07:46.785444 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 12:07:46.785444 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 12:07:46.785444 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 12:07:46.785444 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 12:07:46.785444 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 12:07:46.785444 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 12:07:46.785444 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 12:07:46.785444 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 12:07:46.785444 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 929579db-279b-44f9-bdb4-ccac4a6f9b59 could not be found. Jul 11 12:07:46.785444 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 12:07:46.785444 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 12:07:46.785444 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 12:07:46.785444 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 12:07:46.785444 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 12:07:46.785444 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 12:07:46.785444 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 12:07:46.785444 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 12:07:46.785444 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 12:07:46.786763 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 12:07:46.786763 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 11 12:07:46.786763 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 11 12:07:46.786763 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 11 12:07:46.786763 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 11 12:07:46.786763 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 12:07:46.786763 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 12:07:46.786763 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 12:07:46.786763 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 12:07:46.786763 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 929579db-279b-44f9-bdb4-ccac4a6f9b59 could not be found. Jul 11 12:07:46.786763 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 12:07:46.786763 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 12:07:46.786763 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 12:07:46.786763 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 12:07:46.786763 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 12:07:46.786763 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 12:07:46.786763 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 12:07:46.786763 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 12:07:46.786763 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 929579db-279b-44f9-bdb4-ccac4a6f9b59 could not be found. Jul 11 12:07:46.786763 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR nova.api.openstack.wsgi Jul 11 12:07:46.788196 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-a02c7750-52eb-4bf3-974f-b62d3203c06e tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Returning 404 to user: Instance 929579db-279b-44f9-bdb4-ccac4a6f9b59 could not be found. {{(pid=118321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 12:07:46.788196 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-a02c7750-52eb-4bf3-974f-b62d3203c06e tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] 10.222.0.26 "DELETE /compute/v2.1/servers/929579db-279b-44f9-bdb4-ccac4a6f9b59" status: 404 len: 111 microversion: 2.1 time: 0.029895 Jul 11 12:07:46.788196 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1583/3172] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 11 12:07:46 2022] DELETE /compute/v2.1/servers/929579db-279b-44f9-bdb4-ccac4a6f9b59 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 12:07:46.794226 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-a0dd1821-fa40-4a13-a964-c72b2af65557 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Calling method '>' {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:07:46.794830 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.compute.api [None req-a0dd1821-fa40-4a13-a964-c72b2af65557 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] [instance: 929579db-279b-44f9-bdb4-ccac4a6f9b59] Fetching instance by UUID {{(pid=118322) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 12:07:46.800858 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a0dd1821-fa40-4a13-a964-c72b2af65557 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:07:46.801297 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a0dd1821-fa40-4a13-a964-c72b2af65557 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:07:46.802442 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a0dd1821-fa40-4a13-a964-c72b2af65557 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 12:07:46.802881 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG oslo_concurrency.lockutils [None req-a0dd1821-fa40-4a13-a964-c72b2af65557 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Lock "342f6239-eef4-41fd-9223-51ec0b89b6f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118322) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 12:07:46.817724 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.wsgi [None req-a0dd1821-fa40-4a13-a964-c72b2af65557 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] HTTP exception thrown: Instance 929579db-279b-44f9-bdb4-ccac4a6f9b59 could not be found. Jul 11 12:07:46.819797 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-a0dd1821-fa40-4a13-a964-c72b2af65557 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Request method failure captured: Jul 11 12:07:46.819797 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: request: GET /compute/v2.1/servers/929579db-279b-44f9-bdb4-ccac4a6f9b59 HTTP/1.1 Jul 11 12:07:46.819797 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Accept: application/json Jul 11 12:07:46.819797 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Accept-Encoding: identity Jul 11 12:07:46.819797 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Connection: close Jul 11 12:07:46.819797 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Content-Length: 0 Jul 11 12:07:46.819797 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Content-Type: application/json Jul 11 12:07:46.819797 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Host: 10.222.0.26 Jul 11 12:07:46.819797 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Openstack-System-Scope: None Jul 11 12:07:46.819797 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: User-Agent: python-urllib3/1.26.9 Jul 11 12:07:46.819797 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Auth-Token: gAAAAABizBDaJa--juSQOgepvWxEhFkHWWGDjwcDjE-IRMfk5vcpdIECWk87YnSeGR4IZ-36W9XdviUlQ7pk5DESoYIKRIDcJ4LlxhsBp3q7eh0PdGROFICBLM28bsvQiBpLtzWh7Yi8BhxeRNyNFmDYyG7K9v4C_YIh6sKgK4gBrMujZ7r58tU Jul 11 12:07:46.819797 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Domain-Id: None Jul 11 12:07:46.819797 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Domain-Name: None Jul 11 12:07:46.819797 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Identity-Status: Confirmed Jul 11 12:07:46.819797 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Is-Admin-Project: True Jul 11 12:07:46.819797 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Domain-Id: default Jul 11 12:07:46.819797 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Domain-Name: Default Jul 11 12:07:46.819797 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Id: 79c8c84b3f704d528ea772607da56ddf Jul 11 12:07:46.819797 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Project-Name: tempest-TestVolumeBootPattern-1886729966 Jul 11 12:07:46.819797 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Role: member,reader Jul 11 12:07:46.819797 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Roles: member,reader Jul 11 12:07:46.821234 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_79c8c84b3f704d528ea772607da56ddf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/79c8c84b3f704d528ea772607da56ddf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/79c8c84b3f704d528ea772607da56ddf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/79c8c84b3f704d528ea772607da56ddf"}]}] Jul 11 12:07:46.821234 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Tenant: tempest-TestVolumeBootPattern-1886729966 Jul 11 12:07:46.821234 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Tenant-Id: 79c8c84b3f704d528ea772607da56ddf Jul 11 12:07:46.821234 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-Tenant-Name: tempest-TestVolumeBootPattern-1886729966 Jul 11 12:07:46.821234 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User: tempest-TestVolumeBootPattern-1886729966-project Jul 11 12:07:46.821234 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Domain-Id: default Jul 11 12:07:46.821234 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Domain-Name: Default Jul 11 12:07:46.821234 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Id: fccd3de89cd94e5fa4c488c16d993241 Jul 11 12:07:46.821234 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: X-User-Name: tempest-TestVolumeBootPattern-1886729966-project Jul 11 12:07:46.821234 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: method: > Jul 11 12:07:46.821234 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: exception: Instance 929579db-279b-44f9-bdb4-ccac4a6f9b59 could not be found. Jul 11 12:07:46.821234 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: action_args: {'id': '929579db-279b-44f9-bdb4-ccac4a6f9b59'} Jul 11 12:07:46.822017 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: {{(pid=118322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 12:07:46.822017 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 12:07:46.822017 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 12:07:46.822017 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 12:07:46.822017 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 12:07:46.822017 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 12:07:46.822017 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 12:07:46.822017 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 12:07:46.822017 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 12:07:46.822017 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 12:07:46.822017 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 929579db-279b-44f9-bdb4-ccac4a6f9b59 could not be found. Jul 11 12:07:46.822017 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 12:07:46.822017 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 12:07:46.822017 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 12:07:46.822017 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 12:07:46.822017 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 12:07:46.822017 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 12:07:46.822017 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 12:07:46.822017 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 12:07:46.822017 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 12:07:46.823074 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 12:07:46.823074 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 12:07:46.823074 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 12:07:46.823074 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 12:07:46.823074 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 12:07:46.823074 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 12:07:46.823074 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 12:07:46.823074 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 929579db-279b-44f9-bdb4-ccac4a6f9b59 could not be found. Jul 11 12:07:46.823074 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 12:07:46.823074 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 12:07:46.823074 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 12:07:46.823074 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 12:07:46.823074 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 12:07:46.823074 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 12:07:46.823074 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 12:07:46.823074 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 12:07:46.823074 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 929579db-279b-44f9-bdb4-ccac4a6f9b59 could not be found. Jul 11 12:07:46.823074 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: ERROR nova.api.openstack.wsgi Jul 11 12:07:46.824060 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: DEBUG nova.api.openstack.wsgi [None req-a0dd1821-fa40-4a13-a964-c72b2af65557 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Returning 404 to user: Instance 929579db-279b-44f9-bdb4-ccac4a6f9b59 could not be found. {{(pid=118322) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 12:07:46.824060 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO nova.api.openstack.requestlog [None req-a0dd1821-fa40-4a13-a964-c72b2af65557 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] 10.222.0.26 "GET /compute/v2.1/servers/929579db-279b-44f9-bdb4-ccac4a6f9b59" status: 404 len: 111 microversion: 2.1 time: 0.030662 Jul 11 12:07:46.824060 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: [pid: 118322|app: 0|req: 1590/3173] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 11 12:07:46 2022] GET /compute/v2.1/servers/929579db-279b-44f9-bdb4-ccac4a6f9b59 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 12:07:48.317395 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: DEBUG nova.api.openstack.wsgi [None req-3ca410ec-7ea5-4ca7-abb2-3c992a8e62f8 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] Calling method '.version_select at 0x7fb014225670>' {{(pid=118321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 12:07:48.318603 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3ca410ec-7ea5-4ca7-abb2-3c992a8e62f8 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] [7db4667c-0f44-4e99-8064-10feb45379e7] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 11 12:07:49.326672 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO oslo.messaging._drivers.impl_rabbit [None req-3ca410ec-7ea5-4ca7-abb2-3c992a8e62f8 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] [7db4667c-0f44-4e99-8064-10feb45379e7] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 53072. Jul 11 12:07:49.401579 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO nova.api.openstack.requestlog [None req-3ca410ec-7ea5-4ca7-abb2-3c992a8e62f8 tempest-TestVolumeBootPattern-1886729966 tempest-TestVolumeBootPattern-1886729966-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1764556180" status: 202 len: 0 microversion: 2.1 time: 1.092076 Jul 11 12:07:49.402159 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: [pid: 118321|app: 0|req: 1584/3174] 10.222.0.26 () {58 vars in 1262 bytes} [Mon Jul 11 12:07:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1764556180 => generated 0 bytes in 1093 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 12:09:18.449335 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 12:09:18.450092 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Mon Jul 11 12:09:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 12:09:19.062946 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 12:09:19.063434 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Mon Jul 11 12:09:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 12:11:01.981389 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 12:11:01.982202 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Mon Jul 11 12:11:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 12:12:38.457135 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 12:12:38.457727 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Mon Jul 11 12:12:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 12:12:39.070435 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 12:12:39.070989 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Mon Jul 11 12:12:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 12:12:55.087530 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 12:12:55.088095 dv-cinder-848429-2-iscsi devstack@n-api.service[118322]: Mon Jul 11 12:12:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 12:13:03.715179 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 12:13:03.715766 dv-cinder-848429-2-iscsi devstack@n-api.service[118321]: Mon Jul 11 12:13:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!